mdrxy/fix-usage - Branch - langchain-ai/langchain

fix(core): extract usage metadata from serialized tracer message outputs

#35526Merged

Comparing

mdrxy/fix-usage

(

f9ac259

) with

master

(

cdf140e

)

-2%

Untouched: 13

Skipped: 23

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

No successful run was found on master ( d2c86df) during the generation of this report, so cdf140e was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

36 total

test_import_time[HumanMessage]

libs/core/tests/benchmarks/test_imports.py

274.2 ms275.5 ms

test_import_time[RunnableLambda]

libs/core/tests/benchmarks/test_imports.py

-1%

519.5 ms522.7 ms

test_async_callbacks_in_sync

libs/core/tests/benchmarks/test_async_callbacks.py

-1%

25.8 ms26 ms

test_import_time[BaseChatModel]

libs/core/tests/benchmarks/test_imports.py

-1%

560.9 ms567.2 ms

test_import_time[Runnable]

libs/core/tests/benchmarks/test_imports.py

-2%

513.6 ms521.9 ms

test_import_time[PydanticOutputParser]

libs/core/tests/benchmarks/test_imports.py

-2%

573.6 ms584.3 ms

test_import_time[tool]

libs/core/tests/benchmarks/test_imports.py

-2%

561.9 ms572.7 ms

test_import_time[ChatPromptTemplate]

libs/core/tests/benchmarks/test_imports.py

-2%

660.6 ms676 ms

test_import_time[Document]

libs/core/tests/benchmarks/test_imports.py

-2%

197.5 ms202.4 ms

test_import_time[CallbackManager]

libs/core/tests/benchmarks/test_imports.py

-2%

328.2 ms336.5 ms

test_import_time[LangChainTracer]

libs/core/tests/benchmarks/test_imports.py

-3%

475 ms488.9 ms

test_import_time[InMemoryRateLimiter]

libs/core/tests/benchmarks/test_imports.py

-4%

178.3 ms186.3 ms

test_import_time[InMemoryVectorStore]

libs/core/tests/benchmarks/test_imports.py

-6%

625.8 ms664.4 ms

The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

test_create_chat_prompt_init_time

libs/partners/prompty/tests/unit_tests/test_standard.py

Skipped

311.9 µs*

test_qdrant_vectorstore_init_time

libs/partners/qdrant/tests/unit_tests/test_standard.py

Skipped

225 ms*

test_exa_retriever_init_time

libs/partners/exa/tests/unit_tests/test_standard.py

Skipped

316.4 µs*

test_init_time

libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama

Skipped

1.6 s*

test_nomic_embeddings_init_time

libs/partners/nomic/tests/unit_tests/test_standard.py

Skipped

1.5 ms*

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

6.6 s*

test_init_time

libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard

Skipped

9.2 ms*

test_init_time

libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard

Skipped

3.3 s*

test_init_time

libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard

Skipped

1.6 s*

test_init_time

libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard

Skipped

1.7 s*

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandard

Skipped

1.1 ms*

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard

Skipped

807.1 µs*

Commits

Click on a commit to change the comparison range

Base

master

cdf140e

+3.42%

fix(core): extract usage metadata from serialized tracer message outputs

4dd0f6a

3 months ago

by mdrxy

-5.61%

docs

f9ac259

3 months ago

by mdrxy

Home Terms Privacy Docs