Comparing
LincolnBurrows2017:fix/shared-mutable-dict-bug
(3e33117
) withmaster
(5624001
)+36%
- Improvement
- 9
- Untouched
- 4
- Skipped
- 23
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.No successful run was found on master ( 4a632cf) during the generation of this report, so 5624001 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
36 total
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py+36%
25.8 ms*19 ms
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py+15%
668.1 ms*580.6 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py+13%
569.9 ms*504.4 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py+12%
571.8 ms*508.7 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py+12%
196.2 ms*174.7 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py+12%
475.3 ms*425.8 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py+11%
526.3 ms*474.3 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py+10%
182.8 ms*166 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py+10%
639.9 ms*581.7 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py+9%
521.5 ms*477 ms
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py+9%
274.5 ms*252.1 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py+9%
329.8 ms*303.4 ms
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py+8%
556 ms*516.9 ms
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.pySkipped
225 ms*
test_nomic_embeddings_init_time
libs/partners/nomic/tests/unit_tests/test_standard.pySkipped
1.5 ms*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandardSkipped
1.1 ms*
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandardSkipped
1.6 s*
test_init_time
libs/partners/openrouter/tests/unit_tests/test_standard.py::TestChatOpenRouterUnitSkipped
1.5 s*
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandardSkipped
6.6 s*
test_init_time
libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandardSkipped
1.7 s*
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnitSkipped
1.6 s*
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandardSkipped
9.2 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
821.1 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
12.2 ms*
Commits
Click on a commit to change the comparison rangeBase
master
5624001
+35.96%
fix(core): create independent dicts in BaseLLM metadata_list construction
3e33117
16 hours ago