Comparing
thromel:fix/pydantic-json-schema-error
(32a1e52
) withmaster
(d6e46bb
)+35%
- Improvement
- 13
- Skipped
- 23
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
36 total
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py+35%
24.5 ms18.1 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py+26%
601.5 ms477.9 ms
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py+23%
680.4 ms551.8 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py+22%
659.2 ms542.4 ms
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py+21%
580.6 ms479.6 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py+20%
583.2 ms486.5 ms
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py+20%
287.6 ms240.1 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py+19%
533.9 ms447.9 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py+19%
344.5 ms289.6 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py+18%
201 ms169.8 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py+17%
540.3 ms461.7 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py+16%
487.6 ms419.7 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py+14%
184 ms161.4 ms
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_chroma_init_time
libs/partners/chroma/tests/unit_tests/test_standard.pySkipped
60 ms*
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.pySkipped
225 ms*
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.pySkipped
316.4 µs*
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllamaSkipped
1.6 s*
test_nomic_embeddings_init_time
libs/partners/nomic/tests/unit_tests/test_standard.pySkipped
1.5 ms*
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandardSkipped
6.6 s*
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandardSkipped
9.2 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
820.2 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
12.2 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandardSkipped
1.7 s*
Commits
Click on a commit to change the comparison rangeBase
master
d6e46bb
+1.26%
fix(core): improve error message for non-JSON-serializable tool schemas
456813c
5 months ago
by thromel+33.85%
cr
32a1e52
3 months ago
by ccurme