Comparing
mdrxy/model-profiles-sorting
(245ef13
) withmaster
(5362bf5
)0%
- Untouched
- 16
- Skipped
- 19
No successful run was found on master ( e95e869) during the generation of this report, so 5362bf5 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
35 total
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.py+1%
2.3 ms2.3 ms
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard+1%
12.3 ms*12.2 ms
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard+1%
1.1 s*1.1 s
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard+1%
1.1 s*1.1 s
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses+1%
825 ms*820.4 ms
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses+1%
12.3 ms*12.2 ms
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard+1%
9.3 ms*9.2 ms
test_init_time
libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard0%
1.7 s*1.7 s
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard0%
1.7 s*1.7 s
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard0%
1.6 s*1.6 s
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit0%
1.6 s*1.6 s
test_init_time
libs/partners/openrouter/tests/unit_tests/test_standard.py::TestChatOpenRouterUnit0%
1.5 s*1.5 s
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard0%
6.6 s*6.6 s
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard0%
31.9 ms31.9 ms
test_init_time
libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard0%
3.3 s*3.3 s
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard0%
806.2 µs807.6 µs
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_chroma_init_time
libs/partners/chroma/tests/unit_tests/test_standard.pySkipped
60 ms*
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.pySkipped
225 ms*
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.pySkipped
316.4 µs*
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.pySkipped
563.5 ms*
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.pySkipped
472.1 ms*
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.pySkipped
626.8 ms*
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.pySkipped
558.8 ms*
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.pySkipped
488.6 ms*
Commits
Click on a commit to change the comparison rangeBase
master
5362bf5
+0.02%
fix(model-profiles): sort generated profiles by model ID for stable diffs
f5de716
2 months ago
by mdrxy+0.15%
nit
c848304
2 months ago
by mdrxy+0.12%
lint
245ef13
2 months ago
by mdrxy