GitHub Actions run
CPU SimulationWall Time
9 hours ago 3e48097 bot/refresh-model-profiles pull_requestUnknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Compare
Base
Search a run
Head
Comparechore(model-profiles): refresh model profile data
#36630
bot/refresh-model-profiles
9 hours ago
CPU SimulationWall Time
40 total
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard554.8 ms
test_init_time
libs/partners/openrouter/tests/unit_tests/test_standard.py::TestChatOpenRouterUnit362.2 ms
The benchmarks below were skipped, so their baseline results are used instead.
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandardSkipped
1.1 ms*
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandardSkipped
6.6 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
12.1 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandardSkipped
1.7 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
823.6 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
12.2 ms*
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandardSkipped
27.2 ms*
test_chroma_init_time
libs/partners/chroma/tests/unit_tests/test_standard.pySkipped
101.3 ms*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandardSkipped
1.9 ms*
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.pySkipped
3 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
3.6 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandardSkipped
137.8 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
3.6 ms*
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnitSkipped
384.8 ms*
test_nomic_embeddings_init_time
libs/partners/nomic/tests/unit_tests/test_standard.pySkipped
86.8 µs*
test_init_time
libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandardSkipped
421.2 ms*
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.pySkipped
175.3 ms*
test_init_time
libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandardSkipped
786.1 ms*
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandardSkipped
6.9 ms*
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.pySkipped
272.1 µs*