GitHub Actions run
Wall TimeCPU Simulation
3 hours ago 139fef1 bot/refresh-model-profiles pull_requestUnknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Compare
Base
Search a run
Head
Comparechore(model-profiles): refresh model profile data
#36455
bot/refresh-model-profiles
3 hours ago
Wall TimeCPU Simulation
40 total
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard3.6 ms
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard139 ms
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses3.6 ms
The benchmarks below were skipped, so their baseline results are used instead.
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandardSkipped
1.1 ms*
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandardSkipped
6.6 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
12.1 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandardSkipped
1.7 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
823.6 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
12.2 ms*
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandardSkipped
27.2 ms*
test_nomic_embeddings_init_time
libs/partners/nomic/tests/unit_tests/test_standard.pySkipped
1.1 ms*
test_chroma_init_time
libs/partners/chroma/tests/unit_tests/test_standard.pySkipped
101.3 ms*
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandardSkipped
7.3 ms*
test_init_time
libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandardSkipped
422.1 ms*
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnitSkipped
385.1 ms*
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.pySkipped
3 ms*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandardSkipped
1.9 ms*
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandardSkipped
382.3 ms*
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.pySkipped
175 ms*
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.pySkipped
256.2 µs*
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllamaSkipped
407 ms*
test_init_time
libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandardSkipped
786.8 ms*