Comparing
mdrxy/openai-rfc-1-0
(f36e014
) withcc/1.0/standard_content
(d111965
)+29%
- Improvements
- 1
- Regressions
- 0
- Untouched
- 10
- New
- 0
- Dropped
- 3
- Ignored
- 0
No successful run was found on cc/1.0/standard_content ( 313ed7b) during the generation of this report, so 823c15c was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
Failed
test_init_time_with_clientMissing
libs/partners/anthropic/tests/unit_tests/test_standard.py::test_init_time_with_clientN/A
5.3 ms
N/A
test_init_timeMissing
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard::test_init_timeN/A
3.8 ms
N/A
test_stream_timeMissing
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard::test_stream_timeN/A
15.9 ms
N/A
Improved
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses::test_stream_time+29%
1,209.3 ms
937.4 ms
Passed
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard::test_stream_time0%
1.1 s
1.1 s
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard::test_stream_time0%
1.1 s
1.1 s
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard::test_init_time0%
12.6 ms
12.5 ms
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard::test_init_time0%
6.6 s
6.6 s
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard::test_init_time0%
1.7 s
1.7 s
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard::test_init_time0%
1.6 s
1.6 s
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit::test_init_time0%
1.6 s
1.6 s
test_init_time
libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard::test_init_time0%
3.3 s
3.3 s
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard::test_init_time0%
17.1 ms
17.1 ms
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses::test_init_time0%
17.1 ms
17.2 ms
Commits
Click on a commit to change the comparison rangeBase
cc/1.0/standard_content
d111965
+29%
test(openai): address some type issues in tests
4a26b37
8 days ago
by mdrxy0%
Merge branch 'cc/1.0/standard_content' into mdrxy/openai-rfc-1-0
f36e014
8 days ago
by mdrxy