BerriAI
litellm
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
merge main
#30632
Closed
Comparing
litellm_internal_staging
(
68d6721
) with
litellm_oss_staging
(
fc7538f
)
CodSpeed Performance Gauge
0%
Untouched
16
This run is associated to a commit that was force-pushed
It will not be associated with its branch history. Be careful when comparing its performance to other runs.
Benchmarks
Mode
CPU Simulation
Wall Time
Memory
Status
Untouched
16 total
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+2%
82.3 µs
80.8 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
82.8 µs
81.9 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-1%
1.7 ms
1.7 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
236.5 µs
235.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
79.9 µs
80.2 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
82.1 µs
82.5 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
183.7 µs
184.3 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
143.6 µs
143.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
139.9 µs
139.4 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
564.7 µs
563 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
79.9 µs
80.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
137.6 µs
137.3 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
144.7 µs
144.5 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
563 µs
563.8 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
567.9 µs
568.6 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
415.4 µs
415.2 µs
Commits
Click on a commit to change the comparison range
Base
main
fc7538f
+0.14%
fix: 400 on Anthropic context overflow; seed identity on failed auth (#29848)
68d6721
11 days ago
by yassin-berriai
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs