BerriAI
litellm
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
GitHub Actions run
CPU Simulation
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
53 minutes ago
73fc9da
backend-cache-config-v1.88.0-rc.1
pull_request
Compare
Base
Search a run
Head
Add litellm.cache config to litellm-backend pod
#29611
backend-cache-config-v1.88.0-rc.1
53 minutes ago
CPU Simulation
Compare
Suggested base runs:
Pull Request Base
Mode
CPU Simulation
Wall Time
Memory
Status
Active
16 total
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py
82.4 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py
563 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py
561.4 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py
138.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py
80.2 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py
144.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py
1.7 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py
563 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py
141.8 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py
183.4 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py
235.7 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py
137.2 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py
82.3 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py
80.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py
415.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py
79.3 µs
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs