BerriAI
litellm
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
docs(guardrails): add during_call mode to Model Armor guardrail docs
#26394
Merging
wadhah101:docs/model-armor-during-call
into
litellm_oss_branch
CodSpeed Performance Gauge
N/A
New
16
This run is associated to a commit that was force-pushed
It will not be associated with its branch history. Be careful when comparing its performance to other runs.
Benchmarks
Mode
CPU Simulation
Wall Time
Memory
Status
New
16 total
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
81.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
183.8 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
136.8 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
235 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
414.1 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
138.3 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
81.9 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
142.4 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
79.7 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
80.2 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
567.6 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
144.2 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
1.7 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
79.7 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
540 µs
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
N/A
N/A
541.1 µs
Commits
Click on a commit to change the comparison range
No baseline data is yet available
Once your main branch has generated a first performance report, you will see the list of commits and their performance impact here.
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs