Comparing
litellm_yj_march_17_2026
(1e6abf8
) withmain
(cbb4c2c
)+1%
- Untouched
- 16
No successful run was found on main ( 8e61b32) during the generation of this report, so cbb4c2c was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
16 total
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py+3%
87.1 µs84.9 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py+3%
89.5 µs87.2 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py+2%
85.6 µs83.6 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py+2%
551.6 µs542.2 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py+2%
550.7 µs541.6 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py+2%
86.9 µs85.4 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py+1%
1.7 ms1.7 ms
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py+1%
418.4 µs416.1 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py0%
146.6 µs146 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py0%
142 µs141.7 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py0%
143.5 µs143.4 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py0%
148.9 µs149 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py0%
187 µs187.3 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py-1%
238.9 µs240.3 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py-1%
88.3 µs88.9 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py-1%
568.2 µs573 µs
Commits
Click on a commit to change the comparison rangeBase
main
cbb4c2c
+0.78%
Merge branch 'main' into litellm_yj_march_17_2026
1e6abf8
30 days ago
by yuneng-jiang