Litellm staging 03 21 2026
#24340Comparing
litellm_staging_03_21_2026
(b038c07
) withmain
(f5194b5
)0%
- Untouched
- 16
Benchmarks
16 total
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py+1%
1.7 ms1.7 ms
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py+1%
86.4 µs85.5 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py0%
416.9 µs415 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py0%
544.2 µs543.1 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py0%
543.4 µs543.2 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py0%
141.9 µs142.2 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py0%
146 µs146.4 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py0%
149 µs149.5 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py0%
87.3 µs87.5 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py0%
186.8 µs187.5 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py0%
142.8 µs143.4 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py-1%
84.9 µs85.3 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py-1%
239.5 µs241 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py-1%
565.3 µs570.8 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py-3%
86.3 µs89 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py-3%
83.5 µs86.2 µs
Commits
Click on a commit to change the comparison rangeBase
main
f5194b5
-1.06%
Merge pull request #16590 from Chesars/refactor/remove-backup-file-dry-principle
62df632
15 hours ago
by Chesars+0.58%
fix: ensure gitignored model_prices JSON is included in wheel/sdist
c91b44a
15 hours ago
by Chesars-0.18%
fix: raise clear error when file references used without api_key
76d53fe
15 hours ago
by Chesars+0.01%
refactor: remove unnecessary sys.path.insert from test file
4694a30
15 hours ago
by Chesars+0.22%
Merge pull request #24341 from Chesars/feat/gemini-combined-multimodal-embeddings
912f08b
14 hours ago
by Chesars-0.3%
fix: rename test method
7091f87
14 hours ago
by Chesars+0.29%
refactor: extract _flatten_and_detect_file_refs helper, warn on ModuleNotFoundError
b038c07
13 hours ago
by Chesars