Comparing
Isydmr:fix/vertex-ai-haiku-4-5-pricing
(da5b338
) withlitellm_ishaan_march30
(5812053
)-1%
- Untouched
- 16
Benchmarks
16 total
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py0%
147 µs146.9 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py0%
143.4 µs143.3 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py0%
85.4 µs85.6 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py0%
239.2 µs240 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py0%
87.5 µs87.8 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py0%
542.7 µs545.2 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py-1%
542.1 µs545.2 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py-1%
186.5 µs188 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py-1%
568.8 µs573.4 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py-1%
414.3 µs417.9 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py-1%
1.7 ms1.7 ms
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py-1%
149 µs150.7 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py-1%
85.1 µs86.1 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py-1%
142.2 µs144 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py-2%
87.7 µs89.2 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py-2%
85.8 µs87.7 µs
Commits
Click on a commit to change the comparison rangeBase
main
5812053
+0.01%
fix(pricing): add unversioned vertex_ai/claude-haiku-4-5 entry
866cce8
23 days ago
by Isydmr-0.8%
Merge branch 'main' of github.com:BerriAI/litellm into fix/vertex-ai-haiku-4-5-pricing
da5b338
18 days ago
by Isydmr