Comparing
litellm_ishaan_march_17
(8c23f9f
) withmain
(cbb4c2c
)0%
- Untouched
- 16
Benchmarks
16 total
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py+2%
89.5 µs87.4 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py+2%
87.1 µs85.2 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py+1%
86.9 µs85.6 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py+1%
551.6 µs543.8 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py+1%
550.7 µs543.5 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py+1%
85.6 µs84.9 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py0%
88.3 µs88.1 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py0%
143.5 µs143.3 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py0%
418.4 µs418.2 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py0%
142 µs142.1 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py0%
238.9 µs239.1 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py0%
1.7 ms1.7 ms
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py0%
146.6 µs146.8 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py0%
187 µs187.5 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py-1%
568.2 µs571.9 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py-1%
148.9 µs150.7 µs
Commits
Click on a commit to change the comparison rangeBase
main
cbb4c2c
-0.3%
feat(xai): add grok-4.20 beta 2 models with pricing (#23900)
34bb28d
16 days ago
by ishaan-jaff-0.26%
docs: add Quick Install section for litellm --setup wizard (#23905)
6b2e56f
15 days ago
by ishaan-jaff+0.08%
feat(setup): interactive setup wizard + install.sh (#23644)
212f29f
15 days ago
by ishaan-jaff+0.28%
feat(ui): remove Chat UI page link and banner from sidebar and playground (#23908)
2f7dcba
15 days ago
by ishaan-jaff+0.13%
feat(guardrails): MCPJWTSigner - built-in guardrail for zero trust MCP auth (#23897)
d9a6036
15 days ago
by ishaan-jaff+0.69%
fix(ci): stabilize CI - formatting, type errors, test polling, security CVEs, router bug, batch resolution
fde9062
15 days ago
by cursoragent-0.05%
chore: regenerate poetry.lock to sync with pyproject.toml
05f3ad4
15 days ago
by cursoragent+0.17%
fix: format merged files from main and regenerate poetry.lock
f6d53dc
15 days ago
by cursoragent-0.09%
fix(mypy): annotate jwt_claims as Optional[dict] to fix type incompatibility
cffc92b
15 days ago
by cursoragent-0.05%
fix(ci): update router region test to use gpt-4.1-mini (fix flaky model lookup)
951ecff
15 days ago
by cursoragent+0.11%
ci: retry flaky logging_testing (async event loop race condition)
399a120
15 days ago
by cursoragent-0.57%
fix(ci): aggregate all mock calls in langfuse e2e test to fix race condition
233b1d3
15 days ago
by cursoragent+0.56%
fix(ci): black formatting + update OpenAPI compliance tests for spec changes
b763c87
15 days ago
by cursoragent-0.11%
fix(ci): deduplicate and sort langfuse batch events after aggregation
83f7481
15 days ago
by cursoragent-0.1%
Merge branch 'main' into litellm_ishaan_march_17
8c23f9f
14 days ago
by ishaan-jaff