Comparing
litellm_internal_staging
(c94d692
) withmain
(bc6e7df
)0%
- Untouched
- 31
No successful run was found on main ( c94d692) during the generation of this report, so bc6e7df was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
31 total
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py+3%
84 µs81.3 µs
test_completion_multi_turn
tests/benchmarks/test_inference_benchmarks.py-1%
3.8 ms3.8 ms
test_completion_with_tools
tests/benchmarks/test_inference_benchmarks.py-1%
3.8 ms3.9 ms
test_completion_simple_message
tests/benchmarks/test_inference_benchmarks.py-1%
3.9 ms4 ms
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py-1%
1.7 ms1.7 ms
test_completion_streaming
tests/benchmarks/test_inference_benchmarks.py+1%
37.5 ms37.3 ms
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py+1%
82.5 µs81.9 µs
test_transform_single_mcp_tool_to_openai
tests/benchmarks/test_mcp_benchmarks.py-1%
90.3 µs90.9 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py-1%
533.9 µs537.2 µs
test_transform_openai_tool_call_to_mcp
tests/benchmarks/test_mcp_benchmarks.py-1%
128.5 µs129.3 µs
test_response_to_model_response_object
tests/benchmarks/test_inference_benchmarks.py-1%
403 µs405.5 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py-1%
541.7 µs544.6 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py-1%
148.4 µs149.2 µs
test_mcp_server_prefix_tool_list
tests/benchmarks/test_mcp_benchmarks.py0%
162.5 µs163.2 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py0%
80.5 µs80.8 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py0%
210.6 µs211.4 µs
test_transform_mcp_tool_list_to_openai
tests/benchmarks/test_mcp_benchmarks.py0%
191.3 µs190.6 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py0%
178.1 µs178.7 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py0%
80 µs80.3 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py0%
400.6 µs401.8 µs
test_extract_text_from_a2a_message_response
tests/benchmarks/test_a2a_benchmarks.py0%
87.9 µs88.1 µs
test_logging_executor_runs_inline
tests/benchmarks/test_benchmarks.py0%
125.6 µs125.4 µs
test_convert_messages_to_a2a_prompt
tests/benchmarks/test_a2a_benchmarks.py0%
111.2 µs111.4 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py0%
82.6 µs82.8 µs
test_a2a_inbound_message_to_openai_messages
tests/benchmarks/test_a2a_benchmarks.py0%
96.5 µs96.6 µs
Commits
Click on a commit to change the comparison rangeBase
main
4d100bd
+0.03%
Merge pull request #34067 from MUSE-CODE-SPACE/fix/batch-logging-null-output-file
2bc87ec
2 days ago
by mateo-berri-0.12%
Merge pull request #37225 from BerriAI/litellm_lit5650_guardrail_usage_units
4d57bf0
2 days ago
by mateo-berri+0.12%
fix(proxy): strip callback credentials from the auth object stamped into request metadata (#37233)
a738c45
2 days ago
by yucheng-berri-0.21%
Merge pull request #37247 from BerriAI/litellm_guardrail_usage_retry_safe_errors
333ccf2
2 days ago
by mateo-berri+0.21%
Merge pull request #36599 from daniel-meismer-zocdoc/bugfix/mcp-oauth-startup-discovery
4fd7a73
2 days ago
by mateo-berri+0.09%
feat(complexity_router): plan-mode tier floor for coding-agent clients (#37230)
8159f24
1 day ago
by tin-berri-0.16%
feat(proxy): add /team/daily/activity/aggregated and switch the Usage team tab to it (#36562)
9ec0145
1 day ago
by ryan-crabbe-berri+0.14%
Merge pull request #37333 from BerriAI/litellm_lit_5726_auto_router_header_tags
852368d
1 day ago
by mateo-berri-0.42%
fix(mcp): attach per-user BYOK credential when listing tools for non-oauth2 auth types (#34787)
3f15dc3
1 day ago
by devin-ai-integration[bot]+0.38%
Merge pull request #32448 from ChenluJi/feat/tinyfish-search-headers-and-extras
807e1da
24 hours ago
by mateo-berri-0.28%
fix(ui): highlight the first member search match so Enter picks it (#37429)
c94d692
22 hours ago
by yuneng-berri+0.39%
Merge pull request #37424 from BerriAI/litellm_lit_5788_managed_file_fallback_pin
8941f2a
22 hours ago
by mateo-berri-0.24%
Merge pull request #37423 from BerriAI/litellm_fix_thinking_bool_crash
559310f
20 hours ago
by mateo-berri+0.11%
fix(mcp): forward the per-server auth header on OpenAPI tool calls (#37410)
da7a10e
8 hours ago
by tin-berri-0.21%
Merge pull request #37439 from BerriAI/litellm_decrease_anys_fable_round3
4d100bd
7 hours ago
by mateo-berri+0.38%
fix(proxy): initialize the secret manager before resolving os.environ config references (#37544)
f22eeb2
2 hours ago
by yassin-berriai