Avatar for the BerriAI user
BerriAI
litellm
BlogDocsChangelog

fix(prometheus): read v3 rate-limit remaining headers so RPM/TPM gauges aren't pinned to sys.maxsize (LIT-2577)

#28816Closed
Comparing
oss-agent-shin:shin/lit-2577-prometheus-v3-remaining
(
cee3d21
) with
main
(
06f6cfc
)
CodSpeed Performance Gauge
0%
Untouched
16

Benchmarks

16 total
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
80.7 µs79.5 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-1%
1.7 ms1.7 ms
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-1%
80.1 µs80.7 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
81.5 µs80.9 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-1%
144.1 µs145 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
556.7 µs553.5 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
79.9 µs79.6 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
143 µs142.4 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
558 µs555.6 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
136.9 µs137.4 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
138.5 µs138 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
413.3 µs414.5 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
235.1 µs234.4 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
563.3 µs564.3 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
82.1 µs82 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
183.4 µs183.6 µs

Commits

Click on a commit to change the comparison range
Base
main
06f6cfc
+0.31%
fix(prometheus): defer patch installation via meta-path hook to avoid circular import (LIT-2577)
6c590c7
3 months ago
by oss-agent-shin
-0.03%
fix(prometheus): return None on non-numeric v3 header value to avoid crashing gauge.set() (LIT-2577 Greptile feedback)
897349d
3 months ago
by oss-agent-shin
+0.01%
test(prometheus): cover non-numeric / bool / float v3 header values
f562d1b
3 months ago
by oss-agent-shin
-0.21%
chore(prometheus): drop unused importlib.util, document empty except (Greptile/CodeQL feedback)
cee3d21
3 months ago
by oss-agent-shin
© 2026 CodSpeed Technology
Home Terms Privacy Docs