Comparing
J-Byron:feat/prometheus-org-request-labels
(9eb14a2
) withlitellm_oss_staging_04_02_2026_p1
(5812053
)-1%
- Untouched
- 16
Benchmarks
16 total
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py-2%
149 µs151.7 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py-2%
85.8 µs87.3 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py-1%
414.3 µs419.4 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py-1%
142.2 µs143.9 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py-1%
87.7 µs88.8 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py-1%
85.1 µs86 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py-1%
542.1 µs545.8 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py-1%
542.7 µs546.1 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py-1%
1.7 ms1.7 ms
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py-1%
239.2 µs240.6 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py-1%
568.8 µs571.7 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py0%
87.5 µs87.9 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py0%
186.5 µs187.3 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py0%
85.4 µs85.6 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py0%
147 µs146.7 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py0%
143.4 µs143.1 µs
Commits
Click on a commit to change the comparison rangeBase
main
5812053
-0.08%
Add test for org labels on per-request Prometheus metrics
979bcb7
5 months ago
by J-Byron+0.05%
chore: resolve test mockdata
30c524d
5 months ago
by J-Byron+0.15%
Address review: populate org_alias from DB view, add feature flag, use .get() for org metadata
524b501
5 months ago
by J-Byron-0.28%
Add org labels to failure path and verify flag behavior in test
f36e878
5 months ago
by J-Byron+0.22%
Fix test: build flag-off enum_values without org fields
85a3660
5 months ago
by J-Byron-0.13%
Gate org labels behind feature flag in get_labels() instead of static metric lists
16387b7
5 months ago
by J-Byron-0.03%
Scope org label injection to metrics that carry team context, remove orphaned budget label defs, add test teardown
57f9aa7
5 months ago
by J-Byron-0.07%
Use explicit metric allowlist for org label injection instead of team heuristic
4ae96ab
5 months ago
by J-Byron+0.04%
Fix duplicate org label guard, move _org_label_metrics to class constant
2c51f70
5 months ago
by J-Byron+0.08%
Reset custom_prometheus_metadata_labels after duplicate label assertion
8f6daf8
5 months ago
by J-Byron-0.62%
fix: emit org labels by default, resolve merge conflicts
8d4359d
5 months ago
by J-Byron-0.09%
fix: emit org labels by default, no opt-in flag required
c0d6623
5 months ago
by J-Byron+0.01%
fix: write org_alias to metadata unconditionally in proxy_server.py
9eb14a2
5 months ago
by J-Byron