Avatar for the BerriAI user
BerriAI
litellm
BlogDocsChangelog

fix(caching): preserve prompt_tokens_details through embedding cache round-trip

#24806Closed
Comparing
michelligabriele:fix/embedding-cache-prompt-tokens-details
(
f7424ea
) with
main
(
5cec43c
)
CodSpeed Performance Gauge
0%
Untouched
16

Benchmarks

16 total
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-2%
86.7 µs88.6 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
147.2 µs146.4 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
143.5 µs142.9 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
542.9 µs545 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
415.4 µs416.8 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
542 µs543.8 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
142.2 µs141.9 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
573.4 µs572 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
84 µs83.8 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
238.7 µs238.2 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
85.5 µs85.3 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
149.2 µs149 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
85.4 µs85.6 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
87.7 µs87.6 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
187 µs187 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
1.7 ms1.7 ms

Commits

Click on a commit to change the comparison range
Base
main
5cec43c
+0.14%
fix(caching): preserve prompt_tokens_details through embedding cache round-trip
56a587d
5 months ago
by michelligabriele
-0.04%
style: apply Black formatting to caching files
ab70d0c
5 months ago
by michelligabriele
-0.19%
fix(caching): address Greptile review — cyclic import, guarded construction, nested dict merge
f7424ea
5 months ago
by michelligabriele
© 2026 CodSpeed Technology
Home Terms Privacy Docs