Avatar for the BerriAI user
BerriAI
litellm
BlogDocsChangelog

[feat]Add prompt management support for responses api

#23999Merged
Comparing
Sameerlite:litellm_feat_prompt_responses
(
021540b
) with
litellm_dev_sameer_16_march_week
(
cec3e9e
)
CodSpeed Performance Gauge
0%
Untouched
16

Benchmarks

16 total
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+3%
89.5 µs87.2 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+2%
87.1 µs85.1 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+2%
86.8 µs85.3 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
85.7 µs84.7 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
89.2 µs88.2 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
240 µs237.6 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
+1%
573.1 µs569.7 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
142 µs141.6 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
143.2 µs143 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
149.1 µs148.9 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
542.8 µs542.6 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
542 µs542.4 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
0%
146.6 µs147 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-1%
415.7 µs417.9 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-1%
186.6 µs188.2 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py
CodSpeed Performance Gauge
-1%
1.7 ms1.7 ms

Commits

Click on a commit to change the comparison range
Base
main
cec3e9e
+0.5%
Add support for prompt management for responses
0d70864
13 days ago
by Sameerlite
+0.08%
Fix greptile review
35b3ed5
13 days ago
by Sameerlite
+0.03%
Fix greptile comments
b32f5ea
13 days ago
by Sameerlite
-0.19%
address greptile review feedback (greploop iteration 1)
d333dc4
13 days ago
by Sameerlite
+0.07%
fix: prevent double prompt management in async path, preserve optional params
021540b
13 days ago
by Sameerlite
© 2026 CodSpeed Technology
Home Terms Privacy Docs