litellm_encrypted_content_affinity_cooldown_pin - Branch - BerriAI/litellm

Fix cascading 400 invalid_encrypted_content when originating deployment is cooled down

#27811

Merging

litellm_encrypted_content_affinity_cooldown_pin

into

litellm_internal_staging

N/A

New: 16

Benchmarks

16 total

test_cost_per_token_openai

tests/benchmarks/test_benchmarks.py

N/A

N/A542.7 µs

test_cost_per_token_anthropic

tests/benchmarks/test_benchmarks.py

N/A

N/A542 µs

test_get_llm_provider_anthropic

tests/benchmarks/test_benchmarks.py

N/A

N/A142.5 µs

test_get_llm_provider_openai

tests/benchmarks/test_benchmarks.py

N/A

N/A138.3 µs

test_get_llm_provider_with_prefix

tests/benchmarks/test_benchmarks.py

N/A

N/A136.8 µs

test_token_counter_long_content

tests/benchmarks/test_benchmarks.py

N/A

N/A1.7 ms

test_get_model_cost_key_case_insensitive

tests/benchmarks/test_benchmarks.py

N/A

N/A82.2 µs

test_get_model_cost_key_exact_match

tests/benchmarks/test_benchmarks.py

N/A

N/A79.9 µs

test_token_counter_multi_turn

tests/benchmarks/test_benchmarks.py

N/A

N/A567.8 µs

test_get_model_info_anthropic

tests/benchmarks/test_benchmarks.py

N/A

N/A81.4 µs

test_get_model_info_openai

tests/benchmarks/test_benchmarks.py

N/A

N/A82.5 µs

test_get_llm_provider_azure

tests/benchmarks/test_benchmarks.py

N/A

N/A143.9 µs

test_token_counter_raw_text

tests/benchmarks/test_benchmarks.py

N/A

N/A183.4 µs

test_token_counter_simple_message

tests/benchmarks/test_benchmarks.py

N/A

N/A235.1 µs

test_get_model_info_with_provider

tests/benchmarks/test_benchmarks.py

N/A

N/A80.1 µs

test_token_counter_with_tools

tests/benchmarks/test_benchmarks.py

N/A

N/A414.1 µs

Commits

Click on a commit to change the comparison range

No baseline data is yet availableOnce your main branch has generated a first performance report, you will see the list of commits and their performance impact here.

Home Terms Privacy Docs