harish876:azure-anthropic-timeout-bug - Branch - BerriAI/litellm

[Fix] Request Timeout needs to be also fetched from ```litellm_settings.request_timeout```

#25591

Comparing

harish876:azure-anthropic-timeout-bug

(

2c14d42

) with

main

(

e64d98f

)

Untouched: 16

Benchmarks

16 total

test_get_model_info_anthropic

tests/benchmarks/test_benchmarks.py

+2%

81.3 µs79.6 µs

test_get_model_info_with_provider

tests/benchmarks/test_benchmarks.py

+2%

81.3 µs80.1 µs

test_token_counter_multi_turn

tests/benchmarks/test_benchmarks.py

+1%

568.4 µs564.9 µs

test_token_counter_raw_text

tests/benchmarks/test_benchmarks.py

+1%

183.9 µs182.9 µs

test_get_model_cost_key_case_insensitive

tests/benchmarks/test_benchmarks.py

82.1 µs81.8 µs

test_get_llm_provider_openai

tests/benchmarks/test_benchmarks.py

138.1 µs137.6 µs

test_token_counter_long_content

tests/benchmarks/test_benchmarks.py

1.7 ms1.7 ms

test_get_llm_provider_anthropic

tests/benchmarks/test_benchmarks.py

141.7 µs141.2 µs

test_get_model_cost_key_exact_match

tests/benchmarks/test_benchmarks.py

79.8 µs79.6 µs

test_cost_per_token_anthropic

tests/benchmarks/test_benchmarks.py

541.8 µs541.4 µs

test_get_model_info_openai

tests/benchmarks/test_benchmarks.py

81.6 µs81.7 µs

test_token_counter_with_tools

tests/benchmarks/test_benchmarks.py

413.1 µs414.3 µs

test_cost_per_token_openai

tests/benchmarks/test_benchmarks.py

540.8 µs542.9 µs

test_token_counter_simple_message

tests/benchmarks/test_benchmarks.py

-1%

236.6 µs237.9 µs

test_get_llm_provider_with_prefix

tests/benchmarks/test_benchmarks.py

-1%

137.4 µs138.4 µs

test_get_llm_provider_azure

tests/benchmarks/test_benchmarks.py

-1%

144.4 µs145.6 µs

Commits

Click on a commit to change the comparison range

Base

main

e64d98f

-0.06%

[Test] Add Azure async chat completion timeout test. WIP

ff33fee

2 days ago

by harish876

-0.46%

[Refactor] Implement timeout resolution logic in completion function

645e43b

6 hours ago

by harish876

-0.17%

remove stale test case

2345baf

6 hours ago

by harish876

+0.25%

remove extra print statement

862b693

6 hours ago

by harish876

+0.09%

default request timeout value in constants to 600s to match timeout defaults handled in the proxy

de20182

5 hours ago

by harish876

+0.33%

fix request timeout if using default value from constants.py

c2b26ed

5 hours ago

by harish876

+0.28%

Merge branch 'main' of https://github.com/BerriAI/litellm into azure-anthropic-timeout-bug

fdccbcb

2 hours ago

by harish876

+0.11%

update code structure, test cases

0fa9cd1

2 hours ago

by harish876

-0.13%

only override if the global timeout sets timeout to 6000s

2c14d42

1 hour ago

by harish876

Home Terms Privacy Docs