harish876:azure-anthropic-timeout-bug - Branch - BerriAI/litellm

[Fix] Request Timeout needs to be also fetched from ```litellm_settings.request_timeout```

#25591Merged

Comparing

harish876:azure-anthropic-timeout-bug

(

9ae30ed

) with

litellm_ishaan_april15_2

(

7b36cfc

)

Untouched: 16

Benchmarks

16 total

test_get_model_info_anthropic

tests/benchmarks/test_benchmarks.py

+2%

81 µs79.1 µs

test_get_model_info_with_provider

tests/benchmarks/test_benchmarks.py

+1%

81.1 µs80.2 µs

test_get_llm_provider_anthropic

tests/benchmarks/test_benchmarks.py

-1%

141.2 µs142.7 µs

test_get_model_info_openai

tests/benchmarks/test_benchmarks.py

-1%

81.7 µs82.3 µs

test_token_counter_simple_message

tests/benchmarks/test_benchmarks.py

+1%

235.8 µs234.4 µs

test_cost_per_token_anthropic

tests/benchmarks/test_benchmarks.py

541.7 µs544.3 µs

test_cost_per_token_openai

tests/benchmarks/test_benchmarks.py

541.2 µs543.7 µs

test_token_counter_raw_text

tests/benchmarks/test_benchmarks.py

183.2 µs183.9 µs

test_token_counter_long_content

tests/benchmarks/test_benchmarks.py

1.7 ms1.7 ms

test_get_model_cost_key_exact_match

tests/benchmarks/test_benchmarks.py

79.7 µs79.6 µs

test_get_llm_provider_openai

tests/benchmarks/test_benchmarks.py

137.7 µs138 µs

test_get_llm_provider_azure

tests/benchmarks/test_benchmarks.py

144 µs144.2 µs

test_token_counter_with_tools

tests/benchmarks/test_benchmarks.py

413 µs413.4 µs

test_get_llm_provider_with_prefix

tests/benchmarks/test_benchmarks.py

136.7 µs136.8 µs

test_get_model_cost_key_case_insensitive

tests/benchmarks/test_benchmarks.py

82 µs81.9 µs

test_token_counter_multi_turn

tests/benchmarks/test_benchmarks.py

568.9 µs568.8 µs

Commits

Click on a commit to change the comparison range

Base

main

7b36cfc

-0.06%

[Test] Add Azure async chat completion timeout test. WIP

ff33fee

4 months ago

by harish876

-0.46%

[Refactor] Implement timeout resolution logic in completion function

645e43b

4 months ago

by harish876

-0.17%

remove stale test case

2345baf

4 months ago

by harish876

+0.25%

remove extra print statement

862b693

4 months ago

by harish876

+0.09%

default request timeout value in constants to 600s to match timeout defaults handled in the proxy

de20182

4 months ago

by harish876

+0.33%

fix request timeout if using default value from constants.py

c2b26ed

4 months ago

by harish876

+0.28%

Merge branch 'main' of https://github.com/BerriAI/litellm into azure-anthropic-timeout-bug

fdccbcb

4 months ago

by harish876

+0.11%

update code structure, test cases

0fa9cd1

4 months ago

by harish876

-0.13%

only override if the global timeout sets timeout to 6000s

2c14d42

4 months ago

by harish876

-0.1%

update code structure, move hard coded values to const and make the reslve function readable by moving fallback logic to a seperate function

6a3ca9a

4 months ago

by harish876

-0.07%

modify default timeout values, replacing hard coded ones with default values defined

9ae30ed

4 months ago

by harish876

Home Terms Privacy Docs