Comparing
harish876:oom-file-fix-openai
(69eb345
) withlitellm_harish_april11
(eabb6a3
)0%
- Untouched
- 16
Benchmarks
16 total
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py-2%
84.4 µs86.2 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py+1%
188.8 µs186.4 µs
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py-1%
88.4 µs89.5 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py-1%
1.7 ms1.7 ms
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py+1%
419 µs416.1 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py-1%
567 µs570.3 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py0%
142 µs141.5 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py0%
85.4 µs85.1 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py0%
85.7 µs85.5 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py0%
544 µs542.6 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py0%
149 µs148.6 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py0%
87.6 µs87.4 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py0%
146.6 µs146.3 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py0%
239.7 µs240.2 µs
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py0%
544.1 µs543.3 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py0%
143.1 µs142.9 µs
Commits
Click on a commit to change the comparison rangeBase
main
eabb6a3
-0.72%
Add file content streaming support for OpenAI and related utilities
7ebc144
7 months ago
by harish876-0.22%
remove conftest patch. TODO: make a different PR for this
1310803
7 months ago
by harish876+0.8%
Introduced Content-Length response headers into the streaming response. This provides a 1:1 behaviour mapping similar to the non streaming behaviour.
af4d4ab
7 months ago
by harish876-0.07%
remove unused iterator imports
044d434
7 months ago
by harish876+0.48%
Refactor file content streaming implementation
baba3eb
7 months ago
by harish876-0.04%
E2E test to assert response headers from the openai files change
1c74e17
7 months ago
by harish876-0.61%
Code Comments incorporated.
ccf3dc3
7 months ago
by harish876+0.44%
resolve dependency cycle
4e5e739
7 months ago
by harish876-0.13%
Enhance error handling in FileContentStreamingHandler for custom LLM provider routing
c5d93e6
7 months ago
by harish876-0.41%
Update import paths in tests for StorageBackendFileService
f523ccb
7 months ago
by harish876+0.43%
Refactor file content streaming handling to improve routing and support
69eb345
7 months ago
by harish876