cc/stream_usage - Branch - langchain-ai/langchain

feat(openai): enable stream_usage when using default base URL and client

#33296Merged

Comparing

cc/stream_usage

(

c128277

) with

v0.3

(

95a451e

)

+2%

Untouched: 6

Skipped: 28

No successful run was found on v0.3 ( 0b51de4) during the generation of this report, so master ( 95a451e) was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

34 total

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

+6%

876.5 ms828.2 ms

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

+1%

10.5 ms10.4 ms

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard

+1%

961.7 ms952.9 ms

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard

+1%

962 ms953.3 ms

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

+1%

10.5 ms10.4 ms

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard

1.7 s1.7 s

The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

test_create_chat_prompt_init_time

libs/partners/prompty/tests/unit_tests/test_standard.py

Skipped

311.4 µs*

test_init_time

libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard

Skipped

9.8 ms*

test_nomic_embeddings_init_time

libs/partners/nomic/tests/unit_tests/test_standard.py

Skipped

1.6 ms*

test_init_time

libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit

Skipped

1.6 s*

test_init_time

libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard

Skipped

835.5 ms*

test_init_time

libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard

Skipped

3.3 s*

test_init_time

libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama

Skipped

1.7 s*

test_qdrant_vectorstore_init_time

libs/partners/qdrant/tests/unit_tests/test_standard.py

Skipped

227.9 ms*

test_exa_retriever_init_time

libs/partners/exa/tests/unit_tests/test_standard.py

Skipped

338.8 µs*

test_init_time

libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard

Skipped

1.6 s*

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard

Skipped

778.9 µs*

test_init_time_with_client

libs/partners/anthropic/tests/unit_tests/test_standard.py

Skipped

2.3 ms*

test_stream_time

libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard

Skipped

35.7 ms*

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

6.6 s*

test_chroma_init_time

libs/partners/chroma/tests/unit_tests/test_standard.py

Skipped

58.8 ms*

test_import_time[Document]

libs/core/tests/benchmarks/test_imports.py

Skipped

211.6 ms*

test_import_time[InMemoryRateLimiter]

libs/core/tests/benchmarks/test_imports.py

Skipped

167.8 ms*

test_import_time[CallbackManager]

libs/core/tests/benchmarks/test_imports.py

Skipped

434.4 ms*

test_import_time[InMemoryVectorStore]

libs/core/tests/benchmarks/test_imports.py

Skipped

601 ms*

Commits

Click on a commit to change the comparison range

Base

master

95a451e

+1.54%

fix api ref syntax

fe77ed7

6 months ago

by ccurme

+0.03%

fix(openai): disable stream_usage in chat completions if OPENAI_BASE_URL is set (#33298)

c128277

6 months ago

by ccurme

Home Terms Privacy Docs