langchain-ai
langchain
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
fix(openai): add strict flag to correctly use structured-output of openai provider
#34205
Closed
Comparing
thdesc:fix/strict_flag
(
5c9ea0f
) with
master
(
3ace4e3
)
CodSpeed Performance Gauge
0%
Untouched
6
Skipped
28
Benchmarks
Skipped (28)
Archive selected
These benchmarks were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.py
Skipped
311.9 µs
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_nomic_embeddings_init_time
libs/partners/nomic/tests/unit_tests/test_standard.py
Skipped
1.5 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit
Skipped
1.6 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.py
Skipped
319.1 µs
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard
Skipped
3.3 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard
Skipped
6.6 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard
Skipped
9.2 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard
Skipped
834.5 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_chroma_init_time
libs/partners/chroma/tests/unit_tests/test_standard.py
Skipped
57.2 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama
Skipped
1.6 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.py
Skipped
223.9 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard
Skipped
34.7 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard
Skipped
811.9 µs
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.py
Skipped
2.3 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard
Skipped
1.6 s
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py
Skipped
449.7 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py
Skipped
546.8 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py
Skipped
24.3 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py
Skipped
631.5 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py
Skipped
193 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py
Skipped
636.5 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py
Skipped
516.6 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py
Skipped
182.1 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py
Skipped
533.1 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py
Skipped
276.9 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py
Skipped
483.3 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py
Skipped
507.8 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py
Skipped
557 ms
*
Passed
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses
CodSpeed Performance Gauge
0%
12.3 ms
12.3 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
12.3 ms
12.3 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
1.7 s
1.7 s
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
1.2 s
1.2 s
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
1.2 s
1.2 s
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses
CodSpeed Performance Gauge
0%
856.7 ms
857.6 ms
Commits
Click on a commit to change the comparison range
Base
master
3ace4e3
-0.04%
Merge branch 'master' into fix/strict_flag
e3c880f
12 days ago
by thdesc
-0.02%
Merge branch 'master' into fix/strict_flag
fe48463
12 days ago
by thdesc
-0.01%
Merge branch 'master' into fix/strict_flag
c89adeb
11 days ago
by thdesc
+0.07%
Merge branch 'master' into fix/strict_flag
5c9ea0f
9 days ago
by thdesc
© 2025 CodSpeed Technology
Home
Terms
Privacy
Docs