langchain-ai
langchain
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
fix(openai): make GPT-5 temperature validation case-insensitive
#34012
Comparing
Abhinavexists:openai-case-sensitive
(
c24378f
) with
master
(
32bbe99
)
CodSpeed Performance Gauge
0%
Untouched
6
Skipped
28
Benchmarks
Skipped (28)
Archive selected
These benchmarks were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.py
Skipped
311.9 µs
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.py
Skipped
325.3 µs
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.py
Skipped
224.2 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_chroma_init_time
libs/partners/chroma/tests/unit_tests/test_standard.py
Skipped
57.2 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit
Skipped
1.6 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard
Skipped
837.5 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama
Skipped
1.6 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard
Skipped
3.3 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard
Skipped
6.6 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard
Skipped
9.1 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_nomic_embeddings_init_time
libs/partners/nomic/tests/unit_tests/test_standard.py
Skipped
1.5 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard
Skipped
1.6 s
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard
Skipped
763.7 µs
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard
Skipped
34.6 ms
*
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.py
Skipped
2.2 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py
Skipped
664.8 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py
Skipped
530.2 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py
Skipped
25.3 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py
Skipped
275.9 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py
Skipped
482.5 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py
Skipped
472.6 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py
Skipped
638.6 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py
Skipped
563.5 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py
Skipped
561.5 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py
Skipped
200.7 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py
Skipped
581.1 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py
Skipped
520.2 ms
*
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py
Skipped
185 ms
*
Passed
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses
CodSpeed Performance Gauge
0%
858.1 ms
*
856.9 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
1.2 s
*
1.2 s
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
1.2 s
*
1.2 s
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
1.7 s
*
1.7 s
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard
CodSpeed Performance Gauge
0%
12.1 ms
*
12.1 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses
CodSpeed Performance Gauge
0%
12.1 ms
*
12.2 ms
Commits
Click on a commit to change the comparison range
Base
master
32bbe99
0%
fix BasechatOpenAI lower case
c24378f
3 days ago
by Abhinavexists
© 2025 CodSpeed Technology
Home
Terms
Privacy
Docs