jacob/service_tier - Branch - langchain-ai/langchain - CodSpeed

Blog Docs Changelog

feat(openai): Populate OpenAI service tier token details

Comparing

jacob/service_tier

(

ab745f9

) with

master

(

1cf851e

)

0%

Untouched: 6

Skipped: 28

No successful run was found on master ( 637777b) during the generation of this report, so 1cf851e was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

Skipped (28)

These benchmarks were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_create_chat_prompt_init_time

libs/partners/prompty/tests/unit_tests/test_standard.py

Skipped

311.8 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_nomic_embeddings_init_time

libs/partners/nomic/tests/unit_tests/test_standard.py

Skipped

1.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_exa_retriever_init_time

libs/partners/exa/tests/unit_tests/test_standard.py

Skipped

338.8 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_chroma_init_time

libs/partners/chroma/tests/unit_tests/test_standard.py

Skipped

58.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_qdrant_vectorstore_init_time

libs/partners/qdrant/tests/unit_tests/test_standard.py

Skipped

228.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard

Skipped

9.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama

Skipped

1.7 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard

Skipped

835.4 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit

Skipped

1.6 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard

Skipped

3.3 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

6.6 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard

Skipped

1.6 s*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[HumanMessage]

libs/core/tests/benchmarks/test_imports.py

Skipped

263.6 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[RunnableLambda]

libs/core/tests/benchmarks/test_imports.py

Skipped

460.9 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[CallbackManager]

libs/core/tests/benchmarks/test_imports.py

Skipped

427.6 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[InMemoryRateLimiter]

libs/core/tests/benchmarks/test_imports.py

Skipped

164.8 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_async_callbacks_in_sync

libs/core/tests/benchmarks/test_async_callbacks.py

Skipped

24.5 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[Document]

libs/core/tests/benchmarks/test_imports.py

Skipped

208.4 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[InMemoryVectorStore]

libs/core/tests/benchmarks/test_imports.py

Skipped

589.6 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[tool]

libs/core/tests/benchmarks/test_imports.py

Skipped

485.7 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[LangChainTracer]

libs/core/tests/benchmarks/test_imports.py

Skipped

408.7 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[ChatPromptTemplate]

libs/core/tests/benchmarks/test_imports.py

Skipped

564.3 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[PydanticOutputParser]

libs/core/tests/benchmarks/test_imports.py

Skipped

506.9 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[BaseChatModel]

libs/core/tests/benchmarks/test_imports.py

Skipped

494.9 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_import_time[Runnable]

libs/core/tests/benchmarks/test_imports.py

Skipped

462.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard

Skipped

774.2 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard

Skipped

34.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time_with_client

libs/partners/anthropic/tests/unit_tests/test_standard.py

Skipped

2.3 ms*

Passed

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

0%

10.5 ms*10.5 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

0%

10.6 ms*10.6 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

0%

883.8 ms*883.2 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard

0%

962 ms*961.5 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard

0%

962 ms*961.9 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard

0%

1.7 s*1.7 s

Commits

Click on a commit to change the comparison range

Base

master

1cf851e

-0.09%

Populate OpenAI service tier token details

027fe6b

2 months ago

by jacoblee93

+0.06%

lint

cf9b11a

2 months ago

by jacoblee93

-0.01%

Rename var

594d2f6

2 months ago

by jacoblee93

+0.13%

add test for responses API

ab745f9

1 day ago

by ccurme

© 2025 CodSpeed Technology

Home Terms Privacy Docs