gautamvarmadatla:fix/core-trim-messages-token-counter-annotation - Branch - langchain-ai/langchain

fix(core): fix `trim_messages` misclassification of per-message token_counter

#35630

Comparing

gautamvarmadatla:fix/core-trim-messages-token-counter-annotation

(

f8a8823

) with

master

(

0f4f3f7

)

-4%

Untouched: 13

Skipped: 27

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Benchmarks

27 total

The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_create_chat_prompt_init_time

libs/partners/prompty/tests/unit_tests/test_standard.py

Skipped

311.9 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandard

Skipped

1.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

6.6 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

Skipped

12.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard

Skipped

1.1 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard

Skipped

1.1 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard

Skipped

1.7 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

Skipped

823.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

Skipped

12.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard

Skipped

27.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_nomic_embeddings_init_time

libs/partners/nomic/tests/unit_tests/test_standard.py

Skipped

1.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_chroma_init_time

libs/partners/chroma/tests/unit_tests/test_standard.py

Skipped

101.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard

Skipped

7.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard

Skipped

422.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit

Skipped

385.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time_with_client

libs/partners/anthropic/tests/unit_tests/test_standard.py

Skipped

3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard

Skipped

1.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard

Skipped

382.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_qdrant_vectorstore_init_time

libs/partners/qdrant/tests/unit_tests/test_standard.py

Skipped

175 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openrouter/tests/unit_tests/test_standard.py::TestChatOpenRouterUnit

Skipped

362.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_exa_retriever_init_time

libs/partners/exa/tests/unit_tests/test_standard.py

Skipped

256.2 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama

Skipped

407 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandard

Skipped

786.8 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

494.5 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

Skipped

3.6 ms*

Commits

Click on a commit to change the comparison range

Base

master

0f4f3f7

+38.46%

fix(core): fix trim_messages per-message token_counter detection

be47f94

1 month ago

by gautamvarmadatla

-40.26%

Merge branch 'master' into fix/core-trim-messages-token-counter-annotation

533ae84

30 days ago

by gautamvarmadatla

-1.65%

Merge branch 'master' into fix/core-trim-messages-token-counter-annotation

0113c48

21 days ago

by gautamvarmadatla

+5.23%

Merge branch 'master' into fix/core-trim-messages-token-counter-annotation

9f47bcb

18 days ago

by gautamvarmadatla

-5.39%

Merge branch 'master' into fix/core-trim-messages-token-counter-annotation

f8a8823

13 days ago

by gautamvarmadatla

Home Terms Privacy Docs