cc/oai_image_token_counting - Branch - langchain-ai/langchain

fix(openai): sanitize urls when counting tokens in images

#35143Merged

Comparing

cc/oai_image_token_counting

(

2b928cd

) with

master

(

0493b27

)

-16%

Regression: 5

Untouched: 14

Skipped: 15

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Benchmarks

34 total

test_import_time[PydanticOutputParser]

libs/core/tests/benchmarks/test_imports.py

-16%

541.7 ms*642.9 ms

test_import_time[RunnableLambda]

libs/core/tests/benchmarks/test_imports.py

-12%

507.5 ms*577.3 ms

test_import_time[LangChainTracer]

libs/core/tests/benchmarks/test_imports.py

-12%

446.7 ms*507.8 ms

test_import_time[ChatPromptTemplate]

libs/core/tests/benchmarks/test_imports.py

-11%

635 ms*715.8 ms

test_import_time[InMemoryVectorStore]

libs/core/tests/benchmarks/test_imports.py

-11%

607.1 ms*679.8 ms

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard

1.7 s*1.7 s

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

12.2 ms*12.2 ms

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard

1.1 s*1.1 s

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard

1.1 s*1.1 s

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

806.9 ms*807.7 ms

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

12.2 ms*12.2 ms

test_async_callbacks_in_sync

libs/core/tests/benchmarks/test_async_callbacks.py

-2%

23.5 ms*23.9 ms

test_import_time[HumanMessage]

libs/core/tests/benchmarks/test_imports.py

-5%

263.6 ms*278.8 ms

test_import_time[Document]

libs/core/tests/benchmarks/test_imports.py

-6%

188.8 ms*200 ms

test_import_time[tool]

libs/core/tests/benchmarks/test_imports.py

-6%

531.7 ms*565.7 ms

test_import_time[CallbackManager]

libs/core/tests/benchmarks/test_imports.py

-7%

476 ms*513.1 ms

test_import_time[BaseChatModel]

libs/core/tests/benchmarks/test_imports.py

-8%

548.9 ms*596.4 ms

test_import_time[Runnable]

libs/core/tests/benchmarks/test_imports.py

-10%

506.1 ms*560.2 ms

test_import_time[InMemoryRateLimiter]

libs/core/tests/benchmarks/test_imports.py

-10%

173.6 ms*192.3 ms

The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

test_create_chat_prompt_init_time

libs/partners/prompty/tests/unit_tests/test_standard.py

Skipped

311.9 µs*

test_init_time

libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama

Skipped

1.6 s*

test_chroma_init_time

libs/partners/chroma/tests/unit_tests/test_standard.py

Skipped

60 ms*

test_init_time

libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard

Skipped

1.6 s*

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

6.6 s*

test_init_time

libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard

Skipped

1.7 s*

Commits

Click on a commit to change the comparison range

Base

master

0493b27

-10.87%

timeout -> 5s

6ec227f

3 months ago

by ccurme

-4.86%

codeql

2b928cd

3 months ago

by ccurme

Home Terms Privacy Docs