qinqining:docs/update-modelprofile-formats - Branch - langchain-ai/langchain

docs(core): clarify supported formats for multimodal inputs in ModelProfile

#35628

Comparing

qinqining:docs/update-modelprofile-formats

(

b0b6291

) with

master

(

063739b

)

+2%

Untouched: 13

Skipped: 27

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

No successful run was found on master ( 491eb9d) during the generation of this report, so 063739b was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

27 total

The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_create_chat_prompt_init_time

libs/partners/prompty/tests/unit_tests/test_standard.py

Skipped

311.9 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandard

Skipped

1.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

6.6 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

Skipped

12.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard

Skipped

1.1 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard

Skipped

1.1 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard

Skipped

1.7 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

Skipped

823.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

Skipped

12.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_stream_time

libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard

Skipped

27.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnit

Skipped

383.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllama

Skipped

406.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/mistralai/tests/unit_tests/test_standard.py::TestMistralStandard

Skipped

7.3 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_init_time

libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandard

Skipped

521 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard

Skipped

136.8 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

Skipped

2.9 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

Skipped

2.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_chroma_init_time

libs/partners/chroma/tests/unit_tests/test_standard.py

Skipped

44.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_exa_retriever_init_time

libs/partners/exa/tests/unit_tests/test_standard.py

Skipped

256.1 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandard

Skipped

419.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandard

Skipped

381.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_nomic_embeddings_init_time

libs/partners/nomic/tests/unit_tests/test_standard.py

Skipped

1.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_qdrant_vectorstore_init_time

libs/partners/qdrant/tests/unit_tests/test_standard.py

Skipped

175.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time_with_client

libs/partners/anthropic/tests/unit_tests/test_standard.py

Skipped

1.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

test_init_time

libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard

Skipped

652.1 µs*

Commits

Click on a commit to change the comparison range

Base

master

063739b

-3.79%

docs(core): clarify supported formats for multimodal inputs in ModelProfile

d208245

28 days ago

by qinqining

+4.64%

style(core): fix ruff formatting for empty lines

4a1dbdf

28 days ago

by qinqining

+3.81%

style(core): fix formatting to comply with ruff standards

4f28520

28 days ago

by qinqining

-1.12%

style(core): remove empty line before image_url_inputs

d78ed4a

28 days ago

by qinqining

-1.19%

Merge branch 'master' into docs/update-modelprofile-formats

796edd6

26 days ago

by qinqining

-7.98%

Merge branch 'master' into docs/update-modelprofile-formats

d645f8c

25 days ago

by qinqining

+7.16%

Merge branch 'master' into docs/update-modelprofile-formats

b0b6291

15 days ago

by qinqining

Home Terms Privacy Docs