docs(core): clarify supported formats for multimodal inputs in ModelProfile
#35628Comparing
qinqining:docs/update-modelprofile-formats
(b0b6291
) withmaster
(063739b
)+2%
- Untouched
- 13
- Skipped
- 27
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.No successful run was found on master ( 491eb9d) during the generation of this report, so 063739b was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
40 total
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py+4%
445.9 ms*429.9 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py+3%
508.7 ms*496 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py+3%
464.8 ms*453.4 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py+2%
264.1 ms*257.9 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py+2%
375.8 ms*368.4 ms
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py+1%
216.2 ms*213.1 ms
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py+1%
20.4 ms*20.1 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py+1%
155.4 ms*153.7 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py+1%
455.3 ms*450.6 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py+1%
143 ms*141.6 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py+1%
407.3 ms*403.3 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py0%
404.7 ms*403.7 ms
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py-1%
523.7 ms*526.4 ms
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandardSkipped
1.1 ms*
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandardSkipped
6.6 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
12.1 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandardSkipped
1.7 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
823.6 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
12.2 ms*
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandardSkipped
27.2 ms*
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnitSkipped
383.9 ms*
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllamaSkipped
406.9 ms*
Commits
Click on a commit to change the comparison rangeBase
master
063739b
-3.79%
docs(core): clarify supported formats for multimodal inputs in ModelProfile
d208245
1 month ago
by qinqining+4.64%
style(core): fix ruff formatting for empty lines
4a1dbdf
1 month ago
by qinqining+3.81%
style(core): fix formatting to comply with ruff standards
4f28520
1 month ago
by qinqining-1.12%
style(core): remove empty line before image_url_inputs
d78ed4a
1 month ago
by qinqining-1.19%
Merge branch 'master' into docs/update-modelprofile-formats
796edd6
1 month ago
by qinqining-7.98%
Merge branch 'master' into docs/update-modelprofile-formats
d645f8c
29 days ago
by qinqining+7.16%
Merge branch 'master' into docs/update-modelprofile-formats
b0b6291
19 days ago
by qinqining