fix(core,model-profiles): add missing `ModelProfile` fields, warn on schema drift
#36129Comparing
mdrxy/model-profiles/schema
(a1be2d5
) withmaster
(7d05cfb
)-15%
- Regression
- 5
- Untouched
- 8
- Skipped
- 27
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
40 total
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py-15%
523.7 ms*613.2 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py-13%
407.3 ms*467.8 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py-13%
508.7 ms*583.5 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py-12%
404.7 ms*459.9 ms
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py-11%
445.9 ms*502.4 ms
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py-4%
20.4 ms*21.3 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py-8%
155.4 ms*168 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py-8%
464.8 ms*505.3 ms
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py-8%
216.2 ms*235.1 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py-9%
143 ms*156.5 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py-9%
375.8 ms*411.3 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py-9%
264.1 ms*289.1 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py-9%
455.3 ms*499.8 ms
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicBedrockStandardSkipped
1.1 ms*
test_init_time
libs/partners/fireworks/tests/unit_tests/test_standard.py::TestFireworksStandardSkipped
6.6 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
12.1 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandardSkipped
1.7 s*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
823.6 ms*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
12.2 ms*
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandardSkipped
27.2 ms*
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnitSkipped
383.9 ms*
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllamaSkipped
406.9 ms*
Commits
Click on a commit to change the comparison rangeBase
master
7d05cfb
+23.82%
fix(core,model-profiles): add missing `ModelProfile` fields, warn on schema drift
07c3f43
23 hours ago
by mdrxy-23.82%
fix(core): handle AttributeError in profile validators
8b41d44
23 hours ago
by mdrxy-2.83%
cr
9262c5b
22 hours ago
by mdrxy+3.84%
cr
932ae54
21 hours ago
by mdrxy-15.61%
chore: trigger ci
a1be2d5
21 hours ago
by mdrxy