langchain-ai
langchain
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
feat(anthropic,model-profiles): add `effort` support
#34116
Comparing
mdrxy/effort-anthropic
(
43a2253
) with
mdrxy/anthropic-auto-append-betas
(
1ab885d
)
CodSpeed Performance Gauge
+28%
Improvements
7
Untouched
9
Skipped
18
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using
CodSpeed Macro Runners
: bare-metal machines fine-tuned for performance measurement consistency.
Benchmarks
Skipped (18)
Improved
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py
CodSpeed Performance Gauge
+28%
23.5 ms
*
18.4 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+12%
529 ms
*
470.9 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+12%
512.8 ms
*
458.3 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+11%
456 ms
*
410 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+11%
433.8 ms
*
391.3 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+11%
268.3 ms
*
242.7 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+10%
489 ms
*
443.9 ms
Passed
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+10%
486.8 ms
*
442.7 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+9%
604.8 ms
*
555.5 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+9%
176.3 ms
*
162 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+9%
576.9 ms
*
530.4 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+8%
185 ms
*
171 ms
Uses the
Wall Time instrument
to collect wall time performance metrics.
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py
CodSpeed Performance Gauge
+8%
519.7 ms
*
481.7 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandard
CodSpeed Performance Gauge
0%
34.7 ms
34.7 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.py
CodSpeed Performance Gauge
0%
2.3 ms
2.3 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandard
CodSpeed Performance Gauge
-1%
807.4 µs
819.1 µs
Commits
Click on a commit to change the comparison range
Base
mdrxy/anthropic-auto-append-betas
1ab885d
-0.56%
Merge branch 'mdrxy/anthropic-auto-append-betas' into mdrxy/effort-anthropic
d084a72
4 days ago
by mdrxy
+2.93%
int test
e54a43a
4 days ago
by mdrxy
-4.13%
fix ext tests
7d5efe0
4 days ago
by mdrxy
+2.95%
.
2d4c362
4 days ago
by mdrxy
-0.35%
.
a6a08ad
4 days ago
by mdrxy
+26.69%
fix hardcoding
43a2253
3 days ago
by mdrxy
© 2025 CodSpeed Technology
Home
Terms
Privacy
Docs