Avatar for the langchain-ai user
langchain-ai
deepagents
BlogDocsChangelog

test(sdk): add benchmark regression sleep

#2359
Comparing
eugene/benchmark-sleep-regression
(
d2e5cf8
) with
main
(
f3a19e9
)
CodSpeed Performance Gauge
+1%
Untouched
32
Skipped
15

Benchmarks

47 total
test_import_config
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestStartupPathBenchmarks
CodSpeed Performance Gauge
+2%
16.8 ms16.5 ms
test_import_cli_context
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestStartupPathBenchmarks
CodSpeed Performance Gauge
+2%
8.3 ms8.2 ms
test_import_configurable_model
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestRuntimePathBenchmarks
CodSpeed Performance Gauge
+2%
670.9 ms659.7 ms
test_import_ask_user
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestRuntimePathBenchmarks
CodSpeed Performance Gauge
+2%
538.2 ms529.6 ms
test_import_textual_adapter
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestStartupPathBenchmarks
CodSpeed Performance Gauge
+2%
53.6 ms52.7 ms
test_import_tool_display
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestStartupPathBenchmarks
CodSpeed Performance Gauge
+1%
21.4 ms21.1 ms
test_import_app
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestStartupPathBenchmarks
CodSpeed Performance Gauge
+1%
77.3 ms76.1 ms
test_import_ui
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestStartupPathBenchmarks
CodSpeed Performance Gauge
+1%
23.3 ms23 ms
test_agent_import_loads_langchain
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestDeferredImportsWork
CodSpeed Performance Gauge
+1%
3.2 s3.2 s
test_no_heavy_imports_on_lightweight_path[main.check_cli_dependencies]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
212.4 ms210 ms
test_version_under_threshold
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestCLIStartupTime
CodSpeed Performance Gauge
+1%
355.4 ms351.5 ms
test_no_heavy_imports_on_lightweight_path[skills.commands]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
161.4 ms159.7 ms
test_module_import_time[config]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportTiming
CodSpeed Performance Gauge
+1%
187.4 ms185.6 ms
test_no_heavy_imports_on_lightweight_path[main.parse_args]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
212.7 ms210.7 ms
test_no_heavy_imports_on_lightweight_path[file_ops]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
143.5 ms142.3 ms
test_module_import_time[tool_display]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportTiming
CodSpeed Performance Gauge
+1%
192.2 ms190.5 ms
test_import_ask_user_types
libs/cli/tests/integration_tests/benchmarks/test_codspeed_import_benchmarks.py::TestStartupPathBenchmarks
CodSpeed Performance Gauge
+1%
9.3 ms9.3 ms
test_module_import_time[main]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportTiming
CodSpeed Performance Gauge
+1%
213.1 ms211.3 ms
test_module_import_time[ui]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportTiming
CodSpeed Performance Gauge
+1%
336.1 ms333.4 ms
test_no_heavy_imports_on_lightweight_path[_ask_user_types]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
313.5 ms311 ms
test_ask_user_middleware_loads_langchain
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestDeferredImportsWork
CodSpeed Performance Gauge
+1%
2 s2 s
test_help_under_threshold
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestCLIStartupTime
CodSpeed Performance Gauge
+1%
561.7 ms557.6 ms
test_no_heavy_imports_on_lightweight_path[ui]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
335.4 ms333 ms
test_no_heavy_imports_on_lightweight_path[tool_display]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
191.7 ms190.3 ms
test_no_heavy_imports_on_lightweight_path[_cli_context.CLIContext]
libs/cli/tests/integration_tests/benchmarks/test_startup_benchmarks.py::TestImportIsolation
CodSpeed Performance Gauge
+1%
124 ms123.1 ms

Commits

Click on a commit to change the comparison range
Base
main
f3a19e9
+1.05%
test(sdk): reduce benchmark regression sleep
369c6dc
2 days ago
by eyurtsev
-0.07%
Merge branch 'main' into eugene/benchmark-sleep-regression
d2e5cf8
7 hours ago
by mdrxy
© 2026 CodSpeed Technology
Home Terms Privacy Docs