test(sdk): add benchmark regression sleep
#2359Comparing
eugene/benchmark-sleep-regression
(d2e5cf8
) withmain
(f3a19e9
)+1%
- Untouched
- 32
- Skipped
- 15
Benchmarks
15 total
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_scaling_tools[10_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
79.8 ms*
test_create_deep_agent_minimal
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
78.4 ms*
test_filesystem_init
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
351 µs*
test_with_tools
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
78.9 ms*
test_scaling_subagents[1_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
117.1 ms*
test_scaling_tools[5_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
79.2 ms*
test_scaling_subagents[5_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
271.9 ms*
test_scaling_subagents[3_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
194.6 ms*
test_scaling_tools[20_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
81.4 ms*
test_with_multiple_subagents
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
272.5 ms*
test_with_string_model_resolution
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
78.5 ms*
test_scaling_subagents[10_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
465.7 ms*
test_with_one_subagent
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
117.3 ms*
test_full_featured
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
228.5 ms*
test_scaling_tools[1_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
78.5 ms*
Commits
Click on a commit to change the comparison rangeBase
main
f3a19e9
+1.05%
test(sdk): reduce benchmark regression sleep
369c6dc
2 days ago
by eyurtsev-0.07%
Merge branch 'main' into eugene/benchmark-sleep-regression
d2e5cf8
14 hours ago
by mdrxy