Summarization Experiment
#2711Comparing
cat-experiment
(ba7a620
) withmain
(6e57731
)-1%
- Untouched
- 32
- Skipped
- 15
No successful run was found on simplify-harbor ( eaae7e7) during the generation of this report, so main ( 6e57731) was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
15 total
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_create_deep_agent_minimal
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
53.9 ms*
test_with_one_subagent
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
80.9 ms*
test_scaling_subagents[3_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
133.8 ms*
test_scaling_subagents[10_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
320 ms*
test_filesystem_init
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
360.2 µs*
test_scaling_tools[5_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
54.9 ms*
test_full_featured
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
190.2 ms*
test_scaling_tools[10_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
55.9 ms*
test_with_tools
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
54.6 ms*
test_scaling_subagents[1_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
80.7 ms*
test_with_string_model_resolution
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
54.2 ms*
test_scaling_tools[20_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
57.6 ms*
test_scaling_subagents[5_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
187.2 ms*
test_scaling_tools[1_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScalingSkipped
54.2 ms*
test_with_multiple_subagents
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmarkSkipped
187.3 ms*
Commits
Click on a commit to change the comparison rangeBase
main
6e57731
-0.59%
everything
0f0dbfa
10 days ago
by maahir30+0.6%
add all changes
5e3649e
10 days ago
by maahir30-1.24%
updates to prompt
ba7a620
10 days ago
by maahir30