GitHub Actions run
Wall TimeMemory
17 hours ago b0e8d83 main pushCompare
Suggested base runs: •
94 total
test_with_tools
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark52.6 ms
test_filesystem_init
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark365.1 µs
test_create_deep_agent_minimal
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark51.9 ms
test_with_one_subagent
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark77.9 ms
test_scaling_tools[20_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling55.6 ms
test_with_multiple_subagents
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark180.5 ms
test_scaling_subagents[1_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling77.9 ms
test_full_featured
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark186.2 ms
test_scaling_subagents[3_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling129.5 ms
test_with_string_model_resolution
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark52.3 ms
test_scaling_subagents[5_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling181 ms
test_scaling_tools[1_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling52.2 ms
test_scaling_subagents[10_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling309.9 ms
test_scaling_tools[5_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling52.9 ms
test_scaling_tools[10_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling53.9 ms
The benchmarks below were skipped, so their baseline results are used instead.
test_repl_memory_peak[console_log-8_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
6.7 MB*
test_repl_memory_peak[console_log-32_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
15.3 MB*
test_repl_memory_peak[ptc_tools-8_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
5.2 MB*
test_repl_memory_peak[console_log-1_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
1 MB*
test_repl_memory_peak[ptc_tools-32_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
19.4 MB*
test_repl_memory_peak[ptc_tools-1_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
1 MB*
test_repl_memory_peak[console_log-64_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
16.4 MB*
test_repl_memory_peak[ptc_tools-64_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
38.7 MB*
test_multi_turn_snapshot_throughput[snapshot_disabled-50_turns]
libs/partners/quickjs/tests/benchmarks/test_quickjs_throughput.py::TestQuickJSThroughputBenchmarksSkipped
6.1 s*
test_multi_turn_snapshot_throughput[snapshot_enabled-10_turns]
libs/partners/quickjs/tests/benchmarks/test_quickjs_throughput.py::TestQuickJSThroughputBenchmarksSkipped
1.2 s*