GitHub Actions run
Wall TimeMemory
16 hours ago 746c66d main pushCompare
Suggested base runs: •
94 total
test_filesystem_init
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark369.9 µs
test_scaling_tools[5_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling54.2 ms
test_create_deep_agent_minimal
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark53 ms
test_scaling_subagents[5_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling183.3 ms
test_with_tools
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark53.8 ms
test_scaling_subagents[10_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling314.9 ms
test_scaling_subagents[3_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling131.9 ms
test_with_one_subagent
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark79.6 ms
test_scaling_tools[10_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling55.2 ms
test_with_multiple_subagents
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark184.3 ms
test_scaling_tools[20_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling56.8 ms
test_full_featured
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark191 ms
test_scaling_subagents[1_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling79.6 ms
test_with_string_model_resolution
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark53.4 ms
test_scaling_tools[1_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling53.4 ms
The benchmarks below were skipped, so their baseline results are used instead.
test_repl_memory_peak[console_log-8_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
6.7 MB*
test_repl_memory_peak[console_log-32_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
15.3 MB*
test_repl_memory_peak[ptc_tools-8_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
5.2 MB*
test_repl_memory_peak[console_log-1_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
1 MB*
test_repl_memory_peak[ptc_tools-32_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
19.4 MB*
test_repl_memory_peak[ptc_tools-1_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
1 MB*
test_repl_memory_peak[console_log-64_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
16.4 MB*
test_repl_memory_peak[ptc_tools-64_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
38.7 MB*
test_multi_turn_snapshot_throughput[snapshot_disabled-50_turns]
libs/partners/quickjs/tests/benchmarks/test_quickjs_throughput.py::TestQuickJSThroughputBenchmarksSkipped
6.1 s*
test_multi_turn_snapshot_throughput[snapshot_enabled-10_turns]
libs/partners/quickjs/tests/benchmarks/test_quickjs_throughput.py::TestQuickJSThroughputBenchmarksSkipped
1.2 s*