GitHub Actions run
Wall TimeMemory
2 days ago e18c8ef nm/backend-delete-method pull_requestThis run is associated to a commit that was force-pushed
It will not be associated with its branch history. Be careful when comparing its performance to other runs.Compare
Base
Search a run
Head
Comparefeat(sdk): delete operation to backend protocol
#3659
nm/backend-delete-method
2 days ago
Wall TimeMemory
94 total
test_create_deep_agent_minimal
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark52.9 ms
test_with_one_subagent
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark79.4 ms
test_scaling_tools[5_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling54.1 ms
test_scaling_tools[10_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling54.9 ms
test_filesystem_init
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark404.9 µs
test_with_tools
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark53.6 ms
test_scaling_tools[20_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling56.7 ms
test_scaling_subagents[1_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling79.3 ms
test_with_multiple_subagents
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark184.3 ms
test_scaling_subagents[3_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling132 ms
test_full_featured
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark190.2 ms
test_with_string_model_resolution
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentBenchmark53.2 ms
test_scaling_subagents[10_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling316.1 ms
test_scaling_subagents[5_subagents]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling184 ms
test_scaling_tools[1_tools]
libs/deepagents/tests/benchmarks/test_benchmark_create_deep_agent.py::TestCreateDeepAgentScaling53.3 ms
The benchmarks below were skipped, so their baseline results are used instead.
test_repl_memory_peak[console_log-8_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
6.7 MB*
test_repl_memory_peak[console_log-32_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
15.3 MB*
test_repl_memory_peak[ptc_tools-8_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
5.2 MB*
test_repl_memory_peak[console_log-1_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
1 MB*
test_repl_memory_peak[ptc_tools-32_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
19.4 MB*
test_repl_memory_peak[ptc_tools-1_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
1 MB*
test_repl_memory_peak[console_log-64_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
16.4 MB*
test_repl_memory_peak[ptc_tools-64_threads]
libs/partners/quickjs/tests/benchmarks/test_quickjs_memory.py::TestQuickJSMemoryBenchmarksSkipped
38.7 MB*
test_multi_turn_snapshot_throughput[snapshot_disabled-50_turns]
libs/partners/quickjs/tests/benchmarks/test_quickjs_throughput.py::TestQuickJSThroughputBenchmarksSkipped
6.1 s*
test_multi_turn_snapshot_throughput[snapshot_enabled-10_turns]
libs/partners/quickjs/tests/benchmarks/test_quickjs_throughput.py::TestQuickJSThroughputBenchmarksSkipped
1.2 s*