Comparing
hunter/per-call-timeout-host-wait
(59e2556
) withmain
(eaab304
)-11%
- Improvement
- 8
- Regression
- 1
- Untouched
- 24
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
33 total
bench_marshal_list_10k_ints
benchmarks/test_marshaling.py-11%
720 µs811.6 µs
bench_eval_async_noop
benchmarks/test_eval_async.py+64%
103.4 µs63.1 µs
bench_eval_async_immediate_host
benchmarks/test_eval_async.py+49%
146.5 µs98.4 µs
bench_host_call_async_noop
benchmarks/test_host_functions.py+47%
144 µs98.1 µs
bench_runtime_create
benchmarks/test_startup.py+28%
14.6 µs11.4 µs
bench_eval_async_sequential_10
benchmarks/test_eval_async.py+26%
366.4 µs291.9 µs
bench_eval_async_fan_out_10
benchmarks/test_eval_async.py+23%
256.4 µs207.9 µs
bench_threaded_runtime_context_isolation_tps
benchmarks/test_threaded_stress.py+23%
810.7 ms660 ms
bench_marshal_bytes_1mb
benchmarks/test_marshaling.py+16%
91.2 µs78.9 µs
bench_marshal_dict_flat_100
benchmarks/test_marshaling.py+10%
46.6 µs42.5 µs
bench_eval_object_create_1k
benchmarks/test_eval_sync.py+8%
556.5 µs515.4 µs
bench_context_create_10x
benchmarks/test_startup.py+8%
1.7 ms1.6 ms
bench_host_call_100x_loop
benchmarks/test_host_functions.py+7%
54.9 µs51.5 µs
bench_runtime_and_context
benchmarks/test_startup.py+6%
128 µs120.9 µs
bench_eval_json_parse_10kb
benchmarks/test_eval_sync.py+5%
242.6 µs230.1 µs
bench_eval_regex
benchmarks/test_eval_sync.py+5%
31.4 µs29.9 µs
bench_context_create
benchmarks/test_startup.py+4%
158.3 µs151.5 µs
bench_eval_loop_1m
benchmarks/test_eval_sync.py0%
23.9 ms23.9 ms
bench_mem_runtime_4x_context_payload
benchmarks/test_memory.py0%
2.2 MB2.2 MB
bench_mem_runtime_context_create
benchmarks/test_memory.py0%
87 KB87 KB
bench_mem_gc_reclaim_cycle
benchmarks/test_memory.py0%
2.1 MB2.1 MB
bench_eval_string_concat
benchmarks/test_eval_sync.py-2%
3.9 µs3.9 µs
bench_eval_fibonacci_30
benchmarks/test_eval_sync.py-2%
102.7 ms104.7 ms
bench_eval_json_parse
benchmarks/test_eval_sync.py-2%
17.1 µs17.6 µs
bench_host_call_identity_int
benchmarks/test_host_functions.py-3%
3.8 µs3.9 µs
Commits
Click on a commit to change the comparison rangeBase
main
eaab304
-11.28%
fix(timeout): make async timeouts per-call by default
59e2556
18 days ago
by hntrl