Comparing
hunter/pending-id-collision
(39216f7
) withhunter/threat-model-doc
(81fad93
)-30%
- Improvement
- 12
- Regression
- 1
- Untouched
- 16
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
29 total
bench_marshal_string_100kb
benchmarks/test_marshaling.py-30%
27.9 µs39.9 µs
bench_eval_regex
benchmarks/test_eval_sync.py+29%
36 µs28 µs
bench_runtime_create
benchmarks/test_startup.py+27%
15.3 µs12 µs
bench_host_call_100x_loop
benchmarks/test_host_functions.py+14%
58.3 µs51.3 µs
bench_eval_async_noop
benchmarks/test_eval_async.py+13%
106.4 µs93.9 µs
bench_host_call_noop
benchmarks/test_host_functions.py+12%
3.2 µs2.9 µs
bench_eval_async_immediate_host
benchmarks/test_eval_async.py+12%
148.4 µs133 µs
bench_host_call_async_noop
benchmarks/test_host_functions.py+11%
147.5 µs132.7 µs
bench_host_call_identity_dict
benchmarks/test_host_functions.py+11%
5 µs4.5 µs
bench_eval_async_fan_out_10
benchmarks/test_eval_async.py+11%
258 µs232.9 µs
bench_eval_async_sequential_10
benchmarks/test_eval_async.py+10%
368.3 µs334 µs
bench_host_call_identity_int
benchmarks/test_host_functions.py+10%
3.8 µs3.5 µs
bench_eval_json_parse
benchmarks/test_eval_sync.py+10%
17.5 µs15.9 µs
bench_marshal_int
benchmarks/test_marshaling.py+10%
3.6 µs3.3 µs
bench_context_create
benchmarks/test_startup.py+9%
159.8 µs146.2 µs
bench_eval_noop
benchmarks/test_eval_sync.py+9%
2.7 µs2.4 µs
bench_runtime_and_context
benchmarks/test_startup.py+9%
127.6 µs117 µs
bench_eval_json_parse_10kb
benchmarks/test_eval_sync.py+9%
248.8 µs228.4 µs
bench_eval_string_concat
benchmarks/test_eval_sync.py+8%
3.8 µs3.5 µs
bench_marshal_string_1kb
benchmarks/test_marshaling.py+8%
4.3 µs3.9 µs
bench_eval_object_create_1k
benchmarks/test_eval_sync.py+8%
567.2 µs524.2 µs
bench_context_create_10x
benchmarks/test_startup.py+8%
1.7 ms1.6 ms
bench_marshal_list_10k_ints
benchmarks/test_marshaling.py+7%
739.4 µs689.1 µs
bench_eval_arithmetic
benchmarks/test_eval_sync.py+7%
3.1 µs2.9 µs
bench_marshal_dict_flat_100
benchmarks/test_marshaling.py+7%
43.4 µs40.6 µs
Commits
Click on a commit to change the comparison rangeBase
hunter/threat-model-doc
81fad93
-30.13%
fix(runtime): prevent async pending-id collision on wraparound
39216f7
4 days ago
by hntrl