Comparing
hunter/release-0-1-1
(d6a9774
) withmain
(757c341
)-33%
- Improvement
- 3
- Regression
- 15
- Untouched
- 27
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
45 total
bench_marshal_string_100kb
benchmarks/test_marshaling.py-33%
29.6 µs44 µs
bench_eval_async_noop
benchmarks/test_eval_async.py-19%
85.5 µs105.8 µs
bench_eval_async_immediate_host
benchmarks/test_eval_async.py-18%
122 µs149.3 µs
bench_eval_regex
benchmarks/test_eval_sync.py-18%
32.2 µs39.2 µs
bench_host_call_async_noop
benchmarks/test_host_functions.py-17%
121.8 µs147.6 µs
bench_eval_async_fan_out_10
benchmarks/test_eval_async.py-16%
230.6 µs273.8 µs
bench_eval_async_sequential_10
benchmarks/test_eval_async.py-15%
323.7 µs379.3 µs
bench_host_call_100x_loop
benchmarks/test_host_functions.py-14%
52.6 µs60.9 µs
bench_eval_loop_1m
benchmarks/test_eval_sync.py-13%
21.4 ms24.6 ms
bench_eval_fibonacci_30
benchmarks/test_eval_sync.py-12%
90.8 ms102.9 ms
bench_context_create_10x
benchmarks/test_startup.py-11%
1.6 ms1.8 ms
bench_snapshot_create_medium
benchmarks/test_snapshot.py-11%
429.4 µs482.4 µs
bench_threaded_runtime_context_isolation_tps
benchmarks/test_threaded_stress.py-11%
862.7 ms965.3 ms
bench_snapshot_create_large
benchmarks/test_snapshot.py-11%
1.8 ms2 ms
bench_eval_json_parse_10kb
benchmarks/test_eval_sync.py-10%
233.8 µs260.5 µs
bench_marshal_bytes_1mb
benchmarks/test_marshaling.py×2.3
174.7 µs74.8 µs
bench_snapshot_extraction_large_with_names
benchmarks/test_snapshot_extraction.py+30%
41.2 ms31.6 ms
bench_runtime_create
benchmarks/test_startup.py+13%
12.5 µs11.1 µs
bench_runtime_and_context
benchmarks/test_startup.py+5%
131.7 µs125.2 µs
bench_snapshot_restore_small
benchmarks/test_snapshot.py+3%
19 µs18.4 µs
bench_eval_arithmetic
benchmarks/test_eval_sync.py+2%
3.6 µs3.5 µs
bench_context_create
benchmarks/test_startup.py+2%
162.6 µs160 µs
bench_marshal_dict_nested_5
benchmarks/test_marshaling.py+1%
6.5 µs6.5 µs
bench_eval_noop
benchmarks/test_eval_sync.py+1%
3 µs3 µs
bench_marshal_int
benchmarks/test_marshaling.py+1%
3.9 µs3.9 µs
Commits
Click on a commit to change the comparison rangeBase
main
757c341
-32.81%
release: 0.1.1
d6a9774
17 days ago
by hntrl