Comparing
cc/release
(99c5a69
) withmain
(4038af6
)-55%
- Improvement
- 12
- Regression
- 1
- Untouched
- 20
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
33 total
bench_marshal_bytes_1mb
benchmarks/test_marshaling.py-55%
73 µs161.9 µs
bench_eval_async_noop
benchmarks/test_eval_async.py+28%
107 µs83.3 µs
bench_eval_async_immediate_host
benchmarks/test_eval_async.py+28%
150.7 µs117.5 µs
bench_eval_regex
benchmarks/test_eval_sync.py+27%
36.5 µs28.7 µs
bench_host_call_async_noop
benchmarks/test_host_functions.py+26%
147.5 µs116.8 µs
bench_threaded_runtime_context_isolation_tps
benchmarks/test_threaded_stress.py+25%
870.6 ms697.2 ms
bench_eval_async_sequential_10
benchmarks/test_eval_async.py+22%
367.2 µs302 µs
bench_eval_async_fan_out_10
benchmarks/test_eval_async.py+20%
260.2 µs216.8 µs
bench_marshal_list_10k_ints
benchmarks/test_marshaling.py+19%
750.3 µs630.1 µs
bench_eval_fibonacci_30
benchmarks/test_eval_sync.py+14%
104.2 ms91.3 ms
bench_eval_loop_1m
benchmarks/test_eval_sync.py+14%
24.6 ms21.6 ms
bench_context_create_10x
benchmarks/test_startup.py+12%
1.7 ms1.5 ms
bench_host_call_100x_loop
benchmarks/test_host_functions.py+10%
57 µs51.7 µs
bench_marshal_dict_flat_100
benchmarks/test_marshaling.py+5%
43.2 µs41 µs
bench_marshal_int
benchmarks/test_marshaling.py+4%
3.7 µs3.6 µs
bench_eval_json_parse_10kb
benchmarks/test_eval_sync.py+3%
239.4 µs231.4 µs
bench_eval_json_parse
benchmarks/test_eval_sync.py+3%
17.4 µs16.9 µs
bench_eval_arithmetic
benchmarks/test_eval_sync.py+3%
3.3 µs3.2 µs
bench_marshal_dict_nested_5
benchmarks/test_marshaling.py+3%
6.3 µs6.1 µs
bench_host_call_identity_dict
benchmarks/test_host_functions.py+2%
4.9 µs4.8 µs
bench_host_call_identity_int
benchmarks/test_host_functions.py+2%
3.9 µs3.9 µs
bench_eval_noop
benchmarks/test_eval_sync.py+2%
2.8 µs2.7 µs
bench_marshal_string_1kb
benchmarks/test_marshaling.py+2%
4.4 µs4.4 µs
bench_eval_object_create_1k
benchmarks/test_eval_sync.py0%
556.6 µs553.9 µs
bench_host_call_noop
benchmarks/test_host_functions.py0%
3.3 µs3.3 µs
Commits
Click on a commit to change the comparison rangeBase
main
4038af6
+1.4%
update release workflow
736637e
11 hours ago
by ccurme-56.34%
cr
99c5a69
11 hours ago
by ccurme