Comparing
hunter/spec-cleanup
(2024253
) withmain
(02a137e
)-12%
- Improvement
- 7
- Regression
- 2
- Untouched
- 21
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
30 total
bench_marshal_bytes_1mb
benchmarks/test_marshaling.py-12%
71.8 µs81.8 µs
bench_marshal_list_10k_ints
benchmarks/test_marshaling.py-11%
736.6 µs824.5 µs
bench_eval_async_noop
benchmarks/test_eval_async.py+67%
105.1 µs63 µs
bench_eval_async_immediate_host
benchmarks/test_eval_async.py+46%
146.6 µs100.6 µs
bench_host_call_async_noop
benchmarks/test_host_functions.py+41%
141.2 µs100.1 µs
bench_eval_async_sequential_10
benchmarks/test_eval_async.py+24%
358.2 µs289.7 µs
bench_eval_async_fan_out_10
benchmarks/test_eval_async.py+23%
255.6 µs207.1 µs
bench_threaded_runtime_context_isolation_tps
benchmarks/test_threaded_stress.py+20%
844.8 ms702.1 ms
bench_eval_regex
benchmarks/test_eval_sync.py+11%
36.7 µs33.1 µs
bench_eval_object_create_1k
benchmarks/test_eval_sync.py+10%
559 µs509 µs
bench_eval_loop_1m
benchmarks/test_eval_sync.py+9%
26.2 ms24 ms
bench_context_create_10x
benchmarks/test_startup.py+8%
1.7 ms1.6 ms
bench_host_call_100x_loop
benchmarks/test_host_functions.py+7%
56.7 µs53 µs
bench_eval_json_parse_10kb
benchmarks/test_eval_sync.py+6%
246.2 µs232.4 µs
bench_host_call_identity_dict
benchmarks/test_host_functions.py+3%
4.9 µs4.8 µs
bench_runtime_create
benchmarks/test_startup.py+3%
13.1 µs12.7 µs
bench_context_create
benchmarks/test_startup.py+2%
157.6 µs155 µs
bench_eval_json_parse
benchmarks/test_eval_sync.py+2%
17.5 µs17.3 µs
bench_marshal_dict_flat_100
benchmarks/test_marshaling.py+1%
42.7 µs42.4 µs
bench_marshal_string_1kb
benchmarks/test_marshaling.py0%
4.3 µs4.3 µs
bench_eval_string_concat
benchmarks/test_eval_sync.py0%
3.8 µs3.8 µs
bench_marshal_int
benchmarks/test_marshaling.py0%
3.5 µs3.5 µs
bench_host_call_identity_int
benchmarks/test_host_functions.py-1%
3.8 µs3.8 µs
bench_runtime_and_context
benchmarks/test_startup.py-1%
126.5 µs127.5 µs
bench_eval_arithmetic
benchmarks/test_eval_sync.py-2%
3.1 µs3.1 µs
Commits
Click on a commit to change the comparison rangeBase
main
02a137e
×2.1
merge(main): refresh cleanup pass on latest origin/main
8d5c6f5
4 days ago
by hntrlcr
e15b992
4 days ago
by hntrl+21.01%
cr
2024253
4 days ago
by hntrl