Avatar for the CodSpeedHQ user
CodSpeedHQ
codspeed-rust
Instrumentation
Wall Time
BlogDocsChangelog

feat!: add warmup runs

#5Merged
Comparing
feat/add-warmup
(
bb6087f
) with
main
(
f9fbacd
)
CodSpeed Performance Gauge
+72%
Improvements
6
Untouched
42
Ignored
3

Benchmarks

Improved

from_elem[1024]
crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem::from_elem[1024]
CodSpeed Performance Gauge
+72%
3.3 µs1.9 µs
Iterative
crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis::Fibonacci::Iterative
CodSpeed Performance Gauge
+29%
133.3 ns103.6 ns
Iterative[20]
crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3::Iterative[20]
CodSpeed Performance Gauge
+29%
133.3 ns103.6 ns
Iterative[21]
crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3::Iterative[21]
CodSpeed Performance Gauge
+28%
135 ns105.3 ns
from_elem_decimal[2048]
crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem::from_elem_decimal[2048]
CodSpeed Performance Gauge
+5%
3.9 µs3.7 µs
b
crates/bencher_compat/benches/bencher_example.rs::b
CodSpeed Performance Gauge
+3%
2.8 µs2.7 µs

Passed

from_elem[4096]
crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem::from_elem[4096]
CodSpeed Performance Gauge
+1%
7.1 µs7 µs
large_drop
crates/criterion_compat/benches/criterion_integration/iter_with_large_drop.rs::benches::large_drop::iter_with_large_drop::large_drop
CodSpeed Performance Gauge
0%
1 ms1 ms
Recursive
crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis::Fibonacci::Recursive
CodSpeed Performance Gauge
0%
81 µs80.9 µs
Recursive[20]
crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3::Recursive[20]
CodSpeed Performance Gauge
0%
81 µs80.9 µs
Recursive[21]
crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3::Recursive[21]
CodSpeed Performance Gauge
0%
130.7 µs130.6 µs
fibo_recursive_cached
crates/codspeed/benches/native.rs::fibo_recursive_cached
CodSpeed Performance Gauge
0%
7 µs7 µs
fibo_recursive
crates/codspeed/benches/native.rs::fibo_recursive
CodSpeed Performance Gauge
0%
916.7 ns916.7 ns
fibo_iterative
crates/codspeed/benches/native.rs::fibo_iterative
CodSpeed Performance Gauge
0%
126.4 ns126.4 ns
a
crates/bencher_compat/benches/bencher_example.rs::a
CodSpeed Performance Gauge
0%
254.7 ns254.7 ns
with_input[5]
crates/criterion_compat/benches/test_benches.rs::benches::bench::with_input[5]
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
small_drop
crates/criterion_compat/benches/criterion_integration/iter_with_large_drop.rs::benches::small_drop::iter_with_large_drop::small_drop
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
large_setup
crates/criterion_compat/benches/criterion_integration/iter_with_large_setup.rs::benches::large_setup::iter_with_large_setup::large_setup
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
small_setup
crates/criterion_compat/benches/criterion_integration/iter_with_large_setup.rs::benches::small_setup::iter_with_large_setup::small_setup
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_with_setup
crates/criterion_compat/benches/criterion_integration/iter_with_setup.rs::benches::setup::iter_with_setup
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
fibonacci_custom_measurement
crates/criterion_compat/benches/criterion_integration/custom_measurement.rs::benches::fibonacci_cycles::fibonacci_custom_measurement
CodSpeed Performance Gauge
0%
916.7 ns916.7 ns
from_elem[16384]
crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem::from_elem[16384]
CodSpeed Performance Gauge
0%
19.4 µs19.4 µs
from_elem[8192]
crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem::from_elem[8192]
CodSpeed Performance Gauge
0%
11.1 µs11.2 µs
from_elem[2048]
crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem::from_elem[2048]
CodSpeed Performance Gauge
-1%
3.9 µs3.9 µs
from_elem_decimal[1024]
crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem::from_elem_decimal[1024]
CodSpeed Performance Gauge
-1%
1.9 µs1.9 µs
"*benchmark/" '
crates/criterion_compat/benches/criterion_integration/special_characters.rs::benches::some_benchmark::"*group/"::"*benchmark/" '
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_with_setup
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_with_setup
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_with_large_setup
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_with_large_setup
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_with_large_drop
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_with_large_drop
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_batched_small_input
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_batched_small_input
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_batched_large_input
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_batched_large_input
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_batched_per_iteration
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_batched_per_iteration
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_batched_ref_small_input
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_batched_ref_small_input
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_batched_ref_large_input
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_batched_ref_large_input
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter_batched_ref_per_iteration
crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead::iter_batched_ref_per_iteration
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns
iter
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_with_setup
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_with_setup
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_with_large_setup
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_with_large_setup
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_with_large_drop
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_with_large_drop
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_batched_small_input
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_batched_small_input
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_batched_large_input
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_batched_large_input
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_batched_per_iteration
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_batched_per_iteration
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_batched_ref_small_input
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_batched_ref_small_input
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_batched_ref_large_input
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_batched_ref_large_input
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
iter_batched_ref_per_iteration
crates/criterion_compat/benches/criterion_integration/async_measurement_overhead.rs::benches::some_benchmark::async overhead::iter_batched_ref_per_iteration
CodSpeed Performance Gauge
N/A
29.4 ns< 1 ns
sum_fold
crates/criterion_compat/benches/criterion_example.rs::benches::a::sum_fold
CodSpeed Performance Gauge
0%
254.7 ns254.7 ns
build_vec
crates/criterion_compat/benches/criterion_example.rs::benches::b::build_vec
CodSpeed Performance Gauge
0%
2.8 µs2.8 µs

Ignored

Auto
crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode::Auto
Ignored
CodSpeed Performance Gauge
+19%
184.4 ns155.3 ns
Linear
crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode::Linear
Ignored
CodSpeed Performance Gauge
+19%
184.4 ns155.3 ns
Flat
crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode::Flat
Ignored
CodSpeed Performance Gauge
+6%
533.9 ns504.7 ns

Commits

Click on a commit to change the comparison range
Base
main
f9fbacd
+74.91%
feat!: add warmup runs
9b955a7
2 years ago
by art049
0%
fix: add more opaque black boxes in the tests
ac7e208
2 years ago
by art049
-2.68%
feat: harden criterion compat library against optimization
bb6087f
2 years ago
by art049
© 2025 CodSpeed Technology
Home Terms Privacy Docs