cod-393-default-to-profile-bench - Branch - CodSpeedHQ/codspeed-rust

feat: change default profile from release to bench for build command

#102Merged

Comparing

cod-393-default-to-profile-bench

(

087f25d

) with

main

(

b71c93b

)

-72%

Improvements: 10

Regressions: 4

Untouched: 149

This report only contains results for the Wall Time instrument. To view results for the CPU Simulation instrument, click here.

Benchmarks

Failed

sleep_100ns

crates/divan_compat/examples/benches/time_scale.rs

Regression

-72%

16.2 µs57.6 µs

graph_coloring[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

Regression

-4%

1 µs1.1 µs

sleep_100us

crates/divan_compat/examples/benches/time_scale.rs

Regression

-6%

126.1 µs133.6 µs

permutations[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

Regression

-4%

66.6 µs69.1 µs

Improved

add_two_integers[(42, 13)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

×3.3

20 ns6 ns

add_two_integers[(255, 255)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

×3.3

20 ns6 ns

sleep_1ns

crates/divan_compat/examples/benches/time_scale.rs

+58%

36.6 µs23.1 µs

sleep_1us

crates/divan_compat/examples/benches/time_scale.rs

+51%

36.9 µs24.5 µs

large_setup

crates/criterion_compat/benches/criterion_integration/iter_with_large_setup.rs::benches::large_setup::iter_with_large_setup

+9%

12 ns11 ns

permutations[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+6%

817 µs768.8 µs

permutations[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+5%

11.4 µs10.9 µs

large_drop

crates/criterion_compat/benches/criterion_integration/iter_with_large_drop.rs::benches::large_drop::iter_with_large_drop

+5%

175.3 µs167.2 µs

generate_combinations[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+5%

827 ns791 ns

from_elem[4096]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

+3%

338 ns327 ns

Passed

sleep_10ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

10.1 ms10.1 ms

sleep_100ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

100.1 ms100.1 ms

iter_with_large_setup

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

"*benchmark/" '

crates/criterion_compat/benches/criterion_integration/special_characters.rs::benches::some_benchmark::"*group/"

N/A

< 1 ns< 1 ns

Recursive[21]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

84.7 µs84.7 µs

sum_fold

crates/criterion_compat/benches/criterion_example.rs::benches::a

304 ns304 ns

iter

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

bench_explicit_measurement

crates/criterion_compat/benches/test_benches.rs::benches::bench_using_group_with_explicit_measurement::group

N/A

< 1 ns< 1 ns

iter_batched_large_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

from_elem[1024]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

+1%

82 ns81 ns

fibonacci_custom_measurement

crates/criterion_compat/benches/criterion_integration/custom_measurement.rs::benches::fibonacci_cycles

422 ns422 ns

Iterative[21]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

22 ns22 ns

Linear

crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode

3 ns3 ns

iter_batched_ref_small_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

iter_batched_ref_large_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

from_elem_decimal[1024]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

+1%

82 ns81 ns

small_setup

crates/criterion_compat/benches/criterion_integration/iter_with_large_setup.rs::benches::small_setup::iter_with_large_setup

1 ns1 ns

Iterative[20]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

21 ns21 ns

iter_with_setup

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

40 ns40 ns

iter_batched_ref_per_iteration

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

40 ns40 ns

iter_batched_per_iteration

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

40 ns40 ns

Auto

crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode

3 ns3 ns

sleep_50ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

50.1 ms50.1 ms

sleep_1ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

1.1 ms1.1 ms

from_elem[16384]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

816 ns819 ns

Recursive[20]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

52.3 µs52.5 µs

from_elem[2048]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

-1%

244 ns247 ns

with_input[5]

crates/criterion_compat/benches/test_benches.rs::benches::bench_with_explicit_lifetime

N/A

< 1 ns< 1 ns

Recursive

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis::Fibonacci

52.3 µs52.3 µs

build_vec

crates/criterion_compat/benches/criterion_example.rs::benches::b

205 ns206 ns

from_elem_decimal[2048]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

-1%

244 ns247 ns

iter_with_setup

crates/criterion_compat/benches/criterion_integration/iter_with_setup.rs::benches::setup

-3%

39 ns40 ns

small_drop

crates/criterion_compat/benches/criterion_integration/iter_with_large_drop.rs::benches::small_drop::iter_with_large_drop

N/A

< 1 ns< 1 ns

iter_with_large_drop

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

with_input[5]

crates/criterion_compat/benches/test_benches.rs::benches::nested::bench

N/A

< 1 ns< 1 ns

iter_batched_small_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

Iterative

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis::Fibonacci

21 ns21 ns

with_input[5]

crates/criterion_compat/benches/test_benches.rs::benches::bench

N/A

< 1 ns< 1 ns

from_elem[8192]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

+3%

497 ns483 ns

permutations[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+2%

2.4 µs2.4 µs

knight_tour[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

293.1 ms292.3 ms

knight_tour[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

299.2 µs298.3 µs

sudoku

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

108.6 µs108.6 µs

sort

crates/divan_compat/examples/benches/sort.rs::sorted

137.3 µs137.2 µs

generate_gray_code[1]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

131 ns131 ns

tsc (aarch64)

crates/divan_compat/examples/benches/time.rs::now

3 ns3 ns

rem

crates/divan_compat/examples/benches/math.rs

3 ns3 ns

iterative[5]

crates/divan_compat/examples/benches/math.rs::fibonacci

7 ns7 ns

add_two_integers[(65535, -65535)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

75 ns75 ns

hamiltonian_cycle[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

720 ns720 ns

find_highest_set_bit[1024]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

recursive_memoized[BTreeMap<u64, u64>, 10]

crates/divan_compat/examples/benches/math.rs::fibonacci

513 ns513 ns

recursive_memoized[HashMap<u64, u64>, 30]

crates/divan_compat/examples/benches/math.rs::fibonacci

5.7 µs5.7 µs

iterative[20]

crates/divan_compat/examples/benches/math.rs::fibonacci

40 ns40 ns

recursive_memoized[BTreeMap<u64, u64>, 20]

crates/divan_compat/examples/benches/math.rs::fibonacci

1.7 µs1.7 µs

instant

crates/divan_compat/examples/benches/time.rs::now

39 ns39 ns

count_set_bits[42]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

13 ns13 ns

recursive_memoized[HashMap<u64, u64>, 20]

crates/divan_compat/examples/benches/math.rs::fibonacci

3.3 µs3.3 µs

subset_sum[14]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

2 µs2 µs

mul

crates/divan_compat/examples/benches/math.rs

2 ns2 ns

add_two_integers[(0, 0)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

n_queens_solver[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

532.7 µs532.9 µs

recursive[30]

crates/divan_compat/examples/benches/math.rs::fibonacci

5.8 ms5.8 ms

generate_parentheses[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

21.7 µs21.7 µs

subset_sum[10]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

977 ns980 ns

permutations[3]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

704 ns707 ns

recursive_memoized[BTreeMap<u64, u64>, 5]

crates/divan_compat/examples/benches/math.rs::fibonacci

-1%

182 ns183 ns

rat_in_maze[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

794 ns800 ns

generate_combinations[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

1.3 µs1.3 µs

generate_gray_code[4]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

-1%

890 ns899 ns

generate_gray_code[3]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

-1%

452 ns458 ns

hamiltonian_cycle[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

555 ns563 ns

generate_combinations[9]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

4.2 µs4.3 µs

generate_combinations[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

4.1 µs4.2 µs

graph_coloring[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-3%

1.2 µs1.3 µs

tsc (aarch64)

crates/divan_compat/examples/benches/time.rs::duration_since

N/A

< 1 ns< 1 ns

rat_in_maze[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+1%

594 ns588 ns

n_queens_solver[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+1%

1.7 µs1.6 µs

generate_parentheses[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+1%

69.4 µs68.9 µs

recursive_memoized[HashMap<u64, u64>, 5]

crates/divan_compat/examples/benches/math.rs::fibonacci

575 ns573 ns

rat_in_maze[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

917 ns914 ns

sleep_10ms

crates/divan_compat/benches/sleep_benches.rs

10.1 ms10 ms

sort_unstable

crates/divan_compat/examples/benches/sort.rs::random

3.3 ms3.3 ms

n_queens_solver[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

127.1 µs126.8 µs

recursive[20]

crates/divan_compat/examples/benches/math.rs::fibonacci

47.7 µs47.6 µs

sleep_1ms

crates/divan_compat/examples/benches/time_scale.rs

1.1 ms1.1 ms

sleep_1ms

crates/divan_compat/benches/sleep_benches.rs

1.1 ms1.1 ms

Flat

crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode

10.1 ms10.1 ms

sleep_50ms

crates/divan_compat/benches/sleep_benches.rs

50.1 ms50.1 ms

add

crates/divan_compat/examples/benches/math.rs

2 ns2 ns

iterative[0]

crates/divan_compat/examples/benches/math.rs::fibonacci

1 ns1 ns

iterative[30]

crates/divan_compat/examples/benches/math.rs::fibonacci

51 ns51 ns

count_set_bits[1024]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

13 ns13 ns

count_set_bits[0]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

13 ns13 ns

subset_sum[16]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

3.9 µs3.9 µs

find_highest_set_bit[255]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

system_time

crates/divan_compat/examples/benches/time.rs::now

39 ns39 ns

print_env_hello

crates/divan_compat/examples/benches/env.rs

1.9 µs1.9 µs

count_set_bits[255]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

13 ns13 ns

find_highest_set_bit[65535]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

count_set_bits[65535]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

13 ns13 ns

add_two_integers[(1024, -1024)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

66 ns66 ns

iterative[10]

crates/divan_compat/examples/benches/math.rs::fibonacci

16 ns16 ns

recursive[0]

crates/divan_compat/examples/benches/math.rs::fibonacci

1 ns1 ns

instant

crates/divan_compat/examples/benches/time.rs::duration_since

10 ns10 ns

find_highest_set_bit[0]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

recursive_memoized[HashMap<u64, u64>, 0]

crates/divan_compat/examples/benches/math.rs::fibonacci

15 ns15 ns

subset_sum[12]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

1.9 µs1.9 µs

recursive[5]

crates/divan_compat/examples/benches/math.rs::fibonacci

31 ns31 ns

recursive_memoized[BTreeMap<u64, u64>, 0]

crates/divan_compat/examples/benches/math.rs::fibonacci

14 ns14 ns

find_highest_set_bit[42]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

div

crates/divan_compat/examples/benches/math.rs

3 ns3 ns

system_time

crates/divan_compat/examples/benches/time.rs::duration_since

13 ns13 ns

recursive[10]

crates/divan_compat/examples/benches/math.rs::fibonacci

391 ns391 ns

subset_sum[18]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

4 µs4 µs

bench_array2[42]

crates/divan_compat/benches/basic_example.rs::const_bench

51 ns51 ns

bench_array1[1]

crates/divan_compat/benches/basic_example.rs::const_bench

2 ns2 ns

init_array[42]

crates/divan_compat/benches/basic_example.rs::const_bench

51 ns51 ns

bench_array1[42]

crates/divan_compat/benches/basic_example.rs::const_bench

51 ns51 ns

bench_array2[1]

crates/divan_compat/benches/basic_example.rs::const_bench

2 ns2 ns

bench_array2[4]

crates/divan_compat/benches/basic_example.rs::const_bench

3 ns3 ns

bench_array1[10]

crates/divan_compat/benches/basic_example.rs::const_bench

10 ns10 ns

bench_array2[10]

crates/divan_compat/benches/basic_example.rs::const_bench

10 ns10 ns

fibo_10

crates/divan_compat/benches/basic_example.rs

2 ns2 ns

mut_borrow

crates/divan_compat/benches/basic_example.rs

7 ns7 ns

bench_array1[4]

crates/divan_compat/benches/basic_example.rs::const_bench

3 ns3 ns

init_array[4]

crates/divan_compat/benches/basic_example.rs::const_bench

3 ns3 ns

fibo_50

crates/divan_compat/benches/basic_example.rs

2 ns2 ns

sleep_100ms

crates/divan_compat/benches/sleep_benches.rs

100.1 ms100.1 ms

sort_unstable

crates/divan_compat/examples/benches/sort.rs::sorted

130.5 µs130.5 µs

sleep_100ms_with_custom_sample

crates/divan_compat/benches/sleep_benches.rs

100.1 ms100.1 ms

generate_parentheses[3]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

2.3 µs2.3 µs

knight_tour[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

249.4 ms249.6 ms

knight_tour[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

8.6 ms8.6 ms

sort

crates/divan_compat/examples/benches/sort.rs::random

4.9 ms4.9 ms

generate_parentheses[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

6.8 µs6.8 µs

generate_gray_code[2]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

236 ns237 ns

recursive_memoized[BTreeMap<u64, u64>, 30]

crates/divan_compat/examples/benches/math.rs::fibonacci

2.8 µs2.8 µs

generate_combinations[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

2 µs2 µs

init_array[1000]

crates/divan_compat/benches/basic_example.rs::const_bench

-1%

1.7 µs1.7 µs

recursive_memoized[HashMap<u64, u64>, 10]

crates/divan_compat/examples/benches/math.rs::fibonacci

-1%

1.5 µs1.6 µs

n_queens_solver[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

23.1 µs23.3 µs

rat_in_maze[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

704 ns710 ns

hamiltonian_cycle[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

789 ns797 ns

n_queens_solver[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

9 µs9.1 µs

graph_coloring[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

1.2 µs1.2 µs

generate_gray_code[5]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

-2%

1.8 µs1.9 µs

graph_coloring[3]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

1.2 µs1.2 µs

hamiltonian_cycle[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

645 ns659 ns

Commits

Click on a commit to change the comparison range

Base

main

b71c93b

-71.79%

feat: change default profile from release to bench for build command Change cargo codspeed build to default to --profile bench instead of --profile release to align with cargo bench behavior and allow users to leverage bench profile customizations. Fixes COD-393 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>

087f25d

4 months ago

by art049

Home Terms Privacy Docs