cod-1187-cargo-codspeed-not-building-properly-with-304-on-swc - Branch - CodSpeedHQ/codspeed-rust

fix: regression for handling rustflags from .cargo/config.toml

#114Merged

Comparing

cod-1187-cargo-codspeed-not-building-properly-with-304-on-swc

(

88f18b7

) with

main

(

2d80483

)

-59%

Improvements: 14

Regressions: 10

Untouched: 139

This report only contains results for the Wall Time instrument. To view results for the CPU Simulation instrument, click here.

Benchmarks

Failed

from_elem[16384]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

Regression

-3%

836 ns863 ns

large_setup

crates/criterion_compat/benches/criterion_integration/iter_with_large_setup.rs::benches::large_setup::iter_with_large_setup

Regression

-13%

13 ns15 ns

from_elem[8192]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

Regression

-3%

494 ns510 ns

large_drop

crates/criterion_compat/benches/criterion_integration/iter_with_large_drop.rs::benches::large_drop::iter_with_large_drop

Regression

-11%

166.6 µs188.1 µs

system_time

crates/divan_compat/examples/benches/time.rs::duration_since

Regression

-8%

12 ns13 ns

hamiltonian_cycle[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

Regression

-4%

636 ns662 ns

sleep_1ns

crates/divan_compat/examples/benches/time_scale.rs

Regression

-6%

54.4 µs57.6 µs

instant

crates/divan_compat/examples/benches/time.rs::duration_since

Regression

-9%

10 ns11 ns

sleep_100ns

crates/divan_compat/examples/benches/time_scale.rs

Regression

-59%

24 µs57.8 µs

system_time

crates/divan_compat/examples/benches/time.rs::now

Regression

-5%

38 ns40 ns

Improved

add_two_integers[(42, 13)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

×3.3

20 ns6 ns

add_two_integers[(255, 255)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

×3.3

20 ns6 ns

sleep_1us

crates/divan_compat/examples/benches/time_scale.rs

+34%

29.3 µs21.8 µs

sleep_100us

crates/divan_compat/examples/benches/time_scale.rs

+12%

126.5 µs113.1 µs

bench_array1[10]

crates/divan_compat/benches/basic_example.rs::const_bench

+11%

10 ns9 ns

bench_array2[10]

crates/divan_compat/benches/basic_example.rs::const_bench

+11%

10 ns9 ns

recursive_memoized[HashMap<u64, u64>, 5]

crates/divan_compat/examples/benches/math.rs::fibonacci

+9%

627 ns573 ns

recursive_memoized[BTreeMap<u64, u64>, 5]

crates/divan_compat/examples/benches/math.rs::fibonacci

+8%

214 ns199 ns

recursive_memoized[BTreeMap<u64, u64>, 20]

crates/divan_compat/examples/benches/math.rs::fibonacci

+6%

1.9 µs1.8 µs

graph_coloring[3]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+5%

1.2 µs1.1 µs

recursive_memoized[HashMap<u64, u64>, 10]

crates/divan_compat/examples/benches/math.rs::fibonacci

+5%

1.6 µs1.5 µs

permutations[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+5%

14 µs13.4 µs

recursive_memoized[BTreeMap<u64, u64>, 30]

crates/divan_compat/examples/benches/math.rs::fibonacci

+4%

3.1 µs3 µs

from_elem[4096]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

+3%

332 ns321 ns

Passed

recursive_memoized[HashMap<u64, u64>, 20]

crates/divan_compat/examples/benches/math.rs::fibonacci

+3%

3.4 µs3.3 µs

from_elem_decimal[2048]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

+2%

254 ns248 ns

Recursive[20]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

47.2 µs47 µs

Recursive

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis::Fibonacci

47 µs47 µs

Recursive[21]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

76 µs76 µs

sleep_1ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

1.1 ms1.1 ms

sleep_50ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

50.1 ms50.1 ms

sleep_100ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

100.1 ms100.1 ms

sleep_10ms

crates/criterion_compat/benches/criterion_integration/sleep.rs::benches::sleep_benchmarks

10.1 ms10.1 ms

Auto

crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode

3 ns3 ns

from_elem_decimal[1024]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

81 ns81 ns

small_setup

crates/criterion_compat/benches/criterion_integration/iter_with_large_setup.rs::benches::small_setup::iter_with_large_setup

1 ns1 ns

Flat

crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode

10.1 ms10.1 ms

iter_batched_ref_large_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

Iterative

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis::Fibonacci

20 ns20 ns

Linear

crates/criterion_compat/benches/criterion_integration/sampling_mode.rs::benches::sampling_mode_tests::sampling_mode

3 ns3 ns

Iterative[21]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

21 ns21 ns

sum_fold

crates/criterion_compat/benches/criterion_example.rs::benches::a

304 ns304 ns

iter_batched_ref_per_iteration

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

40 ns40 ns

from_elem[2048]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

-2%

251 ns255 ns

build_vec

crates/criterion_compat/benches/criterion_example.rs::benches::b

-2%

200 ns204 ns

small_drop

crates/criterion_compat/benches/criterion_integration/iter_with_large_drop.rs::benches::small_drop::iter_with_large_drop

N/A

< 1 ns< 1 ns

bench_explicit_measurement

crates/criterion_compat/benches/test_benches.rs::benches::bench_using_group_with_explicit_measurement::group

N/A

< 1 ns< 1 ns

iter_batched_small_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

fibonacci_custom_measurement

crates/criterion_compat/benches/criterion_integration/custom_measurement.rs::benches::fibonacci_cycles

421 ns421 ns

iter_with_setup

crates/criterion_compat/benches/criterion_integration/iter_with_setup.rs::benches::setup

-3%

38 ns39 ns

iter_batched_large_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

"*benchmark/" '

crates/criterion_compat/benches/criterion_integration/special_characters.rs::benches::some_benchmark::"*group/"

N/A

< 1 ns< 1 ns

iter

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

from_elem[1024]

crates/criterion_compat/benches/criterion_integration/with_inputs.rs::benches::from_elem

81 ns81 ns

with_input[5]

crates/criterion_compat/benches/test_benches.rs::benches::bench_with_explicit_lifetime

N/A

< 1 ns< 1 ns

iter_with_large_setup

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

with_input[5]

crates/criterion_compat/benches/test_benches.rs::benches::bench

N/A

< 1 ns< 1 ns

with_input[5]

crates/criterion_compat/benches/test_benches.rs::benches::nested::bench

N/A

< 1 ns< 1 ns

iter_with_large_drop

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

recursive_memoized[BTreeMap<u64, u64>, 10]

crates/divan_compat/examples/benches/math.rs::fibonacci

+2%

575 ns561 ns

recursive[10]

crates/divan_compat/examples/benches/math.rs::fibonacci

+2%

391 ns384 ns

generate_gray_code[2]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

+1%

270 ns267 ns

hamiltonian_cycle[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+1%

582 ns578 ns

sudoku

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

111.8 µs111.7 µs

permutations[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

759.4 µs758.9 µs

Iterative[20]

crates/criterion_compat/benches/criterion_integration/compare_functions.rs::fibonaccis::compare_fibonaccis_group::Fibonacci3

20 ns20 ns

iter_with_setup

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

40 ns40 ns

graph_coloring[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

1 µs1 µs

recursive_memoized[HashMap<u64, u64>, 0]

crates/divan_compat/examples/benches/math.rs::fibonacci

16 ns16 ns

tsc (aarch64)

crates/divan_compat/examples/benches/time.rs::now

3 ns3 ns

recursive_memoized[BTreeMap<u64, u64>, 0]

crates/divan_compat/examples/benches/math.rs::fibonacci

14 ns14 ns

add_two_integers[(0, 0)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

count_set_bits[42]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

8 ns8 ns

find_highest_set_bit[1024]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

count_set_bits[0]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

8 ns8 ns

iterative[5]

crates/divan_compat/examples/benches/math.rs::fibonacci

7 ns7 ns

sort_unstable

crates/divan_compat/examples/benches/sort.rs::random

3.3 ms3.3 ms

iter_batched_per_iteration

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

-3%

39 ns40 ns

iter_batched_ref_small_input

crates/criterion_compat/benches/criterion_integration/measurement_overhead.rs::benches::some_benchmark::overhead

N/A

< 1 ns< 1 ns

count_set_bits[255]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

8 ns8 ns

find_highest_set_bit[0]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

count_set_bits[1024]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

8 ns8 ns

knight_tour[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

245.5 ms245.8 ms

knight_tour[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

290.7 ms291.1 ms

generate_parentheses[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

68.2 µs68.4 µs

subset_sum[10]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

992 ns995 ns

n_queens_solver[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

493.7 µs496 µs

graph_coloring[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

971 ns977 ns

generate_combinations[9]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

4.2 µs4.3 µs

print_env_hello

crates/divan_compat/examples/benches/env.rs

-1%

2 µs2 µs

rat_in_maze[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

926 ns938 ns

rat_in_maze[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

809 ns821 ns

hamiltonian_cycle[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

788 ns803 ns

tsc (aarch64)

crates/divan_compat/examples/benches/time.rs::duration_since

N/A

< 1 ns< 1 ns

hamiltonian_cycle[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+2%

758 ns740 ns

bench_array1[42]

crates/divan_compat/benches/basic_example.rs::const_bench

+2%

51 ns50 ns

bench_array2[42]

crates/divan_compat/benches/basic_example.rs::const_bench

+2%

51 ns50 ns

init_array[42]

crates/divan_compat/benches/basic_example.rs::const_bench

+2%

51 ns50 ns

n_queens_solver[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

+2%

20.1 µs19.8 µs

init_array[1000]

crates/divan_compat/benches/basic_example.rs::const_bench

+1%

1.7 µs1.7 µs

recursive[20]

crates/divan_compat/examples/benches/math.rs::fibonacci

+1%

47.6 µs47.3 µs

recursive_memoized[HashMap<u64, u64>, 30]

crates/divan_compat/examples/benches/math.rs::fibonacci

+1%

5.8 µs5.7 µs

generate_gray_code[4]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

+1%

1 µs1 µs

permutations[3]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

704 ns701 ns

permutations[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

65.6 µs65.4 µs

n_queens_solver[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

117.2 µs117 µs

generate_parentheses[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

21.8 µs21.7 µs

recursive[30]

crates/divan_compat/examples/benches/math.rs::fibonacci

5.8 ms5.8 ms

sleep_10ms

crates/divan_compat/benches/sleep_benches.rs

10.1 ms10.1 ms

sleep_100ms_with_custom_sample

crates/divan_compat/benches/sleep_benches.rs

100.1 ms100.1 ms

sort_unstable

crates/divan_compat/examples/benches/sort.rs::sorted

109.7 µs109.7 µs

sleep_100ms

crates/divan_compat/benches/sleep_benches.rs

100.1 ms100.1 ms

count_set_bits[65535]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

8 ns8 ns

recursive[0]

crates/divan_compat/examples/benches/math.rs::fibonacci

1 ns1 ns

n_queens_solver[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

1.5 µs1.5 µs

subset_sum[18]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

4.1 µs4.1 µs

generate_parentheses[3]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

2.3 µs2.3 µs

iterative[0]

crates/divan_compat/examples/benches/math.rs::fibonacci

1 ns1 ns

add

crates/divan_compat/examples/benches/math.rs

2 ns2 ns

mul

crates/divan_compat/examples/benches/math.rs

2 ns2 ns

iterative[10]

crates/divan_compat/examples/benches/math.rs::fibonacci

16 ns16 ns

add_two_integers[(65535, -65535)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

75 ns75 ns

div

crates/divan_compat/examples/benches/math.rs

3 ns3 ns

find_highest_set_bit[42]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

subset_sum[14]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

2 µs2 µs

find_highest_set_bit[255]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

recursive[5]

crates/divan_compat/examples/benches/math.rs::fibonacci

31 ns31 ns

iterative[30]

crates/divan_compat/examples/benches/math.rs::fibonacci

50 ns50 ns

iterative[20]

crates/divan_compat/examples/benches/math.rs::fibonacci

39 ns39 ns

find_highest_set_bit[65535]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

5 ns5 ns

add_two_integers[(1024, -1024)]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

66 ns66 ns

rem

crates/divan_compat/examples/benches/math.rs

3 ns3 ns

bench_array1[1]

crates/divan_compat/benches/basic_example.rs::const_bench

2 ns2 ns

fibo_10

crates/divan_compat/benches/basic_example.rs

2 ns2 ns

fibo_50

crates/divan_compat/benches/basic_example.rs

2 ns2 ns

bench_array2[4]

crates/divan_compat/benches/basic_example.rs::const_bench

3 ns3 ns

init_array[4]

crates/divan_compat/benches/basic_example.rs::const_bench

3 ns3 ns

bench_array2[1]

crates/divan_compat/benches/basic_example.rs::const_bench

2 ns2 ns

bench_array1[4]

crates/divan_compat/benches/basic_example.rs::const_bench

3 ns3 ns

mut_borrow

crates/divan_compat/benches/basic_example.rs

7 ns7 ns

sleep_50ms

crates/divan_compat/benches/sleep_benches.rs

50.1 ms50.1 ms

sort

crates/divan_compat/examples/benches/sort.rs::sorted

137.4 µs137.4 µs

sleep_1ms

crates/divan_compat/examples/benches/time_scale.rs

1.1 ms1.1 ms

sleep_1ms

crates/divan_compat/benches/sleep_benches.rs

1.1 ms1.1 ms

knight_tour[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

8.5 ms8.5 ms

generate_gray_code[3]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

521 ns522 ns

knight_tour[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

293.3 µs293.9 µs

sort

crates/divan_compat/examples/benches/sort.rs::random

4.9 ms4.9 ms

generate_parentheses[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

6.8 µs6.9 µs

generate_gray_code[5]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

-1%

2.1 µs2.1 µs

n_queens_solver[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

7.2 µs7.2 µs

generate_gray_code[1]

crates/divan_compat/examples/benches/the_algorithms.rs::bit_manipulation

-1%

145 ns146 ns

rat_in_maze[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

713 ns719 ns

permutations[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

2.3 µs2.3 µs

graph_coloring[4]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

896 ns908 ns

generate_combinations[6]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-1%

1.3 µs1.3 µs

generate_combinations[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

779 ns791 ns

generate_combinations[7]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

2 µs2 µs

generate_combinations[8]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

4.2 µs4.3 µs

rat_in_maze[5]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

591 ns605 ns

subset_sum[16]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-2%

4 µs4.1 µs

instant

crates/divan_compat/examples/benches/time.rs::now

-3%

38 ns39 ns

subset_sum[12]

crates/divan_compat/examples/benches/the_algorithms.rs::backtracking

-3%

1.9 µs2 µs

Commits

Click on a commit to change the comparison range

Base

main

2d80483

-58.52%

fix(cargo-codspeed): use target.rustflags config so it's merged with the .cargo/config.toml When using build.rustflags, it won't be merged because it has a lower precedence. See: https://doc.rust-lang.org/nightly/cargo/reference/config.html#buildrustflags

88f18b7

3 months ago

by not-matthias

Home Terms Privacy Docs