Avatar for the CodSpeedHQ user
CodSpeedHQ
pytest-codspeed
Instrumentation
Wall Time
BlogDocsChangelog

fix: use proper iterations times and fix round sizes

#67Merged
Comparing
cod-505-use-correct-timings-in-pytest-codspeed-walltime
(
4333c1f
) with
master
(
003c3b4
)
CodSpeed Performance Gauge
+3%
Improvements
1
Regressions
0
Untouched
46
New
0
Dropped
0
Ignored
53

Benchmarks

Improved

test_combination_lists[5-4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_lists[5-4]
CodSpeed Performance Gauge
+3%
28.7 µs
27.9 µs

Passed

test_make_lowpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_lowpass
CodSpeed Performance Gauge
+2%
47.3 µs
46.5 µs
test_noop_pass_decorated
tests/benchmarks/test_bench_various_noop.py::test_noop_pass_decorated
CodSpeed Performance Gauge
+1%
14.5 µs
14.4 µs
test_is_complete[board0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_is_complete[board0]
CodSpeed Performance Gauge
+1%
23.7 µs
23.5 µs
test_noop_pass
tests/benchmarks/test_bench_various_noop.py::test_noop_pass
CodSpeed Performance Gauge
+1%
12.3 µs
12.2 µs
test_iir_filter_set_coefficients[a_coeffs0-b_coeffs0]
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_iir_filter_set_coefficients[a_coeffs0-b_coeffs0]
CodSpeed Performance Gauge
+1%
15.7 µs
15.6 µs
test_get_valid_pos[pos0-4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_get_valid_pos[pos0-4]
CodSpeed Performance Gauge
+1%
25.1 µs
25 µs
test_solve_crossword[puzzle0-words0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_solve_crossword[puzzle0-words0]
CodSpeed Performance Gauge
+1%
21.9 µs
21.8 µs
test_generate_all_combinations[0-0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_combinations[0-0]
CodSpeed Performance Gauge
0%
18.3 µs
18.2 µs
test_combination_lists[4-2]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_lists[4-2]
CodSpeed Performance Gauge
0%
30.3 µs
30.1 µs
test_noop_ellipsis_decorated
tests/benchmarks/test_bench_various_noop.py::test_noop_ellipsis_decorated
CodSpeed Performance Gauge
0%
14.3 µs
14.2 µs
test_noop_lambda
tests/benchmarks/test_bench_various_noop.py::test_noop_lambda
CodSpeed Performance Gauge
0%
17.4 µs
17.3 µs
test_sudoku[initial_grid0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_sudoku[initial_grid0]
CodSpeed Performance Gauge
0%
34.2 µs
34 µs
test_make_peak
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_peak
CodSpeed Performance Gauge
0%
40.4 µs
40.2 µs
test_noop_lambda_decorated
tests/benchmarks/test_bench_various_noop.py::test_noop_lambda_decorated
CodSpeed Performance Gauge
0%
18.9 µs
18.9 µs
test_minimax[scores0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_minimax[scores0]
CodSpeed Performance Gauge
0%
39.3 µs
39.1 µs
test_make_bandpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_bandpass
CodSpeed Performance Gauge
0%
37.4 µs
37.3 µs
test_solve_power_sum[13-2]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_solve_power_sum[13-2]
CodSpeed Performance Gauge
0%
32.3 µs
32.2 µs
test_generate_all_subsequences[sequence0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_subsequences[sequence0]
CodSpeed Performance Gauge
0%
93.7 µs
93.5 µs
test_hamilton_cycle[graph0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_hamilton_cycle[graph0]
CodSpeed Performance Gauge
0%
79.6 µs
79.4 µs
test_combination_sum[candidates0-8]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_sum[candidates0-8]
CodSpeed Performance Gauge
0%
43.2 µs
43.1 µs
test_generate_all_subsequences[sequence1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_subsequences[sequence1]
CodSpeed Performance Gauge
0%
61.7 µs
61.6 µs
test_depth_first_search[4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_depth_first_search[4]
CodSpeed Performance Gauge
0%
83.3 µs
83.2 µs
test_make_lowshelf
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_lowshelf
CodSpeed Performance Gauge
0%
42.7 µs
42.7 µs
test_color[graph0-3]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_color[graph0-3]
CodSpeed Performance Gauge
0%
81.1 µs
80.9 µs
test_iterative_fibo_10
tests/benchmarks/test_bench_fibo.py::test_iterative_fibo_10
CodSpeed Performance Gauge
0%
21.2 µs
21.2 µs
test_combination_lists[0-0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_lists[0-0]
CodSpeed Performance Gauge
0%
23.1 µs
23.1 µs
test_solve_maze[maze0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_solve_maze[maze0]
CodSpeed Performance Gauge
0%
67.8 µs
67.7 µs
test_recursive_fibo_10
tests/benchmarks/test_bench_fibo.py::test_recursive_fibo_10
CodSpeed Performance Gauge
0%
100.8 µs
100.7 µs
test_make_highpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_highpass
CodSpeed Performance Gauge
0%
37.9 µs
37.9 µs
test_recursive_cached_fibo_10
tests/benchmarks/test_bench_fibo.py::test_recursive_cached_fibo_10
CodSpeed Performance Gauge
0%
40.4 µs
40.4 µs
test_make_highshelf
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_highshelf
CodSpeed Performance Gauge
0%
42.5 µs
42.5 µs
test_generate_all_permutations[sequence0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_permutations[sequence0]
CodSpeed Performance Gauge
0%
104 µs
103.9 µs
test_is_safe[board0-1-1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_is_safe[board0-1-1]
CodSpeed Performance Gauge
0%
42.5 µs
42.5 µs
test_match_word_pattern[aba-GraphTreesGraph]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_match_word_pattern[aba-GraphTreesGraph]
CodSpeed Performance Gauge
0%
193.5 µs
193.4 µs
test_generate_parenthesis[3]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_parenthesis[3]
CodSpeed Performance Gauge
0%
40.9 µs
40.9 µs
test_generate_all_combinations[5-4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_combinations[5-4]
CodSpeed Performance Gauge
0%
41.9 µs
41.9 µs
test_recursive_fibo_20
tests/benchmarks/test_bench_fibo.py::test_recursive_fibo_20
CodSpeed Performance Gauge
0%
10.2 ms
10.2 ms
test_iir_filter_process
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_iir_filter_process
CodSpeed Performance Gauge
0%
31.1 µs
31.1 µs
test_generate_all_permutations[sequence1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_permutations[sequence1]
CodSpeed Performance Gauge
0%
103.6 µs
103.6 µs
test_open_knight_tour[1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_open_knight_tour[1]
CodSpeed Performance Gauge
0%
33.1 µs
33.1 µs
test_n_queens_solve[board0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_n_queens_solve[board0]
CodSpeed Performance Gauge
0%
3.8 ms
3.8 ms
test_make_allpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_allpass
CodSpeed Performance Gauge
0%
36.6 µs
36.6 µs
test_word_exists[board0-ABCCED]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_word_exists[board0-ABCCED]
CodSpeed Performance Gauge
0%
63.8 µs
63.9 µs
test_generate_all_combinations[4-2]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_combinations[4-2]
CodSpeed Performance Gauge
0%
36.3 µs
36.3 µs
test_generate_sum_of_subsets_soln[nums0-9]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_sum_of_subsets_soln[nums0-9]
CodSpeed Performance Gauge
0%
72.1 µs
72.2 µs
test_recursive_cached_fibo_100
tests/benchmarks/test_bench_fibo.py::test_recursive_cached_fibo_100
CodSpeed Performance Gauge
-1%
199.9 µs
202 µs

Ignored

test_array_alloc[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[100000]
CodSpeed Performance Gauge
0%
431.6 µs
431.4 µs
test_array_alloc[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[10000]
CodSpeed Performance Gauge
0%
60 µs
59.7 µs
test_array_alloc[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[1000]
CodSpeed Performance Gauge
+1%
22.4 µs
22.2 µs
test_array_alloc[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[100]
CodSpeed Performance Gauge
0%
17.7 µs
17.6 µs
test_dup_fdIgnored
tests/benchmarks/test_bench_syscalls.py::test_dup_fd
CodSpeed Performance Gauge
0%
22.9 µs
22.8 µs
test_fs_read[1000000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[1000000]
CodSpeed Performance Gauge
+1%
28.2 µs
28 µs
test_fs_read[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[100000]
CodSpeed Performance Gauge
0%
28.7 µs
28.7 µs
test_fs_read[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[10000]
CodSpeed Performance Gauge
0%
28.7 µs
28.6 µs
test_fs_read[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[1000]
CodSpeed Performance Gauge
+1%
15.9 µs
15.8 µs
test_fs_read[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[100]
CodSpeed Performance Gauge
0%
13.8 µs
13.8 µs
test_fs_write[1000000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[1000000]
CodSpeed Performance Gauge
0%
1.8 ms
1.8 ms
test_fs_write[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[100000]
CodSpeed Performance Gauge
0%
208.5 µs
208.2 µs
test_fs_write[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[10000]
CodSpeed Performance Gauge
0%
50 µs
50.1 µs
test_fs_write[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[1000]
CodSpeed Performance Gauge
+1%
33 µs
32.8 µs
test_fs_write[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[100]
CodSpeed Performance Gauge
0%
30.7 µs
30.6 µs
test_hostname_resolution[1.1.1.1]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[1.1.1.1]
CodSpeed Performance Gauge
0%
39.6 µs
39.4 µs
test_hostname_resolution[127.0.0.1]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[127.0.0.1]
CodSpeed Performance Gauge
0%
39.7 µs
39.6 µs
test_hostname_resolution[8.8.8.8]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[8.8.8.8]
CodSpeed Performance Gauge
0%
39.6 µs
39.5 µs
test_hostname_resolution[amazon.com]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[amazon.com]
CodSpeed Performance Gauge
+1%
91.1 µs
90.1 µs
test_hostname_resolution[google.com]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[google.com]
CodSpeed Performance Gauge
+1%
71.3 µs
71 µs
test_hostname_resolution[localhost]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[localhost]
CodSpeed Performance Gauge
+1%
76.9 µs
76.3 µs
test_mmap_operation[409600]Ignored
tests/benchmarks/test_bench_syscalls.py::test_mmap_operation[409600]
CodSpeed Performance Gauge
0%
745 µs
744.9 µs
test_mmap_operation[40960]Ignored
tests/benchmarks/test_bench_syscalls.py::test_mmap_operation[40960]
CodSpeed Performance Gauge
0%
101.4 µs
101.5 µs
test_mmap_operation[4096]Ignored
tests/benchmarks/test_bench_syscalls.py::test_mmap_operation[4096]
CodSpeed Performance Gauge
0%
36.4 µs
36.3 µs
test_multiprocessing_map[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[100000]
CodSpeed Performance Gauge
+5%
91 ms
86.5 ms
test_multiprocessing_map[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[10000]
CodSpeed Performance Gauge
+22%
12.2 ms
10 ms
test_multiprocessing_map[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[1000]
CodSpeed Performance Gauge
+21%
5.7 ms
4.7 ms
test_multiprocessing_map[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[100]
CodSpeed Performance Gauge
+44%
5.5 ms
3.8 ms
test_multiprocessing_map[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[10]
CodSpeed Performance Gauge
-25%
2.4 ms
3.2 ms
test_open_close_fd[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_open_close_fd[1000]
CodSpeed Performance Gauge
-1%
1.3 ms
1.4 ms
test_open_close_fd[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_open_close_fd[100]
CodSpeed Performance Gauge
0%
133.5 µs
133.6 µs
test_open_close_fd[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_open_close_fd[10]
CodSpeed Performance Gauge
+2%
37.4 µs
36.6 µs
test_pipe_communication[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[10000]
CodSpeed Performance Gauge
+1%
41.7 µs
41.5 µs
test_pipe_communication[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[1000]
CodSpeed Performance Gauge
+1%
41.7 µs
41.5 µs
test_pipe_communication[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[100]
CodSpeed Performance Gauge
+1%
40.3 µs
40 µs
test_pipe_communication[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[10]
CodSpeed Performance Gauge
0%
43.8 µs
43.6 µs
test_process_creation[cat /dev/null]Ignored
tests/benchmarks/test_bench_syscalls.py::test_process_creation[cat /dev/null]
CodSpeed Performance Gauge
0%
203.3 µs
203.3 µs
test_process_creation[echo hello]Ignored
tests/benchmarks/test_bench_syscalls.py::test_process_creation[echo hello]
CodSpeed Performance Gauge
0%
234.5 µs
235.4 µs
test_process_creation[ls -l]Ignored
tests/benchmarks/test_bench_syscalls.py::test_process_creation[ls -l]
CodSpeed Performance Gauge
0%
206.1 µs
205.4 µs
test_sleep[0.001]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.001]
CodSpeed Performance Gauge
0%
13.5 µs
13.4 µs
test_sleep[0.01]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.01]
CodSpeed Performance Gauge
0%
13.4 µs
13.4 µs
test_sleep[0.05]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.05]
CodSpeed Performance Gauge
+1%
13.5 µs
13.4 µs
test_sleep[0.1]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.1]
CodSpeed Performance Gauge
+1%
13.5 µs
13.4 µs
test_tcp_connection[1.1.1.1-53]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[1.1.1.1-53]
CodSpeed Performance Gauge
0%
33.5 µs
33.6 µs
test_tcp_connection[8.8.8.8-53]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[8.8.8.8-53]
CodSpeed Performance Gauge
0%
38.7 µs
38.7 µs
test_tcp_connection[google.com-443]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[google.com-443]
CodSpeed Performance Gauge
0%
65.2 µs
65.3 µs
test_tcp_connection[wikipedia.org-443]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[wikipedia.org-443]
CodSpeed Performance Gauge
-1%
65.3 µs
65.6 µs
test_threadpool_map[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[100000]
CodSpeed Performance Gauge
0%
4.3 s
4.3 s
test_threadpool_map[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[10000]
CodSpeed Performance Gauge
0%
418.9 ms
418.6 ms
test_threadpool_map[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[1000]
CodSpeed Performance Gauge
0%
41.1 ms
41.1 ms
test_threadpool_map[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[100]
CodSpeed Performance Gauge
0%
4.6 ms
4.6 ms
test_threadpool_map[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[10]
CodSpeed Performance Gauge
+1%
817.6 µs
810.2 µs
test_noop_ellipsisIgnored
tests/benchmarks/test_bench_various_noop.py::test_noop_ellipsis
CodSpeed Performance Gauge
+1%
12.3 µs
12.2 µs

Commits

Click on a commit to change the comparison range
Base
master
003c3b4
+3%
refactor: replace hardcoded outlier factor for improved readability
4333c1f
8 days ago
by art049
© 2025 CodSpeed Technology
Home Terms PrivacyDocs