Avatar for the CodSpeedHQ user
CodSpeedHQ
pytest-codspeed
Instrumentation
Wall Time
BlogDocsChangelog

Support pytest-benchmark marker attributes

#80Merged
Comparing
cod-949-support-pytest-benchmark-marker-attributes
(
22d4d33
) with
master
(
7583000
)
CodSpeed Performance Gauge
0%
Improvements
0
Regressions
0
Untouched
57
New
0
Dropped
0
Ignored
53

Benchmarks

Passed

test_generate_parenthesis[3]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_parenthesis[3]
CodSpeed Performance Gauge
0%
41.5 µs
41.3 µs
test_make_highshelf
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_highshelf
CodSpeed Performance Gauge
0%
42.7 µs
42.6 µs
test_sudoku[initial_grid0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_sudoku[initial_grid0]
CodSpeed Performance Gauge
0%
34.4 µs
34.3 µs
test_recursive_cached_fibo_100
tests/benchmarks/test_bench_fibo.py::test_recursive_cached_fibo_100
CodSpeed Performance Gauge
0%
202.5 µs
202.1 µs
test_match_word_pattern[aba-GraphTreesGraph]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_match_word_pattern[aba-GraphTreesGraph]
CodSpeed Performance Gauge
0%
193.7 µs
193.4 µs
test_generate_all_permutations[sequence0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_permutations[sequence0]
CodSpeed Performance Gauge
0%
105.2 µs
105.1 µs
test_solve_power_sum[13-2]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_solve_power_sum[13-2]
CodSpeed Performance Gauge
0%
32.5 µs
32.5 µs
test_word_exists[board0-ABCCED]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_word_exists[board0-ABCCED]
CodSpeed Performance Gauge
0%
64.2 µs
64.2 µs
test_generate_all_subsequences[sequence0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_subsequences[sequence0]
CodSpeed Performance Gauge
0%
94.7 µs
94.7 µs
test_sum_squares_slow
tests/benchmarks/test_bench_doc.py::test_sum_squares_slow
CodSpeed Performance Gauge
0%
646.3 µs
646.3 µs
test_iir_filter_set_coefficients[a_coeffs0-b_coeffs0]
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_iir_filter_set_coefficients[a_coeffs0-b_coeffs0]
CodSpeed Performance Gauge
0%
16.1 µs
16.1 µs
test_combination_lists[0-0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_lists[0-0]
CodSpeed Performance Gauge
0%
23.2 µs
23.2 µs
test_count_even[count_even_slow]
tests/benchmarks/test_bench_misc.py::test_count_even[count_even_slow]
CodSpeed Performance Gauge
0%
3.1 ms
3.1 ms
test_recursive_fibo_20
tests/benchmarks/test_bench_fibo.py::test_recursive_fibo_20
CodSpeed Performance Gauge
0%
10.1 ms
10.1 ms
test_make_bandpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_bandpass
CodSpeed Performance Gauge
0%
37.4 µs
37.4 µs
test_count_even[count_even_fast]
tests/benchmarks/test_bench_misc.py::test_count_even[count_even_fast]
CodSpeed Performance Gauge
0%
3 ms
3 ms
test_solve_crossword[puzzle0-words0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_solve_crossword[puzzle0-words0]
CodSpeed Performance Gauge
0%
21.9 µs
21.9 µs
test_make_highpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_highpass
CodSpeed Performance Gauge
0%
38.8 µs
38.8 µs
test_sum_of_squares[sum_of_squares_for_loop_power]
tests/benchmarks/test_bench_misc.py::test_sum_of_squares[sum_of_squares_for_loop_power]
CodSpeed Performance Gauge
0%
518.6 µs
518.6 µs
test_sum_of_squares[sum_of_squares_sum_comprehension_power]
tests/benchmarks/test_bench_misc.py::test_sum_of_squares[sum_of_squares_sum_comprehension_power]
CodSpeed Performance Gauge
0%
537.4 µs
537.4 µs
test_sum_of_squares[sum_of_squares_sum_labmda_power]
tests/benchmarks/test_bench_misc.py::test_sum_of_squares[sum_of_squares_sum_labmda_power]
CodSpeed Performance Gauge
0%
648.4 µs
648.5 µs
test_n_queens_solve[board0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_n_queens_solve[board0]
CodSpeed Performance Gauge
0%
3.8 ms
3.8 ms
test_sum_squares_fast
tests/benchmarks/test_bench_doc.py::test_sum_squares_fast
CodSpeed Performance Gauge
0%
450.3 µs
450.4 µs
test_sum_of_squares[sum_of_squares_sum_labmda_product]
tests/benchmarks/test_bench_misc.py::test_sum_of_squares[sum_of_squares_sum_labmda_product]
CodSpeed Performance Gauge
0%
581.2 µs
581.5 µs
test_sum_of_squares[sum_of_squares_sum_comprehension_product]
tests/benchmarks/test_bench_misc.py::test_sum_of_squares[sum_of_squares_sum_comprehension_product]
CodSpeed Performance Gauge
0%
472 µs
472.3 µs
test_sum_of_squares[sum_of_squares_for_loop_product]
tests/benchmarks/test_bench_misc.py::test_sum_of_squares[sum_of_squares_for_loop_product]
CodSpeed Performance Gauge
0%
452.5 µs
452.9 µs
test_make_peak
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_peak
CodSpeed Performance Gauge
0%
40.7 µs
40.7 µs
test_generate_all_subsequences[sequence1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_subsequences[sequence1]
CodSpeed Performance Gauge
0%
62.9 µs
62.9 µs
test_make_allpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_allpass
CodSpeed Performance Gauge
0%
37 µs
37.1 µs
test_get_valid_pos[pos0-4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_get_valid_pos[pos0-4]
CodSpeed Performance Gauge
0%
25.5 µs
25.5 µs
test_recursive_fibo_10
tests/benchmarks/test_bench_fibo.py::test_recursive_fibo_10
CodSpeed Performance Gauge
0%
101 µs
101.1 µs
test_generate_sum_of_subsets_soln[nums0-9]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_sum_of_subsets_soln[nums0-9]
CodSpeed Performance Gauge
0%
72.7 µs
72.8 µs
test_is_safe[board0-1-1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_is_safe[board0-1-1]
CodSpeed Performance Gauge
0%
42.6 µs
42.7 µs
test_make_lowshelf
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_lowshelf
CodSpeed Performance Gauge
0%
42.8 µs
42.9 µs
test_minimax[scores0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_minimax[scores0]
CodSpeed Performance Gauge
0%
39.6 µs
39.7 µs
test_combination_lists[5-4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_lists[5-4]
CodSpeed Performance Gauge
0%
28.2 µs
28.2 µs
test_open_knight_tour[1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_open_knight_tour[1]
CodSpeed Performance Gauge
0%
33.5 µs
33.6 µs
test_is_complete[board0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_is_complete[board0]
CodSpeed Performance Gauge
0%
23.7 µs
23.8 µs
test_generate_all_permutations[sequence1]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_permutations[sequence1]
CodSpeed Performance Gauge
0%
104.5 µs
104.8 µs
test_hamilton_cycle[graph0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_hamilton_cycle[graph0]
CodSpeed Performance Gauge
0%
79.4 µs
79.7 µs
test_combination_lists[4-2]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_lists[4-2]
CodSpeed Performance Gauge
0%
30.3 µs
30.4 µs
test_solve_maze[maze0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_solve_maze[maze0]
CodSpeed Performance Gauge
0%
68 µs
68.3 µs
test_color[graph0-3]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_color[graph0-3]
CodSpeed Performance Gauge
0%
81.4 µs
81.6 µs
test_generate_all_combinations[0-0]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_combinations[0-0]
CodSpeed Performance Gauge
0%
18.7 µs
18.8 µs
test_iir_filter_process
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_iir_filter_process
CodSpeed Performance Gauge
0%
31.9 µs
32 µs
test_noop_lambda_decorated
tests/benchmarks/test_bench_various_noop.py::test_noop_lambda_decorated
CodSpeed Performance Gauge
0%
19.2 µs
19.3 µs
test_generate_all_combinations[4-2]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_combinations[4-2]
CodSpeed Performance Gauge
0%
36.5 µs
36.7 µs
test_combination_sum[candidates0-8]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_combination_sum[candidates0-8]
CodSpeed Performance Gauge
-1%
43.3 µs
43.6 µs
test_noop_ellipsis_decorated
tests/benchmarks/test_bench_various_noop.py::test_noop_ellipsis_decorated
CodSpeed Performance Gauge
-1%
14.6 µs
14.6 µs
test_generate_all_combinations[5-4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_generate_all_combinations[5-4]
CodSpeed Performance Gauge
-1%
42.3 µs
42.6 µs
test_recursive_cached_fibo_10
tests/benchmarks/test_bench_fibo.py::test_recursive_cached_fibo_10
CodSpeed Performance Gauge
-1%
40.9 µs
41.1 µs
test_noop_lambda
tests/benchmarks/test_bench_various_noop.py::test_noop_lambda
CodSpeed Performance Gauge
-1%
17.6 µs
17.8 µs
test_iterative_fibo_10
tests/benchmarks/test_bench_fibo.py::test_iterative_fibo_10
CodSpeed Performance Gauge
-1%
21.4 µs
21.6 µs
test_noop_pass
tests/benchmarks/test_bench_various_noop.py::test_noop_pass
CodSpeed Performance Gauge
-1%
12.7 µs
12.9 µs
test_noop_pass_decorated
tests/benchmarks/test_bench_various_noop.py::test_noop_pass_decorated
CodSpeed Performance Gauge
-1%
14.7 µs
14.9 µs
test_make_lowpass
tests/benchmarks/TheAlgorithms_bench/test_bench_audio_filters.py::test_make_lowpass
CodSpeed Performance Gauge
-2%
47.4 µs
48.3 µs
test_depth_first_search[4]
tests/benchmarks/TheAlgorithms_bench/test_bench_backtracking.py::test_depth_first_search[4]
CodSpeed Performance Gauge
-2%
84 µs
85.6 µs

Ignored

test_array_alloc[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[100000]
CodSpeed Performance Gauge
0%
432.1 µs
432.2 µs
test_array_alloc[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[10000]
CodSpeed Performance Gauge
0%
60.3 µs
60.4 µs
test_array_alloc[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[1000]
CodSpeed Performance Gauge
0%
23.6 µs
23.6 µs
test_array_alloc[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_array_alloc[100]
CodSpeed Performance Gauge
0%
18 µs
18.1 µs
test_dup_fdIgnored
tests/benchmarks/test_bench_syscalls.py::test_dup_fd
CodSpeed Performance Gauge
0%
23.3 µs
23.3 µs
test_fs_read[1000000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[1000000]
CodSpeed Performance Gauge
-1%
28.5 µs
28.7 µs
test_fs_read[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[100000]
CodSpeed Performance Gauge
-1%
29 µs
29.2 µs
test_fs_read[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[10000]
CodSpeed Performance Gauge
0%
29 µs
29.1 µs
test_fs_read[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[1000]
CodSpeed Performance Gauge
-2%
16.3 µs
16.5 µs
test_fs_read[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_read[100]
CodSpeed Performance Gauge
-1%
14.1 µs
14.2 µs
test_fs_write[1000000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[1000000]
CodSpeed Performance Gauge
0%
1.8 ms
1.8 ms
test_fs_write[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[100000]
CodSpeed Performance Gauge
0%
207.7 µs
207.8 µs
test_fs_write[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[10000]
CodSpeed Performance Gauge
0%
50.3 µs
50.5 µs
test_fs_write[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[1000]
CodSpeed Performance Gauge
0%
33.4 µs
33.4 µs
test_fs_write[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_fs_write[100]
CodSpeed Performance Gauge
-1%
30.9 µs
31.1 µs
test_hostname_resolution[1.1.1.1]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[1.1.1.1]
CodSpeed Performance Gauge
0%
39.5 µs
39.6 µs
test_hostname_resolution[127.0.0.1]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[127.0.0.1]
CodSpeed Performance Gauge
0%
39.8 µs
39.8 µs
test_hostname_resolution[8.8.8.8]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[8.8.8.8]
CodSpeed Performance Gauge
0%
39.4 µs
39.5 µs
test_hostname_resolution[amazon.com]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[amazon.com]
CodSpeed Performance Gauge
0%
90.2 µs
90.2 µs
test_hostname_resolution[google.com]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[google.com]
CodSpeed Performance Gauge
-37%
70.8 µs
111.9 µs
test_hostname_resolution[localhost]Ignored
tests/benchmarks/test_bench_syscalls.py::test_hostname_resolution[localhost]
CodSpeed Performance Gauge
0%
76.4 µs
76.4 µs
test_mmap_operation[409600]Ignored
tests/benchmarks/test_bench_syscalls.py::test_mmap_operation[409600]
CodSpeed Performance Gauge
0%
745.1 µs
745.3 µs
test_mmap_operation[40960]Ignored
tests/benchmarks/test_bench_syscalls.py::test_mmap_operation[40960]
CodSpeed Performance Gauge
0%
101.8 µs
101.9 µs
test_mmap_operation[4096]Ignored
tests/benchmarks/test_bench_syscalls.py::test_mmap_operation[4096]
CodSpeed Performance Gauge
-1%
36.6 µs
37 µs
test_multiprocessing_map[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[100000]
CodSpeed Performance Gauge
-11%
75.3 ms
84.6 ms
test_multiprocessing_map[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[10000]
CodSpeed Performance Gauge
+11%
12.5 ms
11.2 ms
test_multiprocessing_map[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[1000]
CodSpeed Performance Gauge
+12%
4.5 ms
4 ms
test_multiprocessing_map[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[100]
CodSpeed Performance Gauge
-23%
4.6 ms
5.9 ms
test_multiprocessing_map[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_multiprocessing_map[10]
CodSpeed Performance Gauge
+55%
5 ms
3.2 ms
test_open_close_fd[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_open_close_fd[1000]
CodSpeed Performance Gauge
0%
1.3 ms
1.3 ms
test_open_close_fd[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_open_close_fd[100]
CodSpeed Performance Gauge
0%
133.9 µs
133.8 µs
test_open_close_fd[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_open_close_fd[10]
CodSpeed Performance Gauge
-2%
36.8 µs
37.4 µs
test_pipe_communication[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[10000]
CodSpeed Performance Gauge
0%
41.7 µs
41.8 µs
test_pipe_communication[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[1000]
CodSpeed Performance Gauge
0%
41.7 µs
41.6 µs
test_pipe_communication[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[100]
CodSpeed Performance Gauge
0%
40.2 µs
40.1 µs
test_pipe_communication[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_pipe_communication[10]
CodSpeed Performance Gauge
0%
43.7 µs
43.6 µs
test_process_creation[cat /dev/null]Ignored
tests/benchmarks/test_bench_syscalls.py::test_process_creation[cat /dev/null]
CodSpeed Performance Gauge
0%
204.1 µs
203.1 µs
test_process_creation[echo hello]Ignored
tests/benchmarks/test_bench_syscalls.py::test_process_creation[echo hello]
CodSpeed Performance Gauge
0%
234.9 µs
234.6 µs
test_process_creation[ls -l]Ignored
tests/benchmarks/test_bench_syscalls.py::test_process_creation[ls -l]
CodSpeed Performance Gauge
0%
207 µs
206.7 µs
test_sleep[0.001]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.001]
CodSpeed Performance Gauge
-1%
13.8 µs
13.9 µs
test_sleep[0.01]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.01]
CodSpeed Performance Gauge
-1%
13.8 µs
13.9 µs
test_sleep[0.05]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.05]
CodSpeed Performance Gauge
0%
13.9 µs
13.9 µs
test_sleep[0.1]Ignored
tests/benchmarks/test_bench_syscalls.py::test_sleep[0.1]
CodSpeed Performance Gauge
0%
13.9 µs
13.9 µs
test_tcp_connection[1.1.1.1-53]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[1.1.1.1-53]
CodSpeed Performance Gauge
0%
33.7 µs
33.7 µs
test_tcp_connection[8.8.8.8-53]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[8.8.8.8-53]
CodSpeed Performance Gauge
0%
38.7 µs
38.7 µs
test_tcp_connection[google.com-443]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[google.com-443]
CodSpeed Performance Gauge
-39%
65.2 µs
106.9 µs
test_tcp_connection[wikipedia.org-443]Ignored
tests/benchmarks/test_bench_syscalls.py::test_tcp_connection[wikipedia.org-443]
CodSpeed Performance Gauge
0%
65.4 µs
65.3 µs
test_threadpool_map[100000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[100000]
CodSpeed Performance Gauge
0%
4.3 s
4.3 s
test_threadpool_map[10000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[10000]
CodSpeed Performance Gauge
0%
416.7 ms
417.7 ms
test_threadpool_map[1000]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[1000]
CodSpeed Performance Gauge
0%
40.9 ms
40.9 ms
test_threadpool_map[100]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[100]
CodSpeed Performance Gauge
0%
4.6 ms
4.6 ms
test_threadpool_map[10]Ignored
tests/benchmarks/test_bench_syscalls.py::test_threadpool_map[10]
CodSpeed Performance Gauge
-1%
812.6 µs
818.8 µs
test_noop_ellipsisIgnored
tests/benchmarks/test_bench_various_noop.py::test_noop_ellipsis
CodSpeed Performance Gauge
-1%
12.7 µs
12.8 µs

Commits

Click on a commit to change the comparison range
Base
master
7583000
0%
feat: support marker attributes to customize the walltime execution
22d4d33
11 days ago
by art049
© 2025 CodSpeed Technology
Home Terms Privacy Docs