Avatar for the cpp-linter user
cpp-linter
cpp-linter-hooks
BlogDocsChangelog

fix: make benchmark tests resilient to CodSpeed's repeated test body execution

#210Merged
Comparing
copilot/fix-issue-from-main-branch
(
c792a06
) with
main
(
0d4c4db
)
CodSpeed Performance Gauge
0%
Untouched
63
New
25
Skipped
13

Benchmarks

101 total
test_clang_format_style_from_file_with_version[22]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.1 ms
test_clang_format_style_from_file_with_version[21]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.1 ms
test_clang_format_style_preset_is_idempotent[Chromium]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.4 ms
test_clang_format_style_preset_is_idempotent[LLVM]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.4 ms
test_clang_format_style_preset_is_idempotent[WebKit]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.4 ms
test_clang_format_style_preset_is_idempotent[Google]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.4 ms
test_clang_format_style_from_file_with_version[16]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.1 ms
test_clang_format_google_style_matches_good_c
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A809.3 µs
test_clang_format_style_from_file_reformats
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A812.5 µs
test_clang_format_style_from_file_with_version[19]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.1 ms
test_clang_format_style_preset_is_idempotent[Microsoft]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.4 ms
test_clang_format_style_preset_is_idempotent[Mozilla]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.4 ms
test_clang_format_style_preset_reformats_unformatted_file[Google]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A810.8 µs
test_clang_format_style_preset_reformats_unformatted_file[LLVM]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A813.2 µs
test_clang_format_style_preset_reformats_unformatted_file[Chromium]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A810.8 µs
test_clang_format_style_from_file_with_version[20]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.1 ms
test_clang_format_style_from_file_is_idempotent
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.3 ms
test_clang_format_style_from_file_with_version[18]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.1 ms
test_clang_format_style_from_file_with_version[17]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A1.1 ms
test_clang_format_style_preset_reformats_unformatted_file[Microsoft]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A810.3 µs
test_clang_format_verbose_flag_succeeds[--verbose]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A854.8 µs
test_clang_format_style_preset_reformats_unformatted_file[Mozilla]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A809.1 µs
test_clang_tidy_parallel_execution_completes
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A2 ms
test_clang_format_style_preset_reformats_unformatted_file[WebKit]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A813.7 µs
test_clang_format_verbose_flag_succeeds[-v]
tests/test_integration.py
CodSpeed Performance Gauge
N/A
N/A852.6 µs

Commits

Click on a commit to change the comparison range
Base
main
0d4c4db
-0.11%
fix: use absolute TESTING_DIR and reset file in benchmark tests
4e54e3c
20 hours ago
by Copilot
+0.04%
fix: apply ruff-format to long assertion line in test_integration.py
c792a06
13 hours ago
by Copilot
© 2026 CodSpeed Technology
Home Terms Privacy Docs