Avatar for the cpp-linter user
cpp-linter
cpp-linter-hooks
BlogDocsChangelog

fix: make benchmark tests resilient to CodSpeed's repeated test body execution

#210Merged
Comparing
copilot/fix-issue-from-main-branch
(
c792a06
) with
main
(
0d4c4db
)
CodSpeed Performance Gauge
0%
Untouched
63
New
25
Skipped
13

Benchmarks

13 total
test_ensure_installed[clang-format-None]
tests/test_util.py
Skipped
1.3 ms*
test_ensure_installed[clang-format-20]
tests/test_util.py
Skipped
1.4 ms*
test_ensure_installed[clang-tidy-20]
tests/test_util.py
Skipped
1.2 ms*
test_ensure_installed[clang-tidy-None]
tests/test_util.py
Skipped
1.3 ms*
test_ensure_installed_no_runtime_version
tests/test_util.py
Skipped
852.9 µs*
test_ensure_installed_tool_not_found
tests/test_util.py
Skipped
1 ms*
test_get_runtime_version_exception
tests/test_util.py
Skipped
517.5 µs*
test_get_runtime_version_clang_tidy_single_line
tests/test_util.py
Skipped
508.3 µs*
test_get_runtime_version_clang_tidy
tests/test_util.py
Skipped
513.3 µs*
test_ensure_installed_version_mismatch
tests/test_util.py
Skipped
1.5 ms*
test_is_installed_not_found
tests/test_util.py
Skipped
540.5 µs*
test_get_runtime_version_clang_format
tests/test_util.py
Skipped
512.2 µs*
test_is_installed_with_shutil_which
tests/test_util.py
Skipped
602.7 µs*

Commits

Click on a commit to change the comparison range
Base
main
0d4c4db
-0.11%
fix: use absolute TESTING_DIR and reset file in benchmark tests
4e54e3c
20 hours ago
by Copilot
+0.04%
fix: apply ruff-format to long assertion line in test_integration.py
c792a06
13 hours ago
by Copilot
© 2026 CodSpeed Technology
Home Terms Privacy Docs