Avatar for the cpp-linter user
cpp-linter
cpp-linter-hooks
BlogDocsChangelog

Migration: From Clang Tools Binaries to Python Wheels

#87Merged
Comparing
v1
(
f34d1e5
) with
main
(
4c2dece
)
CodSpeed Performance Gauge
-79%
Improvements
2
Regressions
19
Untouched
8
New
39
Dropped
2
Ignored
0

Benchmarks

Failed

test_ensure_installed[clang-tidy-18]Missing
tests/test_util.py::test_ensure_installed[clang-tidy-18]
CodSpeed Performance Gauge
N/A
1.8 ms
N/A
test_ensure_installed[clang-format-18]Missing
tests/test_util.py::test_ensure_installed[clang-format-18]
CodSpeed Performance Gauge
N/A
1.8 ms
N/A
test_run_clang_format_dry_run[args0-1]Regression
tests/test_clang_format.py::test_run_clang_format_dry_run[args0-1]
CodSpeed Performance Gauge
-55%
1.1 ms
2.4 ms
test_run_clang_format_invalid[args0-1]Regression
tests/test_clang_format.py::test_run_clang_format_invalid[args0-1]
CodSpeed Performance Gauge
-55%
1.1 ms
2.4 ms
test_run_clang_format_invalid[args1-1]Regression
tests/test_clang_format.py::test_run_clang_format_invalid[args1-1]
CodSpeed Performance Gauge
-59%
1.1 ms
2.6 ms
test_run_clang_format_invalid[args2-1]Regression
tests/test_clang_format.py::test_run_clang_format_invalid[args2-1]
CodSpeed Performance Gauge
-59%
1.1 ms
2.6 ms
test_run_clang_format_invalid[args3-1]Regression
tests/test_clang_format.py::test_run_clang_format_invalid[args3-1]
CodSpeed Performance Gauge
-58%
1.1 ms
2.6 ms
test_run_clang_format_invalid[args4-1]Regression
tests/test_clang_format.py::test_run_clang_format_invalid[args4-1]
CodSpeed Performance Gauge
-79%
549.4 µs
2,560.3 µs
test_run_clang_format_invalid[args5-1]Regression
tests/test_clang_format.py::test_run_clang_format_invalid[args5-1]
CodSpeed Performance Gauge
-78%
549.5 µs
2,546.3 µs
test_run_clang_format_valid[args0-expected_retval0]Regression
tests/test_clang_format.py::test_run_clang_format_valid[args0-expected_retval0]
CodSpeed Performance Gauge
-51%
1.3 ms
2.6 ms
test_run_clang_format_valid[args1-expected_retval1]Regression
tests/test_clang_format.py::test_run_clang_format_valid[args1-expected_retval1]
CodSpeed Performance Gauge
-55%
1.2 ms
2.8 ms
test_run_clang_format_valid[args2-expected_retval2]Regression
tests/test_clang_format.py::test_run_clang_format_valid[args2-expected_retval2]
CodSpeed Performance Gauge
-55%
1.2 ms
2.8 ms
test_run_clang_format_valid[args3-expected_retval3]Regression
tests/test_clang_format.py::test_run_clang_format_valid[args3-expected_retval3]
CodSpeed Performance Gauge
-54%
1.2 ms
2.7 ms
test_run_clang_format_valid[args4-expected_retval4]Regression
tests/test_clang_format.py::test_run_clang_format_valid[args4-expected_retval4]
CodSpeed Performance Gauge
-74%
686.3 µs
2,676.8 µs
test_run_clang_format_valid[args5-expected_retval5]Regression
tests/test_clang_format.py::test_run_clang_format_valid[args5-expected_retval5]
CodSpeed Performance Gauge
-74%
687.6 µs
2,674.7 µs
test_run_clang_format_verboseRegression
tests/test_clang_format.py::test_run_clang_format_verbose
CodSpeed Performance Gauge
-50%
1.3 ms
2.5 ms
test_run_clang_format_verbose_errorRegression
tests/test_clang_format.py::test_run_clang_format_verbose_error
CodSpeed Performance Gauge
-52%
1.2 ms
2.5 ms
test_run_clang_tidy_invalid[args4-1]Regression
tests/test_clang_tidy.py::test_run_clang_tidy_invalid[args4-1]
CodSpeed Performance Gauge
-58%
461.1 µs
1,087.4 µs
test_run_clang_tidy_invalid[args5-1]Regression
tests/test_clang_tidy.py::test_run_clang_tidy_invalid[args5-1]
CodSpeed Performance Gauge
-58%
457.2 µs
1,080 µs
test_run_clang_tidy_valid[args4-1]Regression
tests/test_clang_tidy.py::test_run_clang_tidy_valid[args4-1]
CodSpeed Performance Gauge
-55%
520.7 µs
1,148.5 µs
test_run_clang_tidy_valid[args5-1]Regression
tests/test_clang_tidy.py::test_run_clang_tidy_valid[args5-1]
CodSpeed Performance Gauge
-54%
521.3 µs
1,142 µs

Improved

test_ensure_installed[clang-tidy-None]
tests/test_util.py::test_ensure_installed[clang-tidy-None]
CodSpeed Performance Gauge
+56%
1.8 ms
1.2 ms
test_ensure_installed[clang-format-None]
tests/test_util.py::test_ensure_installed[clang-format-None]
CodSpeed Performance Gauge
+55%
1.8 ms
1.2 ms

New

test_default_versions
tests/test_util.py::test_default_versions
CodSpeed Performance Gauge
N/A
N/A
84.1 µs
test_ensure_installed[clang-format-20]
tests/test_util.py::test_ensure_installed[clang-format-20]
CodSpeed Performance Gauge
N/A
N/A
2.9 ms
test_ensure_installed[clang-tidy-20]
tests/test_util.py::test_ensure_installed[clang-tidy-20]
CodSpeed Performance Gauge
N/A
N/A
1.5 ms
test_ensure_installed_no_runtime_version
tests/test_util.py::test_ensure_installed_no_runtime_version
CodSpeed Performance Gauge
N/A
N/A
2.4 ms
test_ensure_installed_tool_not_found
tests/test_util.py::test_ensure_installed_tool_not_found
CodSpeed Performance Gauge
N/A
N/A
1 ms
test_ensure_installed_version_mismatch
tests/test_util.py::test_ensure_installed_version_mismatch
CodSpeed Performance Gauge
N/A
N/A
3.1 ms
test_get_runtime_version_clang_format
tests/test_util.py::test_get_runtime_version_clang_format
CodSpeed Performance Gauge
N/A
N/A
513.4 µs
test_get_runtime_version_clang_tidy
tests/test_util.py::test_get_runtime_version_clang_tidy
CodSpeed Performance Gauge
N/A
N/A
515.3 µs
test_get_runtime_version_clang_tidy_single_line
tests/test_util.py::test_get_runtime_version_clang_tidy_single_line
CodSpeed Performance Gauge
N/A
N/A
509.5 µs
test_get_runtime_version_exception
tests/test_util.py::test_get_runtime_version_exception
CodSpeed Performance Gauge
N/A
N/A
517 µs
test_get_version_from_dependency_malformed_toml
tests/test_util.py::test_get_version_from_dependency_malformed_toml
CodSpeed Performance Gauge
N/A
N/A
1.3 ms
test_get_version_from_dependency_missing_dependency
tests/test_util.py::test_get_version_from_dependency_missing_dependency
CodSpeed Performance Gauge
N/A
N/A
1.3 ms
test_get_version_from_dependency_missing_file
tests/test_util.py::test_get_version_from_dependency_missing_file
CodSpeed Performance Gauge
N/A
N/A
950.8 µs
test_get_version_from_dependency_success
tests/test_util.py::test_get_version_from_dependency_success
CodSpeed Performance Gauge
N/A
N/A
1.4 ms
test_install_tool_failure
tests/test_util.py::test_install_tool_failure
CodSpeed Performance Gauge
N/A
N/A
1.4 ms
test_install_tool_success
tests/test_util.py::test_install_tool_success
CodSpeed Performance Gauge
N/A
N/A
1.1 ms
test_install_tool_success_but_not_found
tests/test_util.py::test_install_tool_success_but_not_found
CodSpeed Performance Gauge
N/A
N/A
1.1 ms
test_is_installed_not_found
tests/test_util.py::test_is_installed_not_found
CodSpeed Performance Gauge
N/A
N/A
539.9 µs
test_is_installed_with_shutil_which
tests/test_util.py::test_is_installed_with_shutil_which
CodSpeed Performance Gauge
N/A
N/A
603.6 µs
test_resolve_install_invalid_version
tests/test_util.py::test_resolve_install_invalid_version
CodSpeed Performance Gauge
N/A
N/A
937.5 µs
test_resolve_install_no_version_specified
tests/test_util.py::test_resolve_install_no_version_specified
CodSpeed Performance Gauge
N/A
N/A
932.2 µs
test_resolve_install_tool_already_installed_correct_version
tests/test_util.py::test_resolve_install_tool_already_installed_correct_version
CodSpeed Performance Gauge
N/A
N/A
2.5 ms
test_resolve_install_tool_not_installed
tests/test_util.py::test_resolve_install_tool_not_installed
CodSpeed Performance Gauge
N/A
N/A
2.5 ms
test_resolve_install_tool_version_mismatch
tests/test_util.py::test_resolve_install_tool_version_mismatch
CodSpeed Performance Gauge
N/A
N/A
3.6 ms
test_resolve_version_clang_format[18-18.1.8]
tests/test_util.py::test_resolve_version_clang_format[18-18.1.8]
CodSpeed Performance Gauge
N/A
N/A
1.8 ms
test_resolve_version_clang_format[18.1-18.1.8]
tests/test_util.py::test_resolve_version_clang_format[18.1-18.1.8]
CodSpeed Performance Gauge
N/A
N/A
2.1 ms
test_resolve_version_clang_format[20-20.1.7]
tests/test_util.py::test_resolve_version_clang_format[20-20.1.7]
CodSpeed Performance Gauge
N/A
N/A
1.8 ms
test_resolve_version_clang_format[20.1-20.1.7]
tests/test_util.py::test_resolve_version_clang_format[20.1-20.1.7]
CodSpeed Performance Gauge
N/A
N/A
2.1 ms
test_resolve_version_clang_format[20.1.7-20.1.7]
tests/test_util.py::test_resolve_version_clang_format[20.1.7-20.1.7]
CodSpeed Performance Gauge
N/A
N/A
1.7 ms
test_resolve_version_clang_format[20.99-None]
tests/test_util.py::test_resolve_version_clang_format[20.99-None]
CodSpeed Performance Gauge
N/A
N/A
2.1 ms
test_resolve_version_clang_format[99-None]
tests/test_util.py::test_resolve_version_clang_format[99-None]
CodSpeed Performance Gauge
N/A
N/A
1.8 ms
test_resolve_version_clang_format[None-None]
tests/test_util.py::test_resolve_version_clang_format[None-None]
CodSpeed Performance Gauge
N/A
N/A
86.6 µs
test_resolve_version_clang_format[invalid-None]
tests/test_util.py::test_resolve_version_clang_format[invalid-None]
CodSpeed Performance Gauge
N/A
N/A
103.5 µs
test_resolve_version_clang_tidy[18-18.1.8]
tests/test_util.py::test_resolve_version_clang_tidy[18-18.1.8]
CodSpeed Performance Gauge
N/A
N/A
447.5 µs
test_resolve_version_clang_tidy[19-19.1.0.1]
tests/test_util.py::test_resolve_version_clang_tidy[19-19.1.0.1]
CodSpeed Performance Gauge
N/A
N/A
447.8 µs
test_resolve_version_clang_tidy[20-20.1.0]
tests/test_util.py::test_resolve_version_clang_tidy[20-20.1.0]
CodSpeed Performance Gauge
N/A
N/A
450.1 µs
test_resolve_version_clang_tidy[99-None]
tests/test_util.py::test_resolve_version_clang_tidy[99-None]
CodSpeed Performance Gauge
N/A
N/A
436.7 µs
test_resolve_version_clang_tidy[None-None]
tests/test_util.py::test_resolve_version_clang_tidy[None-None]
CodSpeed Performance Gauge
N/A
N/A
86.3 µs
test_version_lists_not_empty
tests/test_util.py::test_version_lists_not_empty
CodSpeed Performance Gauge
N/A
N/A
110.9 µs

Passed

test_run_clang_tidy_valid[args0-1]
tests/test_clang_tidy.py::test_run_clang_tidy_valid[args0-1]
CodSpeed Performance Gauge
-3%
1.1 ms
1.1 ms
test_run_clang_tidy_invalid[args0-1]
tests/test_clang_tidy.py::test_run_clang_tidy_invalid[args0-1]
CodSpeed Performance Gauge
-3%
1 ms
1 ms
test_run_clang_tidy_invalid[args2-1]
tests/test_clang_tidy.py::test_run_clang_tidy_invalid[args2-1]
CodSpeed Performance Gauge
-4%
1 ms
1.1 ms
test_run_clang_tidy_invalid[args3-1]
tests/test_clang_tidy.py::test_run_clang_tidy_invalid[args3-1]
CodSpeed Performance Gauge
-4%
1 ms
1.1 ms
test_run_clang_tidy_valid[args2-1]
tests/test_clang_tidy.py::test_run_clang_tidy_valid[args2-1]
CodSpeed Performance Gauge
-5%
1.1 ms
1.1 ms
test_run_clang_tidy_valid[args3-1]
tests/test_clang_tidy.py::test_run_clang_tidy_valid[args3-1]
CodSpeed Performance Gauge
-5%
1.1 ms
1.1 ms
test_run_clang_tidy_invalid[args1-1]
tests/test_clang_tidy.py::test_run_clang_tidy_invalid[args1-1]
CodSpeed Performance Gauge
-5%
1 ms
1.1 ms
test_run_clang_tidy_valid[args1-1]
tests/test_clang_tidy.py::test_run_clang_tidy_valid[args1-1]
CodSpeed Performance Gauge
-5%
1.1 ms
1.1 ms

Commits

Click on a commit to change the comparison range
Base
main
4c2dece
-17%
Migrate from clang-tools binaries to wheels
f345167
2 days ago
by shenxianpeng
0%
allow run in parallel and pin clang-tools version
7e13841
2 days ago
by shenxianpeng
0%
update run.sh
9579df6
2 days ago
by shenxianpeng
-61%
fix utils.py tests and others
c03ae0f
2 days ago
by shenxianpeng
0%
fix: add mising package
b67718a
2 days ago
by shenxianpeng
0%
revert mian.c change
fbb7eb9
2 days ago
by shenxianpeng
0%
docs: update docs
d1ee4f5
2 days ago
by shenxianpeng
0%
add @pytest.mark.benchmark to test
4dcaef1
2 days ago
by shenxianpeng
0%
pre-commit autoupdate
ebc62b6
2 days ago
by shenxianpeng
0%
update docs
6610e8d
2 days ago
by shenxianpeng
0%
update docs
02670a3
2 days ago
by shenxianpeng
0%
increase test coverage
f34d1e5
2 days ago
by shenxianpeng
© 2025 CodSpeed Technology
Home Terms Privacy Docs