cod-918-perf-doesnt-work-for-cpp-codspeed - Branch - CodSpeedHQ/codspeed-cpp

CodSpeedHQ

codspeed-cpp

Instrumentation

Wall Time

Blog Docs Changelog

feat: add perf walltime support

#13

Comparing

cod-918-perf-doesnt-work-for-cpp-codspeed

(

da6c95f

) with

main

(

719c41f

)

-33%

Improvements: 3

Regressions: 6

Untouched: 33

New: 16

Dropped: 0

Ignored: 0

Benchmarks

Failed

DoubleTest[MyTemplatedFixture, double]Regression

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace::DoubleTest[MyTemplatedFixture, double]

-33%

< 1 ns

IntTest[MyTemplatedFixture, int]Regression

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace::IntTest[MyTemplatedFixture, int]

-17%

< 1 ns

TestA[MyTemplate1, int]Regression

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace::TestA[MyTemplate1, int]

-17%

< 1 ns

TestB[MyTemplate2, int, double]Regression

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace::TestB[MyTemplate2, int, double]

-20%

< 1 ns

BM_Capture[int_string_test]Regression

examples/google_benchmark_bazel/main.cpp::BM_Capture[int_string_test]

-33%

< 1 ns

BM_rand_vectorRegression

examples/google_benchmark_bazel/main.cpp::BM_rand_vector

-20%

< 1 ns

Improved

BM_Template1_Capture[two_type_test, int, double]

examples/google_benchmark_bazel/template_bench.hpp::BM_Template1_Capture[two_type_test, int, double]

+80%

< 1 ns

FooTest[MyFixture]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace::FooTest[MyFixture]

+50%

< 1 ns

BarTest[MyFixture]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace::BarTest[MyFixture]

+25%

< 1 ns

New

BM_sleep_100ms

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_100ms

N/A

100.1 ms

BM_sleep_100ns

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_100ns

N/A

58.6 µs

BM_sleep_100us

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_100us

N/A

158.7 µs

BM_sleep_10ms

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_10ms

N/A

10.1 ms

BM_sleep_1ms

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_1ms

N/A

1.1 ms

BM_sleep_1ns

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_1ns

N/A

58.6 µs

BM_sleep_1us

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_1us

N/A

59.6 µs

BM_sleep_50ms

examples/google_benchmark_bazel/sleep_bench.hpp::BM_sleep_50ms

N/A

50.1 ms

BM_sleep_100ms

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_100ms

N/A

100.1 ms

BM_sleep_100ns

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_100ns

N/A

58.6 µs

BM_sleep_100us

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_100us

N/A

158.7 µs

BM_sleep_10ms

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_10ms

N/A

10.1 ms

BM_sleep_1ms

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_1ms

N/A

1.1 ms

BM_sleep_1ns

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_1ns

N/A

58.6 µs

BM_sleep_1us

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_1us

N/A

59.6 µs

BM_sleep_50ms

examples/google_benchmark_cmake/sleep_bench.hpp::BM_sleep_50ms

N/A

50.1 ms

Passed

BM_memcpy[8192]

examples/google_benchmark_cmake/main.cpp::BM_memcpy[8192]

+1%

457.4 ns

453.9 ns

BM_memcpy[8192]

examples/google_benchmark_bazel/main.cpp::BM_memcpy[8192]

+1%

457.4 ns

454.8 ns

BM_memcpy[512]

examples/google_benchmark_cmake/main.cpp::BM_memcpy[512]

30.2 ns

30.1 ns

BM_Template1[int]

examples/google_benchmark_cmake/template_bench.hpp::BM_Template1[int]

< 1 ns

BM_memcpy[64]

examples/google_benchmark_cmake/main.cpp::BM_memcpy[64]

6.1 ns

BM_memcpy[8]

examples/google_benchmark_cmake/main.cpp::BM_memcpy[8]

6.1 ns

BM_Capture[int_test]

examples/google_benchmark_bazel/main.cpp::BM_Capture[int_test]

< 1 ns

BM_Template1_Capture[int_string_test]

examples/google_benchmark_bazel/template_bench.hpp::BM_Template1_Capture[int_string_test]

< 1 ns

BM_memcpy[4096]

examples/google_benchmark_cmake/main.cpp::BM_memcpy[4096]

231.1 ns

BM_Template2[int, double]

examples/google_benchmark_cmake/template_bench.hpp::BM_Template2[int, double]

< 1 ns

BM_memcpy[8]

examples/google_benchmark_bazel/main.cpp::BM_memcpy[8]

6.1 ns

BM_StringCopy

examples/google_benchmark_cmake/main.cpp::BM_StringCopy

9.6 ns

BM_memcpy[64]

examples/google_benchmark_bazel/main.cpp::BM_memcpy[64]

6.1 ns

BM_memcpy[512]

examples/google_benchmark_bazel/main.cpp::BM_memcpy[512]

30.5 ns

BM_StringCopy

examples/google_benchmark_bazel/main.cpp::BM_StringCopy

10 ns

BM_memcpy[4096]

examples/google_benchmark_bazel/main.cpp::BM_memcpy[4096]

231.5 ns

231.6 ns

BM_Template1[int]

examples/google_benchmark_bazel/template_bench.hpp::BM_Template1[int]

< 1 ns

BM_Template2[int, double]

examples/google_benchmark_bazel/template_bench.hpp::BM_Template2[int, double]

< 1 ns

BM_rand_vector

examples/google_benchmark_cmake/main.cpp::BM_rand_vector

-1%

< 1 ns

IntTest[MyTemplatedFixture, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace::IntTest[MyTemplatedFixture, int]

-2%

< 1 ns

BM_Template[int]

examples/google_benchmark_cmake/template_bench.hpp::test::BM_Template[int]

-2%

9.5 ns

9.8 ns

DoubleTest[MyTemplatedFixture, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace::DoubleTest[MyTemplatedFixture, double]

-3%

< 1 ns

BM_Template[std\:\:string]

examples/google_benchmark_cmake/template_bench.hpp::test::BM_Template[std\:\:string]

-4%

67.5 ns

70 ns

BarTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace::BarTest[MyFixture]

-4%

< 1 ns

TestB[MyTemplate2, int, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace::TestB[MyTemplate2, int, double]

-4%

< 1 ns

BM_Template[int]

examples/google_benchmark_bazel/template_bench.hpp::test::BM_Template[int]

-4%

9.8 ns

10.3 ns

FooTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace::FooTest[MyFixture]

-5%

< 1 ns

BM_Capture[int_string_test]

examples/google_benchmark_cmake/main.cpp::BM_Capture[int_string_test]

-6%

< 1 ns

TestA[MyTemplate1, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace::TestA[MyTemplate1, int]

-6%

< 1 ns

BM_Capture[int_test]

examples/google_benchmark_cmake/main.cpp::BM_Capture[int_test]

-6%

< 1 ns

BM_Template1_Capture[two_type_test, int, double]

examples/google_benchmark_cmake/template_bench.hpp::BM_Template1_Capture[two_type_test, int, double]

-6%

< 1 ns

BM_Template[std\:\:string]

examples/google_benchmark_bazel/template_bench.hpp::test::BM_Template[std\:\:string]

-8%

64.6 ns

70.1 ns

BM_Template1_Capture[int_string_test]

examples/google_benchmark_cmake/template_bench.hpp::BM_Template1_Capture[int_string_test]

-8%

< 1 ns

Commits

Click on a commit to change the comparison range

Base

main

719c41f

-33%

fix: checkout recursive for windows

da25a57

1 day ago

by not-matthias

fix: compiler warnings

da6c95f

1 day ago

by not-matthias

Home Terms Privacy Docs