cod-918-perf-doesnt-work-for-cpp-codspeed - Branch - CodSpeedHQ/codspeed-cpp

feat: add perf walltime support

#13Closed

Comparing

cod-918-perf-doesnt-work-for-cpp-codspeed

(

0e18f9f

) with

main

(

719c41f

)

-33%

Improvements: 3

Regressions: 5

Untouched: 34

New: 16

This report only contains results for the Wall Time instrument. To view results for the CPU Simulation instrument, click here.

Benchmarks

Failed

TestA[MyTemplate1, int]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace

Regression

-17%

< 1 ns< 1 ns

BM_Capture[int_string_test]

examples/google_benchmark_bazel/main.cpp

Regression

-33%

< 1 ns< 1 ns

TestB[MyTemplate2, int, double]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace

Regression

-20%

< 1 ns< 1 ns

DoubleTest[MyTemplatedFixture, double]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace

Regression

-20%

< 1 ns< 1 ns

BM_Capture[int_test]

examples/google_benchmark_bazel/main.cpp

Regression

-17%

< 1 ns< 1 ns

Improved

BM_Template1_Capture[two_type_test, int, double]

examples/google_benchmark_bazel/template_bench.hpp

×2.3

< 1 ns< 1 ns

BM_Template1_Capture[int_string_test]

examples/google_benchmark_bazel/template_bench.hpp

+20%

< 1 ns< 1 ns

FooTest[MyFixture]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace

+20%

< 1 ns< 1 ns

New

BM_sleep_1ns

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A58.3 µs

BM_sleep_50ms

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A50.1 ms

BM_sleep_100ns

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A58.5 µs

BM_sleep_100us

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A158.6 µs

BM_sleep_100ms

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A100.1 ms

BM_sleep_1us

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A59.5 µs

BM_sleep_10ms

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A10.1 ms

BM_sleep_1ms

examples/google_benchmark_cmake/sleep_bench.hpp

N/A

N/A1.1 ms

BM_sleep_1us

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A59.6 µs

BM_sleep_1ns

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A58.6 µs

BM_sleep_100us

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A158.6 µs

BM_sleep_100ns

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A58.7 µs

BM_sleep_1ms

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A1.1 ms

BM_sleep_100ms

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A100.1 ms

BM_sleep_10ms

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A10.1 ms

BM_sleep_50ms

examples/google_benchmark_bazel/sleep_bench.hpp

N/A

N/A50.1 ms

Passed

BM_memcpy[8192]

examples/google_benchmark_cmake/main.cpp

+1%

457.4 ns453.9 ns

BM_memcpy[8192]

examples/google_benchmark_bazel/main.cpp

+1%

457.4 ns454.3 ns

BM_memcpy[512]

examples/google_benchmark_cmake/main.cpp

30.2 ns30.1 ns

BM_memcpy[8]

examples/google_benchmark_cmake/main.cpp

6.1 ns6.1 ns

BM_Template1[int]

examples/google_benchmark_bazel/template_bench.hpp

< 1 ns< 1 ns

BM_memcpy[64]

examples/google_benchmark_cmake/main.cpp

6.1 ns6.1 ns

BM_memcpy[4096]

examples/google_benchmark_cmake/main.cpp

231.1 ns231.1 ns

BM_Template2[int, double]

examples/google_benchmark_cmake/template_bench.hpp

< 1 ns< 1 ns

BM_Template1[int]

examples/google_benchmark_cmake/template_bench.hpp

< 1 ns< 1 ns

BM_StringCopy

examples/google_benchmark_cmake/main.cpp

9.6 ns9.6 ns

DoubleTest[MyTemplatedFixture, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

< 1 ns< 1 ns

BM_rand_vector

examples/google_benchmark_cmake/main.cpp

< 1 ns< 1 ns

IntTest[MyTemplatedFixture, int]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace

< 1 ns< 1 ns

BarTest[MyFixture]

examples/google_benchmark_bazel/fixture_bench.hpp::example_namespace

< 1 ns< 1 ns

BM_rand_vector

examples/google_benchmark_bazel/main.cpp

< 1 ns< 1 ns

BM_memcpy[8]

examples/google_benchmark_bazel/main.cpp

6.1 ns6.1 ns

BM_Template2[int, double]

examples/google_benchmark_bazel/template_bench.hpp

< 1 ns< 1 ns

BM_StringCopy

examples/google_benchmark_bazel/main.cpp

10 ns10 ns

BM_memcpy[64]

examples/google_benchmark_bazel/main.cpp

6.1 ns6.1 ns

BM_memcpy[512]

examples/google_benchmark_bazel/main.cpp

30.5 ns30.5 ns

BM_memcpy[4096]

examples/google_benchmark_bazel/main.cpp

231.5 ns231.7 ns

BM_Template[std\:\:string]

examples/google_benchmark_cmake/template_bench.hpp::test

-1%

67.5 ns67.8 ns

BM_Template1_Capture[int_string_test]

examples/google_benchmark_cmake/template_bench.hpp

-1%

< 1 ns< 1 ns

BM_Capture[int_string_test]

examples/google_benchmark_cmake/main.cpp

-1%

< 1 ns< 1 ns

BM_Capture[int_test]

examples/google_benchmark_cmake/main.cpp

-1%

< 1 ns< 1 ns

BM_Template1_Capture[two_type_test, int, double]

examples/google_benchmark_cmake/template_bench.hpp

-1%

< 1 ns< 1 ns

BM_Template[int]

examples/google_benchmark_cmake/template_bench.hpp::test

-2%

9.5 ns9.7 ns

TestB[MyTemplate2, int, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

-2%

< 1 ns< 1 ns

BM_Template[std\:\:string]

examples/google_benchmark_bazel/template_bench.hpp::test

-3%

64.6 ns66.4 ns

BM_Template[int]

examples/google_benchmark_bazel/template_bench.hpp::test

-3%

9.8 ns10.1 ns

IntTest[MyTemplatedFixture, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

-3%

< 1 ns< 1 ns

FooTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

-3%

< 1 ns< 1 ns

TestA[MyTemplate1, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

-5%

< 1 ns< 1 ns

BarTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

-5%

< 1 ns< 1 ns

Commits

Click on a commit to change the comparison range

Base

main

719c41f

-33.33%

feat: add sleep benches

0e18f9f

4 months ago

by not-matthias

Home Terms Privacy Docs