cod-1945-support-memory-profiling-for-c - Branch - CodSpeedHQ/codspeed-cpp - CodSpeed

Blog Docs Changelog

feat: add memory profiling support

Comparing

cod-1945-support-memory-profiling-for-c

(

003a1bf

) with

main

(

56e942a

)

-39%

Improvements: 1

Regressions: 3

Untouched: 92

New: 56

Ignored: 4

Skipped: 100

Benchmarks

Skipped (100)

Failed

BM_StringCopy

examples/google_benchmark_cmake/main.cpp

Regression

-39%

10.4 ns17.2 ns

BM_Template1_Capture[two_type_test, int, double]

examples/google_benchmark_cmake/template_bench.hpp

Regression

-32%

60.8 ns90 ns

BM_memcpy[8]

examples/google_benchmark_cmake/main.cpp

Regression

-18%

273.1 ns331.4 ns

Improved

BM_rand_vector

examples/google_benchmark_cmake/main.cpp

+24%

151.4 ns122.2 ns

New

BM_RLE_Encode_SmallRuns[100000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A1.6 ms

BM_RLE_Encode_SmallRuns[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A16 µs

BM_RLE_Encode_SmallRuns[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A1.8 µs

BM_RLE_Encode_LargeRuns[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A213 ns

BM_RLE_Encode_LargeRuns[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A20.5 µs

BM_RLE_Encode_SmallRuns[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A154.7 µs

BM_RLE_Encode_LargeRuns[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A2.2 µs

BM_RLE_Decode[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A368.5 ns

BM_RLE_Encode_LargeRuns[100000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A202.9 µs

BM_Vector_PushBack[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A281.1 ns

BM_RLE_Decode[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A22 µs

BM_Vector_PushBack[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A741.1 ns

BM_Vector_PushBack[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A3.7 µs

BM_Vector_Reserve[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A66.8 ns

BM_String_Concatenation[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A8.3 µs

BM_RLE_Decode[100000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A279.2 µs

BM_RLE_Decode[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A2.7 µs

BM_Vector_PushBack[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A34.1 µs

BM_String_Concatenation[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A987.5 ns

BM_String_Concatenation[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A92.8 ns

BM_Vector_Reserve[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A31.2 µs

BM_Vector_Reserve[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A3.2 µs

BM_Vector_Reserve[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A350.7 ns

BM_String_Reserve[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A810 ns

BM_String_Reserve[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A7.6 µs

BM_String_Reserve[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A75.5 µs

BM_String_Concatenation[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A77.7 µs

BM_String_Reserve[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A98 ns

BM_String_Concatenation[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A23.3 µs

BM_String_Concatenation[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A188 µs

BM_RLE_Encode_SmallRuns[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A8.1 µs

BM_String_Reserve[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A177.5 µs

BM_String_Concatenation[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A556.1 ns

BM_String_Reserve[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A19.2 µs

BM_Vector_PushBack[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A141.9 µs

BM_String_Concatenation[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A4.3 µs

BM_String_Reserve[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A714.4 ns

BM_String_Reserve[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A3.6 µs

BM_Vector_PushBack[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A13.8 µs

BM_Vector_Reserve[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A9.2 µs

BM_Vector_Reserve[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A2.9 µs

BM_Vector_PushBack[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A3.6 µs

BM_RLE_Decode[100000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A610.5 µs

BM_Vector_PushBack[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A3.2 µs

BM_Vector_Reserve[10]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A1.5 µs

BM_Vector_Reserve[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A65.7 µs

BM_RLE_Encode_LargeRuns[100000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A469.2 µs

BM_RLE_Decode[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A59.2 µs

BM_RLE_Decode[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A4.3 µs

BM_RLE_Encode_LargeRuns[100]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A2.3 µs

BM_RLE_Encode_LargeRuns[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A8.5 µs

BM_RLE_Decode[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A11.3 µs

BM_RLE_Encode_SmallRuns[1000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A46.4 µs

BM_RLE_Encode_SmallRuns[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A413.3 µs

BM_RLE_Encode_SmallRuns[100000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A4.2 ms

BM_RLE_Encode_LargeRuns[10000]

examples/google_benchmark_cmake/memory_bench.hpp

N/A

N/A50.6 µs

Passed

BM_StringCopy

examples/google_benchmark_cmake/main.cpp

+8%

398.6 ns369.4 ns

BM_sleep_10ns

examples/google_benchmark_cmake/sleep_bench.hpp

+7%

468.1 ns438.9 ns

BM_sleep_50us

examples/google_benchmark_cmake/sleep_bench.hpp

+7%

468.1 ns438.9 ns

BM_Template[std\:\:string]

examples/google_benchmark_cmake/template_bench.hpp::test

+6%

72.7 ns68.6 ns

BM_Template[int]

examples/google_benchmark_cmake/template_bench.hpp::test

0%

10 ns10 ns

BM_FibonacciRecursive[35]

examples/google_benchmark_cmake/fibonacci_bench.hpp

0%

67.6 ms67.6 ms

BM_sleep_100us

examples/google_benchmark_cmake/sleep_bench.hpp

0%

100.1 µs100.1 µs

BM_FibonacciRecursive[35]

examples/google_benchmark_cmake/fibonacci_bench.hpp

0%

104 ms104 ms

BM_sleep_10ms

examples/google_benchmark_cmake/sleep_bench.hpp

0%

10 ms10 ms

BM_sleep_100ms

examples/google_benchmark_cmake/sleep_bench.hpp

0%

100 ms100 ms

BM_sleep_1ms

examples/google_benchmark_cmake/sleep_bench.hpp

0%

1 ms1 ms

BM_sleep_50ms

examples/google_benchmark_cmake/sleep_bench.hpp

0%

50 ms50 ms

BM_sleep_100ns

examples/google_benchmark_cmake/sleep_bench.hpp

0%

468.1 ns468.1 ns

BM_FibonacciIterative[50]

examples/google_benchmark_cmake/fibonacci_bench.hpp

0%

173.9 ns173.9 ns

BarTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

90.8 ns90.8 ns

DoubleTest[MyTemplatedFixture, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

90.8 ns90.8 ns

BM_sleep_1ns

examples/google_benchmark_cmake/sleep_bench.hpp

0%

468.1 ns468.1 ns

TestA[MyTemplate1, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

90.8 ns90.8 ns

BM_sleep_1us

examples/google_benchmark_cmake/sleep_bench.hpp

0%

468.1 ns468.1 ns

BM_Template1[int]

examples/google_benchmark_cmake/template_bench.hpp

0%

90.8 ns90.8 ns

IntTest[MyTemplatedFixture, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

90.8 ns90.8 ns

BM_Template2[int, double]

examples/google_benchmark_cmake/template_bench.hpp

0%

91.1 ns91.1 ns

FooTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

90.8 ns90.8 ns

BM_Template1_Capture[int_string_test]

examples/google_benchmark_cmake/template_bench.hpp

0%

60.6 ns60.6 ns

BM_large_setup_teardown

examples/google_benchmark_cmake/pause_timing_bench.hpp

0%

10.6 ms10.6 ms

BM_large_setup

examples/google_benchmark_cmake/pause_timing_bench.hpp

0%

10.6 ms10.6 ms

BM_sleep_10us

examples/google_benchmark_cmake/sleep_bench.hpp

0%

468.1 ns468.1 ns

BM_Capture_int_string[int_string_test]

examples/google_benchmark_cmake/main.cpp

0%

60.8 ns60.8 ns

BM_custom_args[100]

examples/google_benchmark_cmake/main.cpp

0%

90.8 ns90.8 ns

TestB[MyTemplate2, int, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

90.8 ns90.8 ns

BM_Capture_int[int_test]

examples/google_benchmark_cmake/main.cpp

0%

61.1 ns61.1 ns

BM_Capture[int_string_test]

examples/google_benchmark_cmake/main.cpp

0%

60.6 ns60.6 ns

BM_memcpy[4096]

examples/google_benchmark_cmake/main.cpp

0%

4.4 µs4.4 µs

BM_custom_multi[10/20]

examples/google_benchmark_cmake/main.cpp

0%

150.3 ns150.3 ns

BM_custom_multi[100/200]

examples/google_benchmark_cmake/main.cpp

0%

150.3 ns150.3 ns

BM_short_name

examples/google_benchmark_cmake/main.cpp

0%

61.1 ns61.1 ns

BM_Capture[int_test]

examples/google_benchmark_cmake/main.cpp

0%

61.1 ns61.1 ns

BM_with_multiple_args[100/200]

examples/google_benchmark_cmake/main.cpp

0%

150.3 ns150.3 ns

BM_with_args[100]

examples/google_benchmark_cmake/main.cpp

0%

90.8 ns90.8 ns

BM_custom_args[1000]

examples/google_benchmark_cmake/main.cpp

0%

90.8 ns90.8 ns

BM_with_args[1000]

examples/google_benchmark_cmake/main.cpp

0%

90.8 ns90.8 ns

BM_custom_name_in_namespace

examples/google_benchmark_cmake/main.cpp::one::two::three

0%

61.1 ns61.1 ns

BM_with_multiple_args[10/20]

examples/google_benchmark_cmake/main.cpp

0%

150.3 ns150.3 ns

BM_with_args[1000]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_with_args[100]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_Template1[int]

examples/google_benchmark_cmake/template_bench.hpp

0%

< 1 ns< 1 ns

BM_sleep_50us

examples/google_benchmark_cmake/sleep_bench.hpp

0%

50.1 µs50.1 µs

BM_memcpy[64]

examples/google_benchmark_cmake/main.cpp

0%

6.2 ns6.2 ns

BM_short_name

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_memcpy[8]

examples/google_benchmark_cmake/main.cpp

0%

6.2 ns6.2 ns

IntTest[MyTemplatedFixture, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

< 1 ns< 1 ns

BM_Capture_int[int_test]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_large_setup

examples/google_benchmark_cmake/pause_timing_bench.hpp

0%

1.1 ms1.1 ms

BM_rand_vector

examples/google_benchmark_cmake/main.cpp

0%

1.8 ns1.8 ns

BM_custom_args[1000]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_Capture[int_string_test]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_Template1_Capture[int_string_test]

examples/google_benchmark_cmake/template_bench.hpp

0%

< 1 ns< 1 ns

TestB[MyTemplate2, int, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

< 1 ns< 1 ns

BM_custom_multi[10/20]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_Template1_Capture[two_type_test, int, double]

examples/google_benchmark_cmake/template_bench.hpp

0%

< 1 ns< 1 ns

DoubleTest[MyTemplatedFixture, double]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

< 1 ns< 1 ns

BM_large_setup_teardown

examples/google_benchmark_cmake/pause_timing_bench.hpp

0%

1.1 ms1.1 ms

BM_with_multiple_args[100/200]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_FibonacciIterative[50]

examples/google_benchmark_cmake/fibonacci_bench.hpp

0%

62.9 ns62.9 ns

BM_Capture[int_test]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_memcpy[512]

examples/google_benchmark_cmake/main.cpp

0%

32.3 ns32.3 ns

BarTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

< 1 ns< 1 ns

BM_Template2[int, double]

examples/google_benchmark_cmake/template_bench.hpp

0%

< 1 ns< 1 ns

BM_with_multiple_args[10/20]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_Capture_int_string[int_string_test]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

TestA[MyTemplate1, int]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

< 1 ns< 1 ns

BM_custom_name_in_namespace

examples/google_benchmark_cmake/main.cpp::one::two::three

0%

< 1 ns< 1 ns

BM_sleep_100ns

examples/google_benchmark_cmake/sleep_bench.hpp

0%

166.9 ns167 ns

FooTest[MyFixture]

examples/google_benchmark_cmake/fixture_bench.hpp::example_namespace

0%

< 1 ns< 1 ns

BM_custom_args[100]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_SimpleMultithread

examples/google_benchmark_cmake/multithread_bench.hpp

0%

10.6 ms10.6 ms

BM_custom_multi[100/200]

examples/google_benchmark_cmake/main.cpp

0%

< 1 ns< 1 ns

BM_sleep_10us

examples/google_benchmark_cmake/sleep_bench.hpp

0%

10.1 µs10.1 µs

BM_sleep_1ns

examples/google_benchmark_cmake/sleep_bench.hpp

0%

83.4 ns83.5 ns

BM_sleep_10ns

examples/google_benchmark_cmake/sleep_bench.hpp

0%

83.4 ns83.5 ns

BM_sleep_1us

examples/google_benchmark_cmake/sleep_bench.hpp

0%

1.1 µs1.1 µs

BM_memcpy[8192]

examples/google_benchmark_cmake/main.cpp

0%

8.3 µs8.3 µs

BM_SimpleMultithread

examples/google_benchmark_cmake/multithread_bench.hpp

-1%

6.7 ms6.8 ms

BM_memcpy[4096]

examples/google_benchmark_cmake/main.cpp

-1%

236.8 ns238.3 ns

BM_memcpy[8192]

examples/google_benchmark_cmake/main.cpp

-1%

472.2 ns478.6 ns

BM_memcpy[512]

examples/google_benchmark_cmake/main.cpp

-3%

941.4 ns970.6 ns

BM_Template[std\:\:string]

examples/google_benchmark_cmake/template_bench.hpp::test

-5%

1.2 µs1.2 µs

BM_sleep_100us

examples/google_benchmark_cmake/sleep_bench.hpp

-6%

438.9 ns468.1 ns

BM_sleep_50ns

examples/google_benchmark_cmake/sleep_bench.hpp

-6%

438.9 ns468.1 ns

BM_sleep_50ns

examples/google_benchmark_cmake/sleep_bench.hpp

-6%

125.5 ns134.2 ns

BM_memcpy[64]

examples/google_benchmark_cmake/main.cpp

-8%

331.1 ns360.3 ns

BM_Template[int]

examples/google_benchmark_cmake/template_bench.hpp::test

-9%

870.6 ns958.1 ns

Ignored

BM_sleep_1ms

examples/google_benchmark_cmake/sleep_bench.hpp

Ignored

-1%

4.4 µs4.5 µs

BM_sleep_10ms

examples/google_benchmark_cmake/sleep_bench.hpp

Ignored

0%

47.8 µs47.8 µs

BM_sleep_50ms

examples/google_benchmark_cmake/sleep_bench.hpp

Ignored

0%

240.9 µs240.1 µs

BM_sleep_100ms

examples/google_benchmark_cmake/sleep_bench.hpp

Ignored

-1%

478.4 µs482.8 µs

Commits

Click on a commit to change the comparison range

Base

main

56e942a

-32.11%

chore: bump instrument-hooks to support memory profiling

acce038

1 day ago

by not-matthias

+32.1%

feat: run memory profiling in CI

dfadbfd

1 day ago

by not-matthias

-39.39%

fix: disable warmup to prevent additional markers When running the warmup, we already call `start/stop_benchmark` which creates two memory profiles per benchmark, which breaks our assumptions in the backend.

003a1bf

9 hours ago

by not-matthias

© 2026 CodSpeed Technology

Home Terms Privacy Docs