CodSpeedHQ
codspeed-go
BlogDocsChangelog

fix(testing): incomplete reading of benchmark time in b.N loops

#43Merged
Comparing
cod-1776-go-benchmarks-report-1ns-time-for-fuego
(
5331397
) with
main
(
0ee1cab
)
CodSpeed Performance Gauge
-30%
Improvements
1
Regressions
4
Untouched
43

Benchmarks

Failed

BenchmarkLargeSetupInLoop
example/setup_test.go
Regression
CodSpeed Performance Gauge
-18%
9.8 ms11.9 ms
BenchmarkSleep100ns_Loop
example/timing/sleep_test.go
Regression
CodSpeed Performance Gauge
-20%
240 ns300 ns
bench_collect_results[10000000, 10]
go-runner/benches/go_runner.rs
Regression
CodSpeed Performance Gauge
-30%
2.4 s3.4 s
bench_collect_results[5000000, 25]
go-runner/benches/go_runner.rs
Regression
CodSpeed Performance Gauge
-18%
2.5 s3.1 s

Improved

bench_go_runner
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
×2.3
130.4 s56 s

Passed

BenchmarkLargeSetup
example/setup_test.go
CodSpeed Performance Gauge
N/A
< 1 ns11.3 ms
BenchmarkWithStopModern
example/setup_test.go
CodSpeed Performance Gauge
-3%
1 ms1.1 ms
BenchmarkFibonacci10Parallel
example/fib_test.go
CodSpeed Performance Gauge
N/A
< 1 ns40 ns
fibonacci(10)
example/fib_test.go::BenchmarkFibonacci10::fibonacci(10)
CodSpeed Performance Gauge
N/A
< 1 ns562 ns
bench_collect_results[500000, 25]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
+2%
261.8 ms257.3 ms
BenchmarkWithOutlierMeasurementModern
example/setup_test.go
CodSpeed Performance Gauge
+2%
1.1 ms1.1 ms
BenchmarkWithStopTraditional
example/setup_test.go
CodSpeed Performance Gauge
0%
1.1 ms1.1 ms
BenchmarkSleep10ms_Loop
example/timing/sleep_test.go
CodSpeed Performance Gauge
0%
10 ms10 ms
BenchmarkWithoutStartupModern
example/setup_test.go
CodSpeed Performance Gauge
-1%
1.1 ms1.1 ms
BenchmarkFibonacci20_bN
example/fib_test.go
CodSpeed Performance Gauge
N/A
< 1 ns70.2 µs
BenchmarkWithoutStartupTraditional
example/setup_test.go
CodSpeed Performance Gauge
N/A
< 1 ns1.1 ms
BenchmarkSleep50ms_Loop
example/timing/sleep_test.go
CodSpeed Performance Gauge
0%
50 ms50 ms
BenchmarkFibonacci20_Loop
example/fib_test.go
CodSpeed Performance Gauge
0%
68.6 µs68.7 µs
BenchmarkWithOutlierMeasurementTraditional
example/setup_test.go
CodSpeed Performance Gauge
0%
1.1 ms1.1 ms
BenchmarkFibonacci20Parallel
example/fib_test.go
CodSpeed Performance Gauge
N/A
< 1 ns5.1 µs
BenchmarkSleep100us
example/timing/sleep_test.go
CodSpeed Performance Gauge
N/A
< 1 ns100.2 µs
BenchmarkSleep50ms
example/timing/sleep_test.go
CodSpeed Performance Gauge
N/A
< 1 ns50 ms
BenchmarkSleep1ms
example/timing/sleep_test.go
CodSpeed Performance Gauge
N/A
< 1 ns1 ms
BenchmarkSleep100ns
example/timing/sleep_test.go
CodSpeed Performance Gauge
N/A
< 1 ns231 ns
BenchmarkQuicktest
example/compat/quicktest_test.go
CodSpeed Performance Gauge
+1%
6.7 µs6.7 µs
BenchmarkWithSlogAssert
example/compat/slogassert_test.go
CodSpeed Performance Gauge
+1%
52.5 µs52.2 µs
BenchmarkSleep1ms_Loop
example/timing/sleep_test.go
CodSpeed Performance Gauge
0%
1 ms1 ms
BenchmarkSleep100us_Loop
example/timing/sleep_test.go
CodSpeed Performance Gauge
0%
100.2 µs100.2 µs
BenchmarkSleep10us_Loop
example/timing/sleep_test.go
CodSpeed Performance Gauge
0%
10.2 µs10.2 µs
BenchmarkSleep1us
example/timing/sleep_test.go
CodSpeed Performance Gauge
N/A
< 1 ns1.1 µs
BenchmarkSleep10ms
example/timing/sleep_test.go
CodSpeed Performance Gauge
N/A
< 1 ns10 ms
BenchmarkSleep10us
example/timing/sleep_test.go
CodSpeed Performance Gauge
N/A
< 1 ns10.2 µs
bench_collect_results[500000, 5]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
+3%
105.3 ms102.7 ms
bench_collect_results[500000, 10]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
+2%
127.1 ms124.1 ms
bench_collect_results[5000000, 5]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
+1%
1 s1 s
bench_collect_results[100000, 10]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
+1%
20.4 ms20.2 ms
bench_collect_results[100000, 5]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
0%
18.6 ms18.6 ms
bench_collect_results[1000000, 25]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
0%
523.5 ms525 ms
bench_collect_results[100000, 25]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
-1%
41 ms41.2 ms
BenchmarkTestifyWithNew
example/compat/testify_test.go
CodSpeed Performance Gauge
-1%
7.7 µs7.7 µs
bench_collect_results[1000000, 5]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
-1%
214.1 ms216.5 ms
BenchmarkTestifyWithT
example/compat/testify_test.go
CodSpeed Performance Gauge
-2%
3.6 µs3.7 µs
bench_collect_results[1000000, 10]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
-2%
248.1 ms253.2 ms
bench_collect_results[10000000, 5]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
-3%
2 s2.1 s
bench_collect_results[5000000, 10]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
-3%
1.3 s1.3 s
bench_collect_results[10000000, 25]
go-runner/benches/go_runner.rs
CodSpeed Performance Gauge
-4%
5 s5.2 s
BenchmarkSleep1us_Loop
example/timing/sleep_test.go
CodSpeed Performance Gauge
-5%
1.2 µs1.2 µs
BenchmarkExample
example/very/nested/module/example_test.go
CodSpeed Performance Gauge
N/A
< 1 ns< 1 ns

Commits

Click on a commit to change the comparison range
Base
main
0ee1cab
-29.54%
fix(testing): incomplete reading of benchmark time in b.N loops
5331397
20 days ago
by not-matthias
© 2025 CodSpeed Technology
Home Terms Privacy Docs