Comparing
cod-1740-codspeed-go-invalid-minimum-benchmark-time-with-bloop
(a6c2549
) withmain
(0f118b3
)-97%
- Improvement
- 3
- Regression
- 1
- Untouched
- 38
- New
- 6
Some benchmarks measured no execution time
Nothing ran under measurement, usually because the compiler removed the code under test. These results are not comparable, so they count as unchanged.Preventing compiler optimizationsBenchmarks
48 total
BenchmarkLargeSetupInLoop
example/setup_test.go-97%
261.8 µs9,740 µs
bench_go_runner
go-runner/benches/go_runner.rs+37%
36.1 s26.4 s
bench_collect_results[10000000, 5]
go-runner/benches/go_runner.rs+15%
2.3 s2 s
bench_collect_results[10000000, 10]
go-runner/benches/go_runner.rs+12%
2.6 s2.3 s
BenchmarkWithoutStartupModern
example/setup_test.goN/A
N/A1.1 ms
BenchmarkWithoutStartupTraditional
example/setup_test.goN/A
N/A< 1 ns
BenchmarkWithOutlierMeasurementTraditional
example/setup_test.goN/A
N/A1.1 ms
BenchmarkWithStopModern
example/setup_test.goN/A
N/A1.1 ms
BenchmarkWithStopTraditional
example/setup_test.goN/A
N/A1.1 ms
BenchmarkWithOutlierMeasurementModern
example/setup_test.goN/A
N/A1.1 ms
bench_collect_results[5000000, 25]
go-runner/benches/go_runner.rs+3%
2.7 s2.6 s
bench_collect_results[5000000, 10]
go-runner/benches/go_runner.rs-3%
1.3 s1.3 s
bench_collect_results[500000, 5]
go-runner/benches/go_runner.rs-2%
102.2 ms104.1 ms
BenchmarkTestifyWithT
example/compat/testify_test.go+2%
3.6 µs3.6 µs
bench_collect_results[5000000, 5]
go-runner/benches/go_runner.rs+2%
1 s1 s
bench_collect_results[500000, 10]
go-runner/benches/go_runner.rs+2%
127.8 ms125.8 ms
bench_collect_results[1000000, 10]
go-runner/benches/go_runner.rs-1%
250.8 ms254.5 ms
BenchmarkTestifyWithNew
example/compat/testify_test.go-1%
7.5 µs7.6 µs
BenchmarkQuicktest
example/compat/quicktest_test.go+1%
6.8 µs6.7 µs
bench_collect_results[100000, 25]
go-runner/benches/go_runner.rs-1%
40.8 ms41.1 ms
bench_collect_results[10000000, 25]
go-runner/benches/go_runner.rs+1%
5.1 s5.1 s
bench_collect_results[1000000, 25]
go-runner/benches/go_runner.rs0%
521.5 ms523.6 ms
bench_collect_results[100000, 5]
go-runner/benches/go_runner.rs0%
18.6 ms18.6 ms
bench_collect_results[1000000, 5]
go-runner/benches/go_runner.rs0%
213.7 ms214.3 ms
bench_collect_results[500000, 25]
go-runner/benches/go_runner.rs0%
257.7 ms257.1 ms
Commits
Click on a commit to change the comparison rangeBase
main
0f118b3
-97.31%
fix(testing): save measurements only in the benchmark framework
a6c2549
10 months ago
by not-matthias