cod-1672-improve-stability-of-codspeed-go-integration - Branch - CodSpeedHQ/codspeed-go

feat: rewrite go-runner to use overlay files

#49

Comparing

cod-1672-improve-stability-of-codspeed-go-integration

(

59c0bda

) with

main

(

4df4d46

)

+22%

Improvements: 1

Untouched: 47

Skipped: 1

Benchmarks

Skipped (1)

Improved

bench_collect_results[10000000, 25]

go-runner/benches/go_runner.rs

+22%

6.1 s5 s

Passed

bench_collect_results[500000, 10]

go-runner/benches/go_runner.rs

+7%

126 ms117.3 ms

bench_collect_results[1000000, 5]

go-runner/benches/go_runner.rs

+7%

214.3 ms200.4 ms

bench_collect_results[1000000, 10]

go-runner/benches/go_runner.rs

+6%

250.4 ms237.1 ms

bench_collect_results[1000000, 25]

go-runner/benches/go_runner.rs

+4%

519 ms498.7 ms

BenchmarkFibonacci20_bN

example/fib_test.go

+4%

73.5 µs71 µs

BenchmarkTestifyWithT

example/compat/testify_test.go

+3%

3.7 µs3.6 µs

BenchmarkFibonacci20Parallel

example/fib_test.go

+3%

5.3 µs5.2 µs

bench_collect_results[500000, 25]

go-runner/benches/go_runner.rs

+2%

255.7 ms250 ms

BenchmarkTestifyWithNew

example/compat/testify_test.go

+2%

7.7 µs7.6 µs

bench_collect_results[10000000, 5]

go-runner/benches/go_runner.rs

+1%

2 s2 s

bench_collect_results[500000, 5]

go-runner/benches/go_runner.rs

+1%

102 ms100.8 ms

BenchmarkSleep100ns

example/timing/sleep_test.go

+1%

231 ns229 ns

fibonacci(10)

example/fib_test.go::BenchmarkFibonacci10::fibonacci(10)

575 ns573 ns

bench_collect_results[100000, 5]

go-runner/benches/go_runner.rs

18.6 ms18.5 ms

BenchmarkSleep1ms

example/timing/sleep_test.go

1 ms1 ms

BenchmarkFibonacci20_Loop

example/fib_test.go

68.7 µs68.7 µs

BenchmarkSleep100ns_Loop

example/timing/sleep_test.go

300 ns300 ns

BenchmarkExternalFib

example/external/external_test.go

45 ns45 ns

BenchmarkSleep50ms_Loop

example/timing/sleep_test.go

50 ms50 ms

BenchmarkSleep50ms

example/timing/sleep_test.go

50 ms50 ms

BenchmarkSleep1ms_Loop

example/timing/sleep_test.go

1 ms1 ms

BenchmarkSleep10ms

example/timing/sleep_test.go

10 ms10 ms

BenchmarkSleep10ms_Loop

example/timing/sleep_test.go

10 ms10 ms

BenchmarkSleep100us_Loop

example/timing/sleep_test.go

100.2 µs100.2 µs

BenchmarkSleep100us

example/timing/sleep_test.go

100.2 µs100.2 µs

BenchmarkLargeSetup

example/setup_test.go

10.2 ms10.2 ms

BenchmarkSleep10us_Loop

example/timing/sleep_test.go

10.2 µs10.2 µs

BenchmarkWithOutlierMeasurementTraditional

example/setup_test.go

1.1 ms1.1 ms

BenchmarkWithStopModern

example/setup_test.go

1.1 ms1.1 ms

BenchmarkWithStopTraditional

example/setup_test.go

1.1 ms1.1 ms

BenchmarkQuicktest

example/compat/quicktest_test.go

6.9 µs6.9 µs

BenchmarkWithoutStartupModern

example/setup_test.go

1.1 ms1.1 ms

BenchmarkWithoutStartupTraditional

example/setup_test.go

1.1 ms1.1 ms

BenchmarkWithOutlierMeasurementModern

example/setup_test.go

1.1 ms1.1 ms

bench_collect_results[5000000, 10]

go-runner/benches/go_runner.rs

1.3 s1.3 s

bench_collect_results[100000, 10]

go-runner/benches/go_runner.rs

20 ms20.1 ms

bench_collect_results[5000000, 5]

go-runner/benches/go_runner.rs

1 s1 s

BenchmarkSleep1us

example/timing/sleep_test.go

-1%

1.1 µs1.2 µs

bench_collect_results[100000, 25]

go-runner/benches/go_runner.rs

-1%

41 ms41.3 ms

BenchmarkSleep10us

example/timing/sleep_test.go

-1%

10.1 µs10.2 µs

BenchmarkSleep1us_Loop

example/timing/sleep_test.go

-1%

1.2 µs1.2 µs

BenchmarkLargeSetupInLoop

example/setup_test.go

-2%

9.9 ms10.1 ms

bench_collect_results[10000000, 10]

go-runner/benches/go_runner.rs

-2%

2.4 s2.4 s

bench_collect_results[5000000, 25]

go-runner/benches/go_runner.rs

-2%

2.5 s2.5 s

BenchmarkWithSlogAssert

example/compat/slogassert_test.go

-8%

52.2 µs57 µs

BenchmarkFibonacci10Parallel

example/fib_test.go

-9%

41 ns45 ns

BenchmarkExample

example/very/nested/module/example_test.go

N/A

< 1 ns< 1 ns

Commits

Click on a commit to change the comparison range

Base

main

4df4d46

+22.24%

fix(go-runner): check Go version compatibility before running tests

59c0bda

3 days ago

by not-matthias

Home Terms Privacy Docs