cod-1221-support-perf-profiling-with-codspeed-node - Branch - CodSpeedHQ/codspeed-node

Add perf profiling to tinybench

#51Merged

Comparing

cod-1221-support-perf-profiling-with-codspeed-node

(

e31ee8b

) with

main

(

81f0dc9

)

-85%

Improvements: 7

Regressions: 11

Untouched: 64

This report only contains results for the CPU Simulation instrument. To view results for the Wall Time instrument, click here.

Benchmarks

Failed

switch 1

examples/with-javascript-esm/tinybench.js

Regression

-76%

30 µs123.9 µs

switch 1

examples/with-typescript-simple-esm/tinybench.ts

Regression

-75%

30.7 µs123.7 µs

short body

packages/tinybench-plugin/benches/sample.ts

Regression

-15%

102.5 µs121.1 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

Regression

-67%

46 µs138.4 µs

switch 1

packages/tinybench-plugin/benches/sample.ts

Regression

-67%

30.9 µs93.3 µs

test_iterative_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

Regression

-85%

29.1 µs190.3 µs

switch 1

examples/with-typescript-simple-cjs/tinybench.ts

Regression

-75%

30.7 µs125.2 µs

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

Regression

-79%

47.2 µs227.5 µs

test_recursive_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

Regression

-16%

1.5 ms1.8 ms

test_recursive_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

Regression

-67%

46 µs139 µs

test sync baz 10

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

Regression

-80%

39.4 µs200 µs

Improved

test_iterative_fibo_100

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

×5.7

194.6 µs34 µs

test sync baz 10

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

×4.9

201.3 µs40.9 µs

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

×4.2

205.7 µs48.9 µs

switch 2

packages/tinybench-plugin/benches/sample.ts

×3.2

25.5 µs8.1 µs

test_iterative_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

+50%

450.4 µs299.4 µs

test_iterative_fibo_100

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

+32%

282.3 µs214.2 µs

wait 1ms

packages/tinybench-plugin/benches/timing.ts::timing

+25%

24.7 µs19.8 µs

Passed

wait 500ms

packages/tinybench-plugin/benches/timing.ts::timing

+2%

12.5 ms12.2 ms

test_iterative_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

+1%

12.1 µs12 µs

wait 1sec

packages/tinybench-plugin/benches/timing.ts::timing

+1%

23.1 ms22.9 ms

two

packages/vitest-plugin/benches/hooks.bench.ts::hooks::run

+1%

203.2 µs202 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite::deeply nested suite

89.1 µs88.8 µs

test_iterative_fibo_100

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

21.2 µs21.2 µs

wait 500ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

12.4 ms12.4 ms

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

36.8 µs36.7 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

89.7 µs89.6 µs

short body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

133 µs132.8 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

352.5 µs352.2 µs

long body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

353.3 µs353.1 µs

short body

packages/benchmark.js-plugin/benches/sample.ts

110.5 µs110.5 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

30.7 µs30.7 µs

one

packages/vitest-plugin/benches/hooks.bench.ts::hooks::run

239.7 µs239.7 µs

fibo 30

examples/with-typescript-esm/src/fibonacci.bench.ts::recursiveFibonacci

175 ms175 ms

end

packages/vitest-plugin/benches/hooks.bench.ts::hooks

209.4 µs209.4 µs

long body

packages/benchmark.js-plugin/benches/sample.ts

320.2 µs320.2 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

132.9 µs132.9 µs

test_recursive_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

1.5 ms1.5 ms

fibo 15

packages/vitest-plugin/benches/flat.bench.ts::fibo

146.6 µs146.6 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

88.9 µs88.9 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

356.4 µs356.5 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

353.2 µs353.3 µs

short body 4

packages/benchmark.js-plugin/benches/sample.ts

59 µs59.1 µs

short body 5

packages/benchmark.js-plugin/benches/sample.ts

59 µs59.1 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr::nested suite

88.7 µs88.8 µs

test_recursive_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

1.5 ms1.5 ms

fibo 10

packages/vitest-plugin/benches/flat.bench.ts::fibo

37.7 µs37.8 µs

test_recursive_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

1.5 ms1.5 ms

short body 3

packages/benchmark.js-plugin/benches/sample.ts

64.1 µs64.3 µs

short body 2

packages/benchmark.js-plugin/benches/sample.ts

59.1 µs59.2 µs

test_recursive_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

28.2 µs28.2 µs

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

25.3 µs25.4 µs

String#indexOf

examples/with-typescript-simple-esm/benchmark-js.ts

11 µs11 µs

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

36.7 µs36.8 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

30.6 µs30.7 µs

String#indexOf

packages/benchmark.js-plugin/benches/sample.ts

-1%

11 µs11 µs

String#indexOf

examples/with-javascript-esm/benchmark-js.js

-1%

10.9 µs10.9 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

-1%

25.3 µs25.4 µs

RegExp#test

examples/with-javascript-esm/benchmark-js.js

-1%

20.2 µs20.3 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

-1%

28.1 µs28.3 µs

RegExp#test

examples/with-typescript-simple-esm/benchmark-js.ts

-1%

18.6 µs18.7 µs

test sync baz 100

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts

-1%

13.2 µs13.3 µs

test_iterative_fibo_100

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

-1%

21.1 µs21.2 µs

RegExp#test

packages/benchmark.js-plugin/benches/sample.ts

-1%

18.6 µs18.8 µs

wait 1sec

packages/vitest-plugin/benches/timing.bench.ts::timing tests

-1%

23 ms23.2 ms

test sync baz 10

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts

-1%

12.3 µs12.4 µs

test sync baz 10

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts

-1%

12.3 µs12.4 µs

wait 1ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

-1%

31 µs31.3 µs

String#indexOf

examples/with-typescript-simple-cjs/benchmark-js.ts

-1%

11 µs11.1 µs

test sync baz 100

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts

-1%

13.6 µs13.8 µs

RegExp#test

examples/with-typescript-simple-cjs/benchmark-js.ts

-1%

18.7 µs18.9 µs

test_iterative_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

-1%

11.9 µs12.1 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

-3%

43.9 µs45.2 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

-4%

46.5 µs48.2 µs

test sync baz 100

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

-5%

31.5 µs33.1 µs

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

-5%

46 µs48.5 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

-5%

43.5 µs45.8 µs

long body

packages/tinybench-plugin/benches/sample.ts

-5%

362 µs382.2 µs

test sync baz 100

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

-6%

31 µs32.9 µs

switch 2

examples/with-typescript-simple-esm/tinybench.ts

-7%

25.7 µs27.6 µs

switch 2

examples/with-javascript-esm/tinybench.js

-7%

25.2 µs27.1 µs

switch 2

examples/with-typescript-simple-cjs/tinybench.ts

-8%

25.6 µs27.8 µs

Commits

Click on a commit to change the comparison range

Base

main

81f0dc9

-50%

refactor(tinybench): share structure across walltime and instrumented

e31ee8b

3 months ago

by GuillaumeLagrange

Home Terms Privacy Docs