cod-1066-tinybench-nodejs-support-for-the-walltime-executor - Branch - CodSpeedHQ/codspeed-node

CodSpeedHQ

codspeed-node

Instrumentation

Wall Time

Blog Docs Changelog

Bump node, bump tinybench, and add support of walltime runs for tinybench

#48

Comparing

cod-1066-tinybench-nodejs-support-for-the-walltime-executor

(

bfb95e2

) with

main

(

6df11e8

)

-96%

Improvements: 10

Regressions: 22

Untouched: 50

New: 3

Dropped: 4

Ignored: 0

Benchmarks

Improved

fibo 15

packages/vitest-plugin/benches/flat.bench.ts::fibo::fibo 15

+95%

285 µs

145.9 µs

test_recursive_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts::test_recursive_fibo_10

+60%

34.6 µs

21.7 µs

short body

packages/tinybench-plugin/benches/sample.ts::short body

+32%

134.4 µs

101.9 µs

two

packages/vitest-plugin/benches/hooks.bench.ts::hooks cleanup::run::two

+19%

128.9 µs

108.7 µs

long body

packages/tinybench-plugin/benches/sample.ts::long body

+15%

415.9 µs

361.4 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite::deeply nested suite::short body

+14%

100.3 µs

87.8 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr::nested suite::short body

+14%

100.2 µs

87.8 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr::short body

+14%

100.2 µs

87.8 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite::short body

+14%

100.2 µs

88.1 µs

one

packages/vitest-plugin/benches/hooks.bench.ts::hooks cleanup::run::one

+10%

119.8 µs

108.6 µs

New

wait 1ms

packages/tinybench-plugin/benches/timing.ts::timing::wait 1ms

N/A

23.9 µs

wait 1sec

packages/tinybench-plugin/benches/timing.ts::timing::wait 1sec

N/A

12.3 ms

wait 500ms

packages/tinybench-plugin/benches/timing.ts::timing::wait 500ms

N/A

12.3 ms

Passed

RegExp#testMissing

examples/with-javascript-cjs/benchmark-js.js::RegExp#test

N/A

14 µs

N/A

String#indexOfMissing

examples/with-javascript-cjs/benchmark-js.js::String#indexOf

N/A

10.3 µs

N/A

switch 1Missing

examples/with-javascript-cjs/tinybench.js::switch 1

N/A

11.9 µs

N/A

switch 2Missing

examples/with-javascript-cjs/tinybench.js::switch 2

N/A

12.3 µs

N/A

end

packages/vitest-plugin/benches/hooks.bench.ts::hooks cleanup::end

+10%

135.4 µs

123.5 µs

one

packages/vitest-plugin/benches/hooks.bench.ts::level1::level 2 bench nested beforeAll::one

+9%

145.7 µs

133 µs

two

packages/vitest-plugin/benches/hooks.bench.ts::level1::two

+9%

136.6 µs

125 µs

five

packages/vitest-plugin/benches/hooks.bench.ts::level1::level 2::five

+9%

156.2 µs

143.5 µs

three

packages/vitest-plugin/benches/hooks.bench.ts::level1::three

+8%

153.2 µs

141.4 µs

seven

packages/vitest-plugin/benches/hooks.bench.ts::level1::level 2::level 3::seven

+8%

152.8 µs

141.2 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::long body

+7%

375.3 µs

352.3 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr::long body

+7%

374.2 µs

351.4 µs

long body

packages/vitest-plugin/benches/flat.bench.ts::parsePr::long body

+6%

375.3 µs

352.4 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::short body

+6%

133.8 µs

126.4 µs

short body

packages/vitest-plugin/benches/flat.bench.ts::parsePr::short body

+6%

133.7 µs

126.6 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite::long body

+5%

374.3 µs

355.4 µs

RegExp#test

examples/with-javascript-esm/benchmark-js.js::RegExp#test

+4%

14.2 µs

13.6 µs

one

packages/vitest-plugin/benches/hooks.bench.ts::one

+4%

337.9 µs

325.6 µs

long body

packages/benchmark.js-plugin/benches/sample.ts::long body

+4%

331.2 µs

319.5 µs

test_recursive_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts::test_recursive_fibo_10

+3%

40.4 µs

39.2 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts::test_recursive_fibo_10

+3%

40.3 µs

39.3 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts::test_recursive_cached_fibo_10

+2%

25.2 µs

24.7 µs

RegExp#test

packages/benchmark.js-plugin/benches/sample.ts::RegExp#test

+2%

12.3 µs

12 µs

short body 2

packages/benchmark.js-plugin/benches/sample.ts::short body 2

+2%

59.4 µs

58.4 µs

short body 4

packages/benchmark.js-plugin/benches/sample.ts::short body 4

+2%

59.3 µs

58.4 µs

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts::test_recursive_cached_fibo_10

+1%

25.1 µs

24.8 µs

short body 5

packages/benchmark.js-plugin/benches/sample.ts::short body 5

+1%

59.3 µs

58.4 µs

RegExp#test

examples/with-typescript-simple-cjs/benchmark-js.ts::RegExp#test

+1%

12.1 µs

12 µs

RegExp#test

examples/with-typescript-simple-esm/benchmark-js.ts::RegExp#test

+1%

12.2 µs

12.1 µs

fibo 10

examples/with-typescript-esm/src/fibonacci.bench.ts::iterativeFibonacci::fibo 10

+1%

15.1 µs

14.9 µs

String#indexOf

examples/with-javascript-esm/benchmark-js.js::String#indexOf

+1%

10.3 µs

10.2 µs

String#indexOf

examples/with-typescript-simple-cjs/benchmark-js.ts::String#indexOf

+1%

10.3 µs

10.2 µs

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts::test_recursive_cached_fibo_30

+1%

36.3 µs

36.1 µs

String#indexOf

packages/benchmark.js-plugin/benches/sample.ts::String#indexOf

+1%

10.3 µs

fibo 10

packages/vitest-plugin/benches/flat.bench.ts::fibo::fibo 10

+1%

37 µs

36.8 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts::test_recursive_cached_fibo_20

30.1 µs

30 µs

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts::test_recursive_cached_fibo_30

36.2 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts::test_recursive_cached_fibo_20

30 µs

30.1 µs

String#indexOf

examples/with-typescript-simple-esm/benchmark-js.ts::String#indexOf

10.3 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts::test_recursive_fibo_10

21.5 µs

21.6 µs

test sync baz 100

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts::test sync baz 100

-1%

12.9 µs

13 µs

test sync baz 10

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts::test sync baz 10

-1%

11.4 µs

11.5 µs

test_recursive_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts::test_recursive_fibo_20

-1%

1.5 ms

test_recursive_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts::test_recursive_fibo_20

-1%

1.5 ms

test_recursive_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts::test_recursive_fibo_20

-2%

1.5 ms

test_recursive_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts::test_recursive_fibo_20

-2%

1.5 ms

test_iterative_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts::test_iterative_fibo_10

-2%

11 µs

11.2 µs

test sync baz 100

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts::test sync baz 100

-4%

12.1 µs

12.6 µs

test sync baz 10

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts::test sync baz 10

-4%

11.3 µs

11.7 µs

test_iterative_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts::test_iterative_fibo_10

-5%

10.8 µs

11.3 µs

test_iterative_fibo_100

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts::test_iterative_fibo_100

-5%

19.3 µs

20.4 µs

test_iterative_fibo_100

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts::test_iterative_fibo_100

-7%

19.2 µs

20.5 µs

short body 3

packages/benchmark.js-plugin/benches/sample.ts::short body 3

-7%

59.3 µs

63.6 µs

short body

packages/benchmark.js-plugin/benches/sample.ts::short body

-7%

101.7 µs

109.8 µs

test_recursive_cached_fibo_30Regression

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts::test_recursive_cached_fibo_30

-10%

41.8 µs

46.7 µs

test_recursive_cached_fibo_20Regression

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts::test_recursive_cached_fibo_20

-17%

35.6 µs

43 µs

test_recursive_cached_fibo_20Regression

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts::test_recursive_cached_fibo_20

-17%

35.7 µs

43.1 µs

test sync baz 100Regression

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts::test sync baz 100

-25%

22.8 µs

30.6 µs

test_recursive_cached_fibo_10Regression

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts::test_recursive_cached_fibo_10

-32%

30.6 µs

45.2 µs

test_recursive_cached_fibo_10Regression

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts::test_recursive_cached_fibo_10

-33%

30.6 µs

45.7 µs

test sync baz 100Regression

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts::test sync baz 100

-42%

17.7 µs

30.4 µs

test_iterative_fibo_10Regression

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts::test_iterative_fibo_10

-42%

16.5 µs

28.5 µs

switch 2Regression

examples/with-javascript-esm/tinybench.js::switch 2

-50%

12.4 µs

24.5 µs

switch 1Regression

examples/with-javascript-esm/tinybench.js::switch 1

-50%

11.9 µs

23.6 µs

switch 2Regression

packages/tinybench-plugin/benches/sample.ts::switch 2

-50%

12.3 µs

24.6 µs

switch 2Regression

examples/with-typescript-simple-cjs/tinybench.ts::switch 2

-51%

12.2 µs

24.6 µs

switch 1Regression

packages/tinybench-plugin/benches/sample.ts::switch 1

-51%

11.8 µs

24.2 µs

switch 1Regression

examples/with-typescript-simple-cjs/tinybench.ts::switch 1

-51%

11.7 µs

24.1 µs

switch 2Regression

examples/with-typescript-simple-esm/tinybench.ts::switch 2

-52%

12.2 µs

25.2 µs

switch 1Regression

examples/with-typescript-simple-esm/tinybench.ts::switch 1

-52%

11.7 µs

24.3 µs

test sync baz 10Regression

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts::test sync baz 10

-56%

17 µs

38.3 µs

test_recursive_cached_fibo_30Regression

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts::test_recursive_cached_fibo_30

-81%

41.7 µs

216.6 µs

test_iterative_fibo_100Regression

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts::test_iterative_fibo_100

-88%

24.8 µs

202.5 µs

test sync baz 10Regression

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts::test sync baz 10

-92%

16.1 µs

209.6 µs

test_iterative_fibo_100Regression

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts::test_iterative_fibo_100

-95%

24.7 µs

465.2 µs

test_iterative_fibo_10Regression

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts::test_iterative_fibo_10

-96%

16.5 µs

453.2 µs

Commits

Click on a commit to change the comparison range

Base

main

6df11e8

-96%

feat(tinybench-plugin): support bench.name opts

bfb95e2

3 days ago

by adriencaccia

Home Terms Privacy Docs