cod-241-vitest-nodejs-support-for-the-walltime-executor - Branch - CodSpeedHQ/codspeed-node

Add walltime support for vitest plugin

#49Merged

Comparing

cod-241-vitest-nodejs-support-for-the-walltime-executor

(

c9d2169

) with

main

(

bfb95e2

)

-67%

Improvements: 2

Regressions: 2
(
2
)

Untouched: 71

New: 7

Dropped: 10
(
10
)

This report only contains results for the CPU Simulation instrument. To view results for the Wall Time instrument, click here.

Benchmarks

Improved

test_iterative_fibo_100

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

+65%

465.2 µs282.1 µs

wait 500ms

packages/tinybench-plugin/benches/timing.ts::timing

+13%

12.3 ms10.8 ms

New

one

packages/vitest-plugin/benches/hooks.bench.ts::hooks::run

N/A

N/A228.2 µs

two

packages/vitest-plugin/benches/hooks.bench.ts::hooks::run

N/A

N/A200.5 µs

end

packages/vitest-plugin/benches/hooks.bench.ts::hooks

N/A

N/A207.9 µs

wait 500ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

N/A

N/A12.1 ms

wait 1ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

N/A

N/A24.3 µs

wait 1sec

packages/vitest-plugin/benches/timing.bench.ts::timing tests

N/A

N/A23 ms

fibo 30

examples/with-typescript-esm/src/fibonacci.bench.ts::recursiveFibonacci

N/A

N/A175 ms

Passed

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

+5%

216.6 µs206.4 µs

test_iterative_fibo_100

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

+4%

202.5 µs195.4 µs

test sync baz 10

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

+4%

209.6 µs202.5 µs

String#indexOf

examples/with-typescript-simple-esm/benchmark-js.ts

+1%

10.3 µs10.2 µs

switch 2

examples/with-typescript-simple-esm/tinybench.ts

+1%

25.2 µs25 µs

switch 1

examples/with-typescript-simple-esm/tinybench.ts

+1%

24.3 µs24.1 µs

test_iterative_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

+1%

28.5 µs28.3 µs

test sync baz 10

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts

11.7 µs11.7 µs

RegExp#test

examples/with-typescript-simple-esm/benchmark-js.ts

12.1 µs12 µs

test sync baz 100

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts

12.6 µs12.5 µs

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

46.7 µs46.5 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

43 µs42.9 µs

test_recursive_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

21.7 µs21.6 µs

short body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

126.6 µs126.3 µs

test_iterative_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

11.2 µs11.2 µs

test_iterative_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

11.3 µs11.3 µs

wait 1ms

packages/tinybench-plugin/benches/timing.ts::timing

23.9 µs23.8 µs

test sync baz 100

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts

13 µs12.9 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

39.3 µs39.2 µs

test_iterative_fibo_100

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

20.4 µs20.3 µs

test_iterative_fibo_100

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

20.5 µs20.5 µs

switch 1

packages/tinybench-plugin/benches/sample.ts

24.2 µs24.2 µs

short body

packages/tinybench-plugin/benches/sample.ts

101.9 µs101.8 µs

long body

packages/tinybench-plugin/benches/sample.ts

361.4 µs361.2 µs

short body 5

packages/benchmark.js-plugin/benches/sample.ts

58.4 µs58.4 µs

short body 2

packages/benchmark.js-plugin/benches/sample.ts

58.4 µs58.4 µs

short body 4

packages/benchmark.js-plugin/benches/sample.ts

58.4 µs58.4 µs

short body

packages/benchmark.js-plugin/benches/sample.ts

109.8 µs109.8 µs

test_recursive_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

1.5 ms1.5 ms

long body

packages/benchmark.js-plugin/benches/sample.ts

319.5 µs319.5 µs

switch 1

examples/with-javascript-esm/tinybench.js

23.6 µs23.6 µs

switch 2

examples/with-javascript-esm/tinybench.js

24.5 µs24.5 µs

test_recursive_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

1.5 ms1.5 ms

test_recursive_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

1.5 ms1.5 ms

test sync baz 10

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts

11.5 µs11.5 µs

switch 2

packages/tinybench-plugin/benches/sample.ts

24.6 µs24.6 µs

RegExp#test

packages/benchmark.js-plugin/benches/sample.ts

12 µs12 µs

String#indexOf

packages/benchmark.js-plugin/benches/sample.ts

10.3 µs10.3 µs

test_recursive_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

1.5 ms1.5 ms

test sync baz 100

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

30.4 µs30.4 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

352.3 µs352.4 µs

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

36.2 µs36.2 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

126.4 µs126.4 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

355.4 µs355.6 µs

fibo 15

packages/vitest-plugin/benches/flat.bench.ts::fibo

145.9 µs146 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

351.4 µs351.6 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr::nested suite

87.8 µs87.9 µs

long body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

352.4 µs352.7 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

30 µs30.1 µs

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

24.8 µs24.8 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

21.6 µs21.6 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

43.1 µs43.2 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

30.1 µs30.1 µs

RegExp#test

examples/with-javascript-esm/benchmark-js.js

13.6 µs13.6 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

87.8 µs88 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

24.7 µs24.7 µs

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

36.1 µs36.1 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

45.7 µs45.9 µs

String#indexOf

examples/with-javascript-esm/benchmark-js.js

10.2 µs10.3 µs

switch 2

examples/with-typescript-simple-cjs/tinybench.ts

24.6 µs24.7 µs

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

45.2 µs45.3 µs

switch 1

examples/with-typescript-simple-cjs/tinybench.ts

24.1 µs24.1 µs

test_recursive_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

39.2 µs39.4 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite::deeply nested suite

-1%

87.8 µs88.2 µs

RegExp#test

examples/with-typescript-simple-cjs/benchmark-js.ts

-1%

12 µs12 µs

fibo 10

packages/vitest-plugin/benches/flat.bench.ts::fibo

-1%

36.8 µs37 µs

String#indexOf

examples/with-typescript-simple-cjs/benchmark-js.ts

-1%

10.2 µs10.3 µs

test sync baz 100

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

-1%

30.6 µs30.8 µs

test sync baz 10

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

-1%

38.3 µs38.7 µs

test_iterative_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

-1%

453.2 µs457.6 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

-1%

88.1 µs88.9 µs

wait 1sec

packages/tinybench-plugin/benches/timing.ts::timing

Regression

-46%

12.3 ms23 ms

short body 3

packages/benchmark.js-plugin/benches/sample.ts

Regression

-67%

63.6 µs191.6 µs

fibo 10

examples/with-typescript-esm/src/fibonacci.bench.ts::iterativeFibonacci

Missing

N/A

14.9 µsN/A

one

packages/vitest-plugin/benches/hooks.bench.ts::hooks cleanup::run

Missing

N/A

108.6 µsN/A

two

packages/vitest-plugin/benches/hooks.bench.ts::hooks cleanup::run

Missing

N/A

108.7 µsN/A

three

packages/vitest-plugin/benches/hooks.bench.ts::level1

Missing

N/A

141.4 µsN/A

five

packages/vitest-plugin/benches/hooks.bench.ts::level1::level 2

Missing

N/A

143.5 µsN/A

end

packages/vitest-plugin/benches/hooks.bench.ts::hooks cleanup

Missing

N/A

123.5 µsN/A

one

packages/vitest-plugin/benches/hooks.bench.ts::level1::level 2 bench nested beforeAll

Missing

N/A

133 µsN/A

one

packages/vitest-plugin/benches/hooks.bench.ts

Missing

N/A

325.6 µsN/A

seven

packages/vitest-plugin/benches/hooks.bench.ts::level1::level 2::level 3

Missing

N/A

141.2 µsN/A

two

packages/vitest-plugin/benches/hooks.bench.ts::level1

Missing

N/A

125 µsN/A

Commits

Click on a commit to change the comparison range

Base

cod-1066-tinybench-nodejs-support-for-the-walltime-executor

bfb95e2

-14.29%

chore(with-typescript-esm): switch vitest bench to recursiveFibo

c9d2169

5 months ago

by adriencaccia

Home Terms Privacy Docs