cod-1441-accept-simulation-as-a-value-instrumentation-which-is-now - Branch - CodSpeedHQ/codspeed-node

feat: rename instrumentation to simulation

#68Merged

Comparing

cod-1441-accept-simulation-as-a-value-instrumentation-which-is-now

(

635c77c

) with

main

(

2e31d9e

)

-56%

Improvements: 1

Regressions: 3

Untouched: 126

No successful run was found on main ( 635c77c) during the generation of this report, so 2e31d9e was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

Failed

short body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

Regression

-56%

132.9 µs301.3 µs

wait 500ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

Regression

-17%

10.4 ms12.5 ms

wait 500ms

packages/tinybench-plugin/benches/timing.ts::timing

Regression

-30%

8.6 ms12.2 ms

Improved

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

+13%

2 µs1.7 µs

Passed

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

+8%

1.8 µs1.7 µs

test sync baz 10

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

+7%

348 ns324 ns

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

+7%

1.8 µs1.7 µs

switch 2

packages/tinybench-plugin/benches/sample.ts

+7%

180 ns168 ns

test sync baz 100

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

+6%

456 ns432 ns

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite::deeply nested suite

+5%

1.8 µs1.7 µs

test sync baz 10

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

+4%

324 ns312 ns

test_iterative_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

+3%

384 ns372 ns

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

+3%

3.4 µs3.3 µs

long body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

+1%

217.3 µs214.6 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

+1%

217.2 µs214.7 µs

end

packages/vitest-plugin/benches/hooks.bench.ts::hooks

+1%

34.9 µs34.5 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

+1%

2.5 µs2.5 µs

short body

packages/tinybench-plugin/benches/sample.ts

+1%

122 µs121.1 µs

String#indexOf

examples/with-javascript-esm/benchmark-js.js

+1%

11 µs10.9 µs

fibo 10

packages/vitest-plugin/benches/flat.bench.ts::fibo

37.9 µs37.7 µs

one

packages/vitest-plugin/benches/hooks.bench.ts::hooks::run

240.9 µs239.9 µs

test_iterative_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

306.8 µs305.6 µs

switch 2

packages/tinybench-plugin/benches/sample.ts

8.1 µs8 µs

RegExp#test

examples/with-javascript-esm/benchmark-js.js

20.3 µs20.2 µs

test sync baz 100

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts

13.7 µs13.7 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

28.2 µs28.2 µs

wait 1ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

31.1 µs31.1 µs

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

36.8 µs36.8 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

138.6 µs138.3 µs

RegExp#test

packages/benchmark.js-plugin/benches/sample.ts

18.7 µs18.7 µs

wait 1ms

packages/tinybench-plugin/benches/timing.ts::timing

19.8 µs19.8 µs

test_iterative_fibo_100

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

21.2 µs21.1 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

25.4 µs25.4 µs

long body

packages/tinybench-plugin/benches/sample.ts

217.6 µs217.5 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

217.2 µs217 µs

test_recursive_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

248.7 µs248.5 µs

fibo 15

packages/vitest-plugin/benches/flat.bench.ts::fibo

146.6 µs146.6 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

45.2 µs45.2 µs

wait 1ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

1 ms1 ms

long body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

353.4 µs353.2 µs

switch 1

packages/tinybench-plugin/benches/sample.ts

93.3 µs93.3 µs

long body

packages/tinybench-plugin/benches/sample.ts

382.1 µs382 µs

test_recursive_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

1.5 ms1.5 ms

test_recursive_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

1.5 ms1.5 ms

test_iterative_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

190.2 µs190.2 µs

wait 500ms

packages/vitest-plugin/benches/timing.bench.ts::timing tests

500 ms500 ms

switch 1

examples/with-typescript-simple-esm/tinybench.ts

264 ns264 ns

switch 1

examples/with-javascript-esm/tinybench.js

300 ns300 ns

test_iterative_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

372 ns372 ns

test_iterative_fibo_100

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

660 ns660 ns

switch 2

examples/with-typescript-simple-esm/tinybench.ts

300 ns300 ns

switch 1

examples/with-typescript-simple-cjs/tinybench.ts

276 ns276 ns

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr::nested suite

1.8 µs1.8 µs

switch 2

examples/with-typescript-simple-cjs/tinybench.ts

288 ns288 ns

test_recursive_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

2.3 µs2.3 µs

test_iterative_fibo_10

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

12 µs12 µs

short body

packages/benchmark.js-plugin/benches/sample.ts

110.6 µs110.6 µs

test_recursive_cached_fibo_20

examples/with-typescript-cjs/bench/benchmark.js/fibo.bench.ts

30.7 µs30.7 µs

String#indexOf

packages/benchmark.js-plugin/benches/sample.ts

11 µs11 µs

test sync baz 10

examples/with-typescript-cjs/bench/benchmark.js/foobarbaz.bench.ts

12.4 µs12.4 µs

test_recursive_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

28.2 µs28.2 µs

fibo 30

examples/with-typescript-esm/src/fibonacci.bench.ts::recursiveFibonacci

175 ms175 ms

wait 1sec

packages/vitest-plugin/benches/timing.bench.ts::timing tests

1 s1 s

wait 1sec

packages/tinybench-plugin/benches/timing.ts::timing

1 s1 s

wait 500ms

packages/tinybench-plugin/benches/timing.ts::timing

500 ms500 ms

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite::deeply nested suite

89.2 µs89.2 µs

test_recursive_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

1.5 ms1.5 ms

test_recursive_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

1.5 ms1.5 ms

long body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

352.5 µs352.6 µs

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

226.3 µs226.3 µs

test_iterative_fibo_100

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

213 µs213 µs

test sync baz 10

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

199.9 µs199.9 µs

wait 1ms

packages/tinybench-plugin/benches/timing.ts::timing

1 ms1 ms

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

356.6 µs356.7 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr

89 µs89.1 µs

long body

packages/benchmark.js-plugin/benches/sample.ts

320.1 µs320.2 µs

fibo 30

examples/with-typescript-esm/src/fibonacci.bench.ts::recursiveFibonacci

29.5 ms29.6 ms

switch 1

examples/with-javascript-esm/tinybench.js

123.4 µs123.5 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

353.1 µs353.4 µs

end

packages/vitest-plugin/benches/hooks.bench.ts::hooks

209.2 µs209.4 µs

test sync baz 100

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

33 µs33.1 µs

switch 2

examples/with-javascript-esm/tinybench.js

27.2 µs27.2 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr

132.9 µs133 µs

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

48.9 µs48.9 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

45.7 µs45.8 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

48.2 µs48.3 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::another parsePr::nested suite

88.8 µs88.9 µs

short body 3

packages/benchmark.js-plugin/benches/sample.ts

64.2 µs64.3 µs

test_iterative_fibo_100

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

21.2 µs21.3 µs

short body 4

packages/benchmark.js-plugin/benches/sample.ts

59.1 µs59.2 µs

RegExp#test

examples/with-typescript-simple-cjs/benchmark-js.ts

18.8 µs18.9 µs

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

48.4 µs48.5 µs

test_iterative_fibo_100

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

34 µs34.1 µs

test sync baz 100

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

33 µs33.1 µs

short body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

89.7 µs89.9 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

30.7 µs30.8 µs

short body 5

packages/benchmark.js-plugin/benches/sample.ts

59.1 µs59.2 µs

short body 2

packages/benchmark.js-plugin/benches/sample.ts

59.1 µs59.2 µs

switch 2

examples/with-typescript-simple-cjs/tinybench.ts

27.8 µs27.9 µs

switch 2

examples/with-typescript-simple-esm/tinybench.ts

27.5 µs27.6 µs

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

25.4 µs25.5 µs

test_recursive_cached_fibo_30

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

36.8 µs36.9 µs

test_iterative_fibo_10

examples/with-typescript-esm/bench/benchmark.js/fibo.bench.ts

12.1 µs12.2 µs

test sync baz 10

examples/with-typescript-cjs/bench/tinybench/foobarbaz.bench.ts

40.9 µs41 µs

switch 1

examples/with-typescript-simple-esm/tinybench.ts

123.1 µs123.6 µs

test_recursive_cached_fibo_20

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

2.7 µs2.7 µs

test sync baz 10

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts

12.4 µs12.4 µs

String#indexOf

examples/with-typescript-simple-cjs/benchmark-js.ts

-1%

11 µs11.1 µs

fibo 15

packages/vitest-plugin/benches/flat.bench.ts::fibo

-1%

21.5 µs21.6 µs

RegExp#test

examples/with-typescript-simple-esm/benchmark-js.ts

-1%

18.6 µs18.8 µs

two

packages/vitest-plugin/benches/hooks.bench.ts::hooks::run

-1%

202 µs203.3 µs

test_recursive_cached_fibo_30

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

-1%

3.3 µs3.4 µs

String#indexOf

examples/with-typescript-simple-esm/benchmark-js.ts

-1%

11 µs11.1 µs

test sync baz 100

examples/with-typescript-esm/bench/benchmark.js/foobarbaz.bench.ts

-1%

13.2 µs13.3 µs

fibo 10

packages/vitest-plugin/benches/flat.bench.ts::fibo

-1%

2.1 µs2.1 µs

test_iterative_fibo_100

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

-2%

648 ns660 ns

test_recursive_cached_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

-2%

1.1 µs1.1 µs

long body

packages/vitest-plugin/benches/parsePr.bench.ts::parsePr::nested suite

-3%

211.7 µs217.2 µs

test_recursive_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

-3%

2.3 µs2.3 µs

test_recursive_fibo_20

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

-3%

248.3 µs255.8 µs

test_recursive_cached_fibo_10

examples/with-typescript-cjs/bench/tinybench/fibo.bench.ts

-3%

1.1 µs1.1 µs

test_recursive_fibo_10

examples/with-typescript-esm/bench/tinybench/fibo.bench.ts

-4%

138.6 µs144 µs

switch 2

examples/with-javascript-esm/tinybench.js

-4%

300 ns312 ns

switch 1

examples/with-typescript-simple-cjs/tinybench.ts

-4%

124.7 µs130 µs

short body

packages/tinybench-plugin/benches/sample.ts

-4%

1.6 µs1.6 µs

test sync baz 100

examples/with-typescript-esm/bench/tinybench/foobarbaz.bench.ts

-5%

444 ns468 ns

short body

packages/vitest-plugin/benches/flat.bench.ts::parsePr

-8%

1.7 µs1.9 µs

switch 1

packages/tinybench-plugin/benches/sample.ts

-8%

132 ns144 ns

wait 1sec

packages/tinybench-plugin/benches/timing.ts::timing

-9%

21.2 ms23.2 ms

wait 1sec

packages/vitest-plugin/benches/timing.bench.ts::timing tests

-9%

21.2 ms23.3 ms

Commits

Click on a commit to change the comparison range

Base

main

2e31d9e

-55.87%

feat: rename instrumentation to simulation `instrumentation` is still accepted as an input, but it maps to simulation internally, as we plan to phase it out.

635c77c

24 days ago

by GuillaumeLagrange

Home Terms Privacy Docs