ci: improve benchmarks stability(#18728)

Merged
Merging
art049:fix/improve-benchmarks-stability
into
main
-35%
IMPROVEMENTS
0
REGRESSIONS
1
UNTOUCHED
2
NEW
0
DROPPED
0

Benchmarks

Failing

client generation ~50 Models
Regression
packages/client/src/__tests__/benchmarks/huge-schema/huge-schema.bench.ts::typescript::client generation ~50 Models
-35%
6.1 s
9.4 s

Passing

typescript compilation ~50 Models
packages/client/src/__tests__/benchmarks/huge-schema/huge-schema.bench.ts::typescript::typescript compilation ~50 Models
-33%
66.4 ms
98.9 ms
client generation 100 models with relations
packages/client/src/__tests__/benchmarks/lots-of-relations/lots-of-relations.bench.ts::typescript::client generation 100 models with relations
+11%
61.2 s
55.3 s

Commits

Click on a commit to change the comparison range
feat(scripts): run all benchmarks even if one fails (#18558) Run all bechmarks and only print failures rather than exiting as soon as one benchmark fails, and only then throw an error if there were failures. This makes the benchmark runner behave more similarly to a test runner, and it will prevent CodSpeed from marking other benchmarks as "dropped" when one of them crashes.
base
1c731aa
7 months ago by aqrln
-46%
fix: improve benchmarks stability
1f0c40f
8 months ago by art049
+6%
Merge branch 'main' into fix/improve-benchmarks-stability
894bb25
7 months ago by aqrln
+4%
Merge branch 'main' into fix/improve-benchmarks-stability
c4ee4ed
7 months ago by aqrln
ResourcesHomePricingDocsBlogGitHub
Copyright © 2023 CodSpeed Technology SAS. All rights reserved.