Avatar for the prisma user
prisma
prisma
BlogDocsChangelog

feat(scripts): run all benchmarks even if one fails

#18558Merged
Comparing
aqrln/bench-run-all
(
99a338c
) with
main
(
b990cf0
)
CodSpeed Performance Gauge
-26%
Improvements
0
Regressions
1
Untouched
2
New
0
Dropped
0
Ignored
0

Benchmarks

Failed

typescript compilation ~50 ModelsRegression
packages/client/src/__tests__/benchmarks/huge-schema/huge-schema.bench.ts::typescript::typescript compilation ~50 Models
CodSpeed Performance Gauge
-26%
9.5 ms
12.9 ms

Passed

client generation 100 models with relations
packages/client/src/__tests__/benchmarks/lots-of-relations/lots-of-relations.bench.ts::typescript::client generation 100 models with relations
CodSpeed Performance Gauge
+1%
11.7 s
11.6 s
client generation ~50 Models
packages/client/src/__tests__/benchmarks/huge-schema/huge-schema.bench.ts::typescript::client generation ~50 Models
CodSpeed Performance Gauge
-15%
1.1 s
1.3 s

Commits

Click on a commit to change the comparison range
Base
main
b990cf0
-26%
feat(scripts): run all benchmarks even if one fails Run all bechmarks and only print failures rather than exiting as soon as one benchmark fails, and only then throw an error if there were failures. This makes the benchmark runner behave more similarly to a test runner, and it will prevent CodSpeed from marking other benchmarks as "dropped" when one of them crashes.
99a338c
2 years ago
by aqrln
© 2025 CodSpeed Technology
Home Terms Privacy Docs