Learn how to improve your benchmarking process performance
Running benchmarks can be quite long and slow down your CI process. With
CodSpeed, you can run multiple benchmark commands in the same CI workflow. When
running heavy benchmark suites, this can divide the total runtime by the number
of jobs, dramatically speeding up your CI pipeline.
CodSpeed will then aggregate the corresponding results into a single report.
Sharding allows you to run your benchmarks in several commands, with each
command running a subset of your benchmarks.There are two main ways of sharding your benchmarks:
splitting them in several files, and running each file or folder independently
using a sharding tool provided by your benchmarking framework
Check the sharding docs corresponding to your benchmarking framework:
With benchmarks written in several languages, it can be difficult to get a
unified performance overview of your project.With CodSpeed, you can run benchmarks written in multiple languages. When run in
the same CI workflow, CodSpeed will aggregate the results of these benchmarks
into a single report.For example, using pytest and vitest: