egraphs-good
egglog
BlogDocsChangelog

Only run bigger benchmarks in CI

#710
Comparing
saulshanabrook:ignore-small-benchmarks
(
7dc6e67
) with
main
(
b066a52
)
CodSpeed Performance Gauge
+1%
Untouched
20
Skipped
190

Benchmarks

Skipped (190)

Passed

tests[herbie-tutorial]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+3%
9.3 ms9 ms
tests[extract-vec-bench]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+2%
145.5 ms142.8 ms
tests[eggcc-extraction]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+2%
2.9 s2.9 s
tests[repro-665-set-union]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+2%
1.2 s1.1 s
tests[math-microbenchmark]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+2%
8.9 s8.8 s
tests[herbie-tutorial]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+1%
14.2 ms14 ms
tests[repro-665-set-union]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+1%
817.1 ms809 ms
tests[typeinfer]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+1%
354.6 ms351.8 ms
tests[cykjson]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
+1%
315.9 ms314.3 ms
tests[herbie]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
260 ms259.2 ms
tests[extract-vec-bench]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
100.1 ms99.8 ms
tests[python_array_optimize]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
7.5 s7.5 s
tests[typeinfer]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
265.3 ms265.1 ms
tests[math-microbenchmark]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
8.6 s8.6 s
tests[python_array_optimize]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
4.8 s4.8 s
tests[eggcc-extraction]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
2.8 s2.8 s
tests[herbie]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
289.8 ms289.9 ms
tests[stresstest_large_expr]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
1.5 s1.5 s
tests[cykjson]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
0%
477.5 ms477.8 ms
tests[stresstest_large_expr]
benches/ci_benchmarking.rs
CodSpeed Performance Gauge
-2%
1.6 s1.6 s

Commits

Click on a commit to change the comparison range
Base
main
b066a52
+0.67%
Only run bigger benchmarks in CI Only runs the bigger benchmarks in CI so that noise on the small ones doesn't distract on PRs
7e48871
2 days ago
by saulshanabrook
-0.02%
Run math first
7dc6e67
2 days ago
by saulshanabrook
© 2025 CodSpeed Technology
Home Terms Privacy Docs