Avatar for the zeek user
zeek
spicy
BlogDocsChangelog

Make some `FileCheck` tests more resilient

#2272
Comparing
topic/etyp/filecheck-tests-hardening
(
9b796f2
) with
main
(
b392080
)
CodSpeed Performance Gauge
0%
Untouched
28
Ignored
78

Benchmarks

106 total
Regex][100]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
69.3 µs69.3 µs
Regex][1000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
335.7 µs335.6 µs
UnitVectorLookahead][100]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
166.8 µs166.8 µs
Regex][10000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
3 ms3 ms
Regex][100000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
30.2 ms30.2 ms
UnitVectorLookahead][1000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
1.3 ms1.3 ms
UnitVectorLookahead][100000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
135 ms135 ms
UnitVectorSize][100000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
82.6 ms82.6 ms
iterate_set[len:1]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
590 ns590 ns
iterate_set[len:100]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
4.3 µs4.3 µs
iterate_set[len:1000000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
33.8 ms33.8 ms
iterate_set[len:10000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
339.1 µs339.1 µs
UnitVectorLookahead][10000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
13.2 ms13.2 ms
iterate_map[len:1000000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
41.1 ms41.1 ms
UnitVectorSize][1000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
806.6 µs806.6 µs
UnitVectorSize][10000]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
8 ms8 ms
iterate_bytes[len:1000000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
10.5 ms10.5 ms
iterate_vector[len:1000000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
10 ms10 ms
UnitVectorSize][100]
spicy/runtime/tests/benchmarks/parsing.cc::benchmarkParser[Benchmark
CodSpeed Performance Gauge
0%
112.5 µs112.5 µs
iterate_map[len:10000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
412.7 µs412.7 µs
iterate_bytes[len:10000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
105.6 µs105.7 µs
iterate_vector[len:10000]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
0%
101 µs101 µs
iterate_map[len:100]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
-1%
5.5 µs5.6 µs
iterate_bytes[len:100]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
-1%
2.1 µs2.1 µs
iterate_vector[len:100]
hilti/runtime/src/benchmarks/iteration.cc
CodSpeed Performance Gauge
-1%
2 µs2 µs

Commits

Click on a commit to change the comparison range
Base
main
b392080
-0.4%
Add env var to skip running `FileCheck` tests
9b796f2
3 days ago
by evantypanski
© 2026 CodSpeed Technology
Home Terms Privacy Docs