Latest Results
Add golden-corpus determinism tests for the default compressor (#8697)
Tracking Issue: https://github.com/vortex-data/vortex/issues/8701
Closes: https://github.com/vortex-data/vortex/issues/6171
## Rationale for this change
Groundwork for making the compressor's selection policy pluggable
(#7697): before any refactoring of scheme selection, pin the
compressor's current decisions with reviewable golden snapshots, so each
subsequent PR can demonstrate unchanged selection behavior by showing
zero snapshot churn. Test-only, and lands first so later PRs diff
against a committed baseline.
This also closes #6171 by adding dedicated regression coverage for
whether the compressor produces the expected array tree, across a
representative corpus rather than one-off encoding assertions.
## What changes are included in this PR?
A golden test suite in `vortex-btrblocks`: 20 seed-generated corpus
entries spanning the registered schemes' habitats, each compressed twice
per run (direct determinism check) and snapshotted as its full encoding
tree with exact array-level byte counts. Three feature variants cover
the default scheme pool, `unstable_encodings`, and `with_compact`
(+`zstd`+`pco`).
A dedicated `btrblocks-golden` CI job runs all three feature
combinations explicitly. The variants are mutually exclusive at compile
time (`unstable_encodings` changes `ALL_SCHEMES`), so the existing
`--all-features` workspace test jobs compile the `default` variant out,
and it would otherwise only run incidentally in the default-features
musl job.
OnPair is excluded from the golden compressors: its dictionary training
is nondeterministic run-to-run (randomly-seeded hash maps in the
upstream crate), so it cannot serve as a baseline. That's a pre-existing
bug worth its own issue.
## What APIs are changed? Are there any user-facing changes?
None (tests and CI only).
---------
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com> Latest Branches
+9%
+3%
polarsignals:worktree-spawn-rm 0%
© 2026 CodSpeed Technology