Avatar for the vortex-data user
vortex-data
vortex
BlogDocsChangelog

Performance History

Latest Results

Add golden-corpus determinism tests for the default compressor (#8697) Tracking Issue: https://github.com/vortex-data/vortex/issues/8701 Closes: https://github.com/vortex-data/vortex/issues/6171 ## Rationale for this change Groundwork for making the compressor's selection policy pluggable (#7697): before any refactoring of scheme selection, pin the compressor's current decisions with reviewable golden snapshots, so each subsequent PR can demonstrate unchanged selection behavior by showing zero snapshot churn. Test-only, and lands first so later PRs diff against a committed baseline. This also closes #6171 by adding dedicated regression coverage for whether the compressor produces the expected array tree, across a representative corpus rather than one-off encoding assertions. ## What changes are included in this PR? A golden test suite in `vortex-btrblocks`: 20 seed-generated corpus entries spanning the registered schemes' habitats, each compressed twice per run (direct determinism check) and snapshotted as its full encoding tree with exact array-level byte counts. Three feature variants cover the default scheme pool, `unstable_encodings`, and `with_compact` (+`zstd`+`pco`). A dedicated `btrblocks-golden` CI job runs all three feature combinations explicitly. The variants are mutually exclusive at compile time (`unstable_encodings` changes `ALL_SCHEMES`), so the existing `--all-features` workspace test jobs compile the `default` variant out, and it would otherwise only run incidentally in the default-features musl job. OnPair is excluded from the golden compressors: its dictionary training is nondeterministic run-to-run (randomly-seeded hash maps in the upstream crate), so it cannot serve as a baseline. That's a pre-existing bug worth its own issue. ## What APIs are changed? Are there any user-facing changes? None (tests and CI only). --------- Signed-off-by: Connor Tsui <connor.tsui20@gmail.com> Co-authored-by: Claude <noreply@anthropic.com>
develop
3 minutes ago
vortex-file: Spawn tasks via runtime instead of directly via tokio
polarsignals:worktree-spawn-rm
26 minutes ago

Latest Branches

CodSpeed Performance Gauge
+9%
Extract scheme-selection policy into a pluggable CostModel#8698
16 minutes ago
7672d77
cost-model-r2-costmodel
CodSpeed Performance Gauge
+3%
vortex-file: Spawn tasks via runtime instead of directly via tokio#8711
32 minutes ago
4b260ab
polarsignals:worktree-spawn-rm
CodSpeed Performance Gauge
0%
© 2026 CodSpeed Technology
Home Terms Privacy Docs