vortex-data/vortex - CodSpeed

vortex

Blog Docs Changelog

Performance History

Latest Results

fix nits Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>

ct/tq-pull-out

46 minutes ago

fix nits Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>

ct/tq-pull-out

48 minutes ago

change nullability semantics Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>

ct/tq-pull-out

1 hour ago

less stuff Signed-off-by: Adam Gutglick <adam@spiraldb.com>

adamg/execution-tests

3 hours ago

fsst: link tests_large doc comment to tracking issue #7833 Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: mprammer <martin@spiraldb.com>

mp/fsst-i32-overflow-regression-test

3 hours ago

clean up Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>

ct/tq-pull-out

3 hours ago

fsst: regression test for i32 offset overflow in fsst_compress `fsst_compress_iter` (encodings/fsst/src/compress.rs:72) hardcodes `VarBinBuilder::<i32>` for the compressed output, so any input whose cumulative compressed bytes exceed `i32::MAX` panics in `vortex-array/src/arrays/varbin/builder.rs:62` with Other error: Failed to convert sum of N and M to offset of type i32 Hit in practice on a real >4 GiB string column going through `vxio.write`. The bug isn't in the input-conversion path — that's zero-copy and respects the input offset width — so widening the input to `large_string` (i64 offsets) at the pyarrow side does NOT help; FSST's output builder runs either way. Add a stress regression test that constructs a `VarBinArray<i64>` with ~2.5 GiB of high-entropy ASCII (FSST cannot compress it below the i32 ceiling) and runs `fsst_compress` end-to-end. The test currently panics with the documented message; it's wrapped in `#[should_panic]` so the test passes today and trips when the underlying bug is fixed — at which point the maintainer drops `#[should_panic]` and the trailing `assert_eq!(compressed.len(), len)` becomes the live assertion. Gated with `#[test_with::env(CI)]` + `#[test_with::no_env(VORTEX_SKIP_SLOW_TESTS)]` (matching the precedent in vortex-btrblocks/src/schemes/integer.rs:1113) because the test allocates ~5 GiB peak and runs in ~6 s under release. Verified locally: - `cargo test -p vortex-fsst fsst_compress_offsets` → ignored, because variable CI not found - `CI=1 cargo test --release -p vortex-fsst fsst_compress_offsets` → 1 passed (panics as expected, captured by should_panic) - `CI=1 VORTEX_SKIP_SLOW_TESTS=1 cargo test --release -p vortex-fsst fsst_compress_offsets` → ignored, because variable VORTEX_SKIP_SLOW_TESTS was found - `cargo +nightly fmt --all` clean - `cargo clippy -p vortex-fsst --all-targets --all-features` clean Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: mprammer <martin@spiraldb.com>

mp/fsst-i32-overflow-regression-test

3 hours ago

clean up Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>

ct/tq-pull-out

4 hours ago

Latest Branches

0%

TurboQuant again!#7829

49 minutes ago

505dd74

ct/tq-pull-out

+59%

Exectuion and optimization tracing harness for testing#7814

3 hours ago

1538135

adamg/execution-tests

0%

fsst: regression test for i32 offset overflow in fsst_compress#7832

3 hours ago

0cfb69f

mp/fsst-i32-overflow-regression-test

© 2026 CodSpeed Technology

Home Terms Privacy Docs