Avatar for the vortex-data user
vortex-data
vortex
BlogDocsChangelog

Add OnPair string compression encoding with predicate pushdown

#7927Closed
Comparing
claude/vortex-array-rust-bindings-FQfIX
(
cd71c15
) with
develop
(
1f6fb0a
)
CodSpeed Performance Gauge
0%
Untouched
1216

Benchmarks

1216 total
map_each[BufferMut<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
+7%
466.1 ns436.9 ns
cuda/bitpacked_u32/unpack/6bw[100M]
vortex-cuda/benches/bitpacked_cuda.rs::benches::benchmark_bitunpack::cuda
CodSpeed Performance Gauge
+5%
1.1 ms1 ms
cuda/dict_256vals_bp8bw_codes/dispatch_u32[100M]
vortex-cuda/benches/dynamic_dispatch_cuda.rs::benches::benchmark_dynamic_dispatch::cuda
CodSpeed Performance Gauge
+5%
1.1 ms1.1 ms
cuda/runend/i32_runlen_1000[100M]
vortex-cuda/benches/runend_cuda.rs::benches::benchmark_runend::cuda
CodSpeed Performance Gauge
-5%
866.6 µs910.6 µs
cuda/alp_f32/0%[100M]
vortex-cuda/benches/alp_cuda.rs::benches::benchmark_alp_decode::cuda
CodSpeed Performance Gauge
-3%
2.4 ms2.5 ms
dict_canonicalize_zipfian[16, 1000]
vortex-array/benches/take_primitive.rs
CodSpeed Performance Gauge
+3%
50.9 µs49.6 µs
encode_varbin[(1000, 8)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
-2%
165.8 µs170 µs
push_vortex_buffer[128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-2%
1.2 µs1.2 µs
push_arrow_buffer[128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-2%
1.2 µs1.3 µs
encode_varbinview[(1000, 512)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
+2%
226.9 µs221.8 µs
push_n_vortex_buffer[u16, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-2%
1.6 µs1.6 µs
transpose_bmi2
encodings/fastlanes/benches/bit_transpose.rs::x86
CodSpeed Performance Gauge
+2%
1.8 µs1.8 µs
untranspose_bmi2
encodings/fastlanes/benches/bit_transpose.rs::x86
CodSpeed Performance Gauge
+2%
1.8 µs1.8 µs
take_map[(0.1, 1.0)]
vortex-array/benches/take_patches.rs
CodSpeed Performance Gauge
+2%
1.7 ms1.6 ms
push_n_vortex_buffer[u64, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-2%
1.9 µs1.9 µs
push_n_vortex_buffer[u8, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-2%
1.9 µs1.9 µs
ScalarBuffer<i32>>, 128]
vortex-buffer/benches/vortex_buffer.rs::map_each[Arrow<arrow_buffer::buffer::scalar
CodSpeed Performance Gauge
-2%
1.9 µs1.9 µs
map_each[Buffer<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
+1%
2.2 µs2.2 µs
map_each[BufferMut<i32>, 1024]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
+1%
2.2 µs2.2 µs
push_n_vortex_buffer[u8, 1024]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-1%
2.2 µs2.3 µs
decode_primitives[f32, (1000, 2)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
-1%
17.7 µs18 µs
encode_primitives[i64, (10000, 512)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
-1%
501.3 µs507.1 µs
decompress_alp[f32, (1000, 0.0, 1.0)]
encodings/alp/benches/alp_compress.rs
CodSpeed Performance Gauge
+1%
10.7 µs10.6 µs
push_n_vortex_buffer[u8, 2048]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-1%
2.6 µs2.7 µs
decompress_alp[f32, (1000, 0.0, 0.25)]
encodings/alp/benches/alp_compress.rs
CodSpeed Performance Gauge
+1%
11.2 µs11.1 µs

Commits

Click on a commit to change the comparison range
Base
develop
1f6fb0a
+0.01%
Add OnPair string array encoding with predicate pushdown
d65969b
28 days ago
by claude
-16.94%
Add 100k-row smoke test for OnPair encoding
0fb5929
28 days ago
by claude
+16.93%
Refactor OnPair to FSST-shape: dict-as-blob, u16 codes child, Rust decode
87f217f
28 days ago
by claude
0%
Wire OnPair as a btrblocks string scheme
70947a8
28 days ago
by claude
-0.02%
Make OnPair the default string-fragmentation scheme + register globally
803bc4e
28 days ago
by claude
+0.02%
Move OnPair default-feature flag up to the vortex umbrella crate
6a9a2a2
28 days ago
by claude
+0.02%
Round out OnPair CI: widen-on-decode + public-api locks + lints
7ae6718
28 days ago
by claude
-0.02%
Add file-write roundtrip skeleton + track Misaligned buffer follow-up
83651e4
28 days ago
by claude
0%
OnPair layout v3: all integer arrays as buffers, file roundtrip works
f0e03a3
28 days ago
by claude
+0.01%
Wire the OnPair roundtrip suite through the full Vortex session
15b7300
28 days ago
by claude
-16.89%
SIMD-friendly OnPair decode + divan bench
d229d6e
28 days ago
by claude
+16.9%
Fix Misaligned buffer on read by reordering OnPair buffers
5432766
28 days ago
by claude
-0.02%
OnPair: FSST-shape ABI — codes / codes_offsets / dict_offsets as slot children
d9a6c8c
28 days ago
by claude
-0.01%
OnPair decoder: combined (offset|length) table + skip canonicalize double-copy
15569bb
28 days ago
by claude
-16.84%
OnPair decoder: drop redundant dict_offsets widen + tighter hot path
adeda19
28 days ago
by claude
+0.01%
OnPair: filter shares dict (TPC-H Q22 SF=10 fix) + token-aware predicates + memchr contains
53c3ea4
28 days ago
by claude
-0.02%
OnPair: drop Like pushdown for now, keep Compare token-aware path
18f0cf2
28 days ago
by claude
+16.86%
OnPair: fast LIKE on compressed codes (PrefixAutomaton + bloom + filter ptype fix)
87011ec
28 days ago
by claude
0%
OnPair: regression tests for narrowed codes_offsets in filter
a1ba67f
28 days ago
by claude
0%
OnPair: drop `%contains%` pushdown (fall through to canonical decode), fix lint
c3bcb2e
27 days ago
by claude
+0.01%
OnPair: FineWeb-shape bench + decode-vs-fallback measurements
cd71c15
27 days ago
by claude
© 2026 CodSpeed Technology
Home Terms Privacy Docs