Avatar for the vortex-data user
vortex-data
vortex
BlogDocsChangelog

fix: canonicalize VarBin/FSST with >2GB buffers

#5961Merged
Comparing
fsst-canonical
(
78cea9c
) with
develop
(
5483037
)
CodSpeed Performance Gauge
-30%
Untouched
842
Archived
1666

Benchmarks

2508 total
binary_search_std
vortex-array/benches/search_sorted.rs
CodSpeed Performance Gauge
+9%
741.4 ns683.1 ns
decompress_fsst[(10000, 4, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-8%
726.4 µs790.2 µs
null_count_run_end[(10000, 1024, 0.01)]
encodings/runend/benches/run_end_null_count.rs
CodSpeed Performance Gauge
+8%
3.5 µs3.3 µs
null_count_run_end[(100000, 1024, 0.01)]
encodings/runend/benches/run_end_null_count.rs
CodSpeed Performance Gauge
+8%
3.5 µs3.3 µs
null_count_run_end[(10000, 256, 0.01)]
encodings/runend/benches/run_end_null_count.rs
CodSpeed Performance Gauge
+8%
3.6 µs3.3 µs
chunked_canonicalize_into[(10, 10000, 4, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-8%
7.5 ms8.2 ms
decompress_fsst[(10000, 4, 8)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-8%
747 µs809.2 µs
decompress_fsst[(1000, 4, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-8%
87.9 µs95.2 µs
chunked_into_canonical[(10, 10000, 4, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-8%
7.5 ms8.1 ms
decompress_fsst[(1000, 4, 8)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-7%
91.1 µs98.2 µs
true_count_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+6%
976.1 ns917.8 ns
chunked_into_canonical[(1000, 50, 8, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-6%
7.2 ms7.7 ms
chunked_canonicalize_into[(1000, 50, 8, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-6%
7.2 ms7.7 ms
decompress_fsst[(1000, 16, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-6%
127 µs134.5 µs
decompress_fsst[(10000, 16, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
1.1 ms1.2 ms
decompress_fsst[(1000, 16, 8)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
137.4 µs145 µs
chunked_into_canonical[(1000, 50, 8, 16)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
8.3 ms8.8 ms
chunked_canonicalize_into[(10, 10000, 16, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
11.4 ms12 ms
chunked_canonicalize_into[(1000, 50, 8, 16)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
8.3 ms8.8 ms
chunked_into_canonical[(10, 10000, 16, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
11.4 ms12 ms
canonicalize_compare[(10000, 4, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
1.2 ms1.3 ms
chunked_into_canonical[(1000, 100, 16, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
14.3 ms15.1 ms
canonicalize_compare[(10000, 4, 8)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
1.3 ms1.3 ms
decompress_fsst[(10000, 16, 8)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
-5%
1.2 ms1.3 ms
take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs
CodSpeed Performance Gauge
+5%
24.2 µs23.1 µs

Commits

Click on a commit to change the comparison range
Base
develop
5483037
-0.12%
fix: FSST canonicalize when > 2GB of buffers
469d55b
5 months ago
by a10y
+0.28%
extract out build_views to use with varbin
b504028
5 months ago
by a10y
-29.91%
move unit test
78cea9c
5 months ago
by a10y
© 2026 CodSpeed Technology
Home Terms Privacy Docs