Avatar for the vortex-data user
vortex-data
vortex
BlogDocsChangelog

feat: implement DuckDB filesystem integration for Vortex file handling

#6198Merged
Comparing
Lychee-Technology:develop
(
8354deb
) with
develop
(
3029e9b
)
CodSpeed Performance Gauge
0%
Untouched
1057
Skipped
1346

Benchmarks

2403 total
true_count_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+6%
976.1 ns917.8 ns
true_count_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+6%
1.1 µs1 µs
true_count_arrow_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+5%
1.2 µs1.2 µs
map_each[BufferMut<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
+4%
828.9 ns799.7 ns
chunked_dict_primitive_canonical_into[f32, (1000, 10, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+3%
96 µs92.9 µs
value_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+3%
1.1 µs1.1 µs
compress[(10000, 4)]
encodings/runend/benches/run_end_compress.rs
CodSpeed Performance Gauge
+3%
298.5 µs290.8 µs
compress[(100000, 4)]
encodings/runend/benches/run_end_compress.rs
CodSpeed Performance Gauge
+3%
3 ms2.9 ms
chunked_dict_primitive_canonical_into[u32, (1000, 10, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+3%
95.7 µs93.3 µs
chunked_dict_primitive_canonical_into[f32, (1000, 1000, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+2%
114.5 µs112 µs
chunked_dict_primitive_canonical_into[u32, (1000, 1000, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+2%
114 µs111.7 µs
append_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+2%
1.5 µs1.4 µs
decompress[u32, (1000, 16)]
encodings/runend/benches/run_end_compress.rs
CodSpeed Performance Gauge
+2%
23.7 µs23.3 µs
take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs
CodSpeed Performance Gauge
+2%
31.4 µs30.9 µs
chunked_dict_primitive_into_canonical[f32, (1000, 1000, 100)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+2%
975.5 µs958.4 µs
iter_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+2%
1.7 µs1.7 µs
true_count_arrow_buffer[16384]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+2%
3.6 µs3.6 µs
chunked_dict_primitive_into_canonical[f32, (1000, 100, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+2%
107.3 µs105.7 µs
chunked_dict_primitive_canonical_into[f32, (1000, 100, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+1%
95.3 µs93.9 µs
patched_take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs
CodSpeed Performance Gauge
+1%
38.4 µs37.9 µs
chunked_dict_primitive_canonical_into[u64, (1000, 100, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+1%
140.2 µs138.5 µs
chunked_dict_primitive_into_canonical[f64, (1000, 1000, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+1%
184.4 µs182.2 µs
chunked_dict_primitive_canonical_into[u64, (1000, 10, 100)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+1%
1.2 ms1.2 ms
train_compressor[(10000, 64, 4)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
+1%
4.7 ms4.7 ms
train_compressor[(10000, 64, 8)]
encodings/fsst/benches/fsst_compress.rs
CodSpeed Performance Gauge
+1%
4.8 ms4.7 ms

Commits

Click on a commit to change the comparison range
Base
develop
3029e9b
-0.01%
refactor: simplify open_file function by letting duckdb handles all schemas.
b2db9de
12 days ago
+0.05%
fix: change DuckDbFsWriter handle to Arc<FsFileHandle> for thread safety and update write/flush methods to use spawn_blocking
8354deb
9 days ago
by iceboundrock
© 2026 CodSpeed Technology
Home Terms Privacy Docs