Avatar for the vortex-data user
vortex-data
vortex
BlogDocsChangelog

spark: pass format options into reader

#7160Merged
Comparing
aduffy/spark-props
(
64c3336
) with
develop
(
8aae4ba
)
CodSpeed Performance Gauge
-16%
Regression
3
Untouched
1103
Skipped
1522

Benchmarks

2628 total
bitwise_not_vortex_buffer_mut[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
-16%
317.8 ns376.1 ns
bitwise_not_vortex_buffer_mut[1024]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
-11%
477.2 ns535.6 ns
map_each[BufferMut<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
-10%
770.6 ns858.1 ns
binary_search_std
vortex-array/benches/search_sorted.rs
CodSpeed Performance Gauge
+6%
553.6 ns524.4 ns
set_indices_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+5%
1.3 µs1.2 µs
encode_varbin[(10000, 8)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
+4%
1.5 ms1.5 ms
binary_search_vortex
vortex-array/benches/search_sorted.rs
CodSpeed Performance Gauge
+4%
807.2 ns778.1 ns
take_map[(0.005, 0.1)]
vortex-array/benches/take_patches.rs
CodSpeed Performance Gauge
+3%
292.2 µs283.9 µs
value_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+3%
1.1 µs1.1 µs
map_each[Buffer<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
+2%
2.5 µs2.5 µs
append_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+2%
1.5 µs1.4 µs
iter_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+2%
1.6 µs1.6 µs
untranspose_bmi2
encodings/fastlanes/benches/bit_transpose.rs::x86
CodSpeed Performance Gauge
+2%
1.8 µs1.8 µs
take_map[(0.1, 0.5)]
vortex-array/benches/take_patches.rs
CodSpeed Performance Gauge
+2%
2.1 ms2 ms
bitwise_not_vortex_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+1%
4 µs3.9 µs
bitwise_not_vortex_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+1%
4.2 µs4.2 µs
take_map[(0.01, 1.0)]
vortex-array/benches/take_patches.rs
CodSpeed Performance Gauge
+1%
2.5 ms2.5 ms
append_buffer_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+1%
4.5 µs4.4 µs
take_map[(0.01, 0.05)]
vortex-array/benches/take_patches.rs
CodSpeed Performance Gauge
+1%
200.6 µs198 µs
old_alp_prim_test_between[f64, 2048]
encodings/fastlanes/benches/compute_between.rs::alp
CodSpeed Performance Gauge
+1%
149.9 µs148 µs
bitwise_not_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+1%
4.7 µs4.6 µs
bench_compare_primitive[(10000, 8)]
vortex-array/benches/dict_compare.rs
CodSpeed Performance Gauge
+1%
137.8 µs136.3 µs
take_map[(0.1, 1.0)]
vortex-array/benches/take_patches.rs
CodSpeed Performance Gauge
+1%
3.5 ms3.5 ms
push_n_vortex_buffer[u32, 128]
vortex-buffer/benches/vortex_buffer.rs
CodSpeed Performance Gauge
+1%
2.9 µs2.9 µs
set_indices_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+1%
3 µs3 µs

Commits

Click on a commit to change the comparison range
Base
develop
8aae4ba
-15.51%
spark: pass format options into reader
1b3c478
6 hours ago
by a10y
0%
propagate S3, Azure properties
cc071c6
3 hours ago
by a10y
0%
more
4c69fa6
3 hours ago
by a10y
0%
address comments
dbf2610
2 hours ago
by a10y
0%
include sorted props in cache key
24b6064
2 hours ago
by a10y
0%
add to writer
64c3336
1 hour ago
by a10y
© 2026 CodSpeed Technology
Home Terms Privacy Docs