Initial impl for sort pushdown in DataFusion FileSource implementation
#8235Comparing
adamg/pushdown-sort-df
(babfac8
) withdevelop
(bd6fc3e
)-20%
- Regression
- 4
- Untouched
- 1271
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
1275 total
chunked_bool_canonical_into[(1000, 10)]
vortex-array/benches/chunk_array_builder.rs-33%
30.1 µs45 µs
chunked_varbinview_canonical_into[(1000, 10)]
vortex-array/benches/chunk_array_builder.rs-18%
161.3 µs197.6 µs
chunked_varbinview_into_canonical[(1000, 10)]
vortex-array/benches/chunk_array_builder.rs-17%
175.9 µs212 µs
bitwise_not_vortex_buffer_mut[128]
vortex-buffer/benches/vortex_bitbuffer.rs-11%
246.1 ns275.3 ns
iter_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+4%
861.1 ns831.9 ns
set_indices_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
1,010.3 ns981.1 ns
take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs+3%
26.6 µs25.9 µs
append_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
1.4 µs1.4 µs
take_map[(0.1, 1.0)]
vortex-array/benches/take_patches.rs+2%
1.7 ms1.6 ms
append_n_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
1.8 µs1.8 µs
bitwise_not_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
2.1 µs2.1 µs
bitwise_not_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
2.3 µs2.3 µs
pushdown_compare[(1000, 4, 4)]
encodings/fsst/benches/fsst_compress.rs+1%
142.5 µs140.7 µs
bitwise_not_arrow_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
2.4 µs2.3 µs
pushdown_compare[(1000, 64, 4)]
encodings/fsst/benches/fsst_compress.rs+1%
142.7 µs141 µs
append_n_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
2.6 µs2.6 µs
append_n_arrow_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
2.6 µs2.6 µs
take_filter_primitive_nullable_slice_mask_random_indices[4096, 1000]
vortex-array/benches/take_filter.rs+1%
52.5 µs52 µs
from_iter[Buffer<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs+1%
3.3 µs3.3 µs
append_n_arrow_buffer[16384]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
3.4 µs3.3 µs
take_map[(0.01, 0.05)]
vortex-array/benches/take_patches.rs+1%
105.7 µs104.8 µs
null_count_run_end[(100000, 1024, 0.01)]
encodings/runend/benches/run_end_null_count.rs+1%
3.4 µs3.4 µs
null_count_run_end[(10000, 1024, 0.01)]
encodings/runend/benches/run_end_null_count.rs+1%
3.4 µs3.4 µs
append_buffer_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
3.4 µs3.4 µs
null_count_run_end[(10000, 256, 0.01)]
encodings/runend/benches/run_end_null_count.rs+1%
3.4 µs3.4 µs
Commits
Click on a commit to change the comparison rangeBase
develop
bd6fc3e
-20.23%
Try pushdown sort for DF
babfac8
15 hours ago
by AdamGS