Add FilterPushdown support to spark data source
#7785Comparing
rk/sparkfilterpushdown
(8511f8b
) withdevelop
(d3ff1f1
)-11%
- Improvement
- 5
- Regression
- 1
- Untouched
- 1163
- Skipped
- 138
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
1307 total
bitwise_not_vortex_buffer_mut[128]
vortex-buffer/benches/vortex_bitbuffer.rs-11%
246.1 ns275.3 ns
take_10k_first_chunk_only
encodings/fastlanes/benches/bitpacking_take.rs+20%
270.8 µs226 µs
take_10k_dispersed
encodings/fastlanes/benches/bitpacking_take.rs+19%
284.8 µs239.9 µs
patched_take_10k_adversarial
encodings/fastlanes/benches/bitpacking_take.rs+13%
259 µs228.8 µs
patched_take_10k_first_chunk_only
encodings/fastlanes/benches/bitpacking_take.rs+11%
302.4 µs272.1 µs
patched_take_10k_dispersed
encodings/fastlanes/benches/bitpacking_take.rs+11%
316 µs285.7 µs
dict_compress_string
vortex/benches/single_encoding_throughput.rs+7%
8.7 ms8.2 ms
cuda/alp_f32/0%[100M]
vortex-cuda/benches/alp_cuda.rs::benches::benchmark_alp_decode::cuda+5%
2.5 ms2.4 ms
true_count_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+4%
678.1 ns648.9 ns
cuda/dict_64vals_bp6bw_codes_for_bp6bw_values/dispatch_u32[100M]
vortex-cuda/benches/dynamic_dispatch_cuda.rs::benches::benchmark_dynamic_dispatch::cuda+4%
1.1 ms1.1 ms
cuda/runend/i32_runlen_1000[100M]
vortex-cuda/benches/runend_cuda.rs::benches::benchmark_runend::cuda+4%
905.1 µs873.2 µs
decompress[u8, (1000, 4)]
encodings/runend/benches/run_end_compress.rs+4%
23.6 µs22.8 µs
take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs+3%
25.3 µs24.5 µs
iter_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
951.9 ns922.8 ns
encode_varbin[(1000, 512)]
vortex-array/benches/dict_compress.rs+3%
228.7 µs221.8 µs
true_count_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
1,023.9 ns994.7 ns
true_count_arrow_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
1.1 µs1.1 µs
set_indices_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
1.1 µs1.1 µs
decode_primitives[i64, (1000, 2)]
vortex-array/benches/dict_compress.rs+2%
18.8 µs18.4 µs
take_map[(0.1, 0.5)]
vortex-array/benches/take_patches.rs+2%
1,007.2 µs989.2 µs
take_indices[(10000, 1024)]
encodings/runend/benches/run_end_compress.rs+2%
53.8 µs52.9 µs
take_map[(0.01, 1.0)]
vortex-array/benches/take_patches.rs+2%
1.2 ms1.2 ms
transpose_scalar
encodings/fastlanes/benches/bit_transpose.rs+2%
1.8 µs1.8 µs
true_count_arrow_buffer[16384]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
2.1 µs2 µs
map_each[Buffer<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs+1%
2.1 µs2.1 µs
Commits
Click on a commit to change the comparison rangeBase
develop
d3ff1f1
+19.83%
spark filter pushdown
569448e
6 days ago
by robert3005-30.43%
more
8511f8b
32 minutes ago
by robert3005