Support reporting statistics in spark datasource
#8057Comparing
rk/sparkstats
(41c0d4f
) withdevelop
(012d0ec
)-2%
- Improvement
- 2
- Regression
- 1
- Untouched
- 1234
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
1237 total
fast_lt_out_of_range[4, 65536]
encodings/fastlanes/benches/bitpack_compare.rs-22%
204.3 µs*262.3 µs
baseline_eq[16, 65536]
encodings/fastlanes/benches/bitpack_compare.rs+11%
287.6 µs*259.6 µs
baseline_lt[16, 65536]
encodings/fastlanes/benches/bitpack_compare.rs+10%
302.7 µs*274.7 µs
iter_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+7%
919.4 ns*861.1 ns
set_indices_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+6%
1,010.3 ns*951.9 ns
cuda/runend/i32_runlen_1000[100M]
vortex-cuda/benches/runend_cuda.rs::benches::benchmark_runend::cuda+4%
903.9 µs869.8 µs
decode_primitives[f32, (1000, 512)]
vortex-array/benches/dict_compress.rs+3%
18.8 µs*18.2 µs
bitwise_not_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
2.1 µs*2.1 µs
chunked_dict_fsst_into_canonical[(1000, 100, 100)]
encodings/fsst/benches/chunked_dict_fsst_builder.rs+3%
14.1 ms*13.7 ms
chunked_dict_fsst_canonical_into[(1000, 100, 100)]
encodings/fsst/benches/chunked_dict_fsst_builder.rs+3%
14 ms*13.6 ms
chunked_dict_fsst_into_canonical[(1000, 1000, 100)]
encodings/fsst/benches/chunked_dict_fsst_builder.rs+3%
14.9 ms*14.5 ms
bitwise_not_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
2.3 µs*2.3 µs
chunked_dict_fsst_into_canonical[(1000, 100, 10)]
encodings/fsst/benches/chunked_dict_fsst_builder.rs+3%
1.5 ms*1.4 ms
decompress[u8, (1000, 16)]
encodings/runend/benches/run_end_compress.rs+3%
19 µs*18.5 µs
bitwise_not_arrow_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
2.4 µs*2.3 µs
chunked_dict_fsst_canonical_into[(1000, 10, 100)]
encodings/fsst/benches/chunked_dict_fsst_builder.rs+2%
13.9 ms*13.6 ms
baseline_eq[4, 65536]
encodings/fastlanes/benches/bitpack_compare.rs+2%
243.7 µs*238.1 µs
encode_varbin[(1000, 32)]
vortex-array/benches/dict_compress.rs+2%
171.2 µs*167.3 µs
patched_take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs+2%
31 µs*30.3 µs
chunked_dict_fsst_canonical_into[(1000, 1000, 100)]
encodings/fsst/benches/chunked_dict_fsst_builder.rs+2%
14.9 ms*14.5 ms
encode_varbin[(1000, 8)]
vortex-array/benches/dict_compress.rs+2%
165.8 µs*162.1 µs
baseline_lt[4, 65536]
encodings/fastlanes/benches/bitpack_compare.rs+2%
257.7 µs*252.1 µs
append_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
1.4 µs*1.4 µs
cuda/bitpacked_patched_u32/unpack/10%[100M]
vortex-cuda/benches/bitpacked_cuda.rs::benches::benchmark_bitunpack_with_patches::cuda+2%
1.2 ms1.2 ms
cuda/dict/u64_values_u8_codes[100M]
vortex-cuda/benches/dict_cuda.rs::benches::benchmark_dict::cuda+2%
2.1 ms2 ms
Commits
Click on a commit to change the comparison rangeBase
develop
012d0ec
-1.66%
Let spark report statistics
41c0d4f
4 days ago
by robert3005