Extend Parquet BYTE_STREAM_SPLIT support to INT32, INT64, and FIXED_LEN_BYTE_ARRAY primitive types
#60Comparing
fork-6159-etseidl/bss
(c0eb828
) withmaster
(d065e8e
)+65%
- Improvement
- 1
- Untouched
- 937
- Ignored
- 1
Benchmarks
939 total
4096 values string with bloom filter
parquet/benches/arrow_writer.rs::benches::bench_primitive_writer::write_batch primitive+65%
11.2 ms6.8 ms
min nonnull false
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool+6%
491.4 ns462.2 ns
occupancy(values: 512, occupancy: 0.1, null_percent: 0.5)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+3%
13.2 µs12.7 µs
occupancy(values: 10, occupancy: 0.1, null_percent: 0.9)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+3%
8.3 µs8 µs
occupancy(values: 100, occupancy: 0.1, null_percent: 0.5)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+2%
13.1 µs12.8 µs
occupancy(values: 10, occupancy: 0.5, null_percent: 0.9)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+2%
7.3 µs7.2 µs
occupancy(values: 100, occupancy: 1, null_percent: 0.5)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+2%
13.2 µs13 µs
occupancy(values: 512, occupancy: 0.5, null_percent: 0.1)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+1%
18.1 µs17.8 µs
occupancy(values: 10, occupancy: 0.1, null_percent: 0.5)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+1%
13.2 µs13.1 µs
occupancy(values: 100, occupancy: 0.5, null_percent: 0.1)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+1%
18.2 µs18 µs
validate_decimal256_array 20000
arrow/benches/decimal_validate.rs::benches::validate_decimal256_benchmark+1%
3.4 µs3.3 µs
occupancy(values: 512, occupancy: 1, null_percent: 0.9)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+1%
7.5 µs7.4 µs
4096 values bool non-null
parquet/benches/arrow_writer.rs::benches::bench_primitive_writer::write_batch primitive+1%
316.7 µs314.7 µs
occupancy(values: 100, occupancy: 0.1, null_percent: 0.1)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+1%
18.2 µs18.1 µs
equal_bool_513
arrow/benches/equal.rs::benches::add_benchmark+1%
4.7 µs4.7 µs
occupancy(values: 10, occupancy: 1, null_percent: 0.5)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+1%
13.1 µs13 µs
array_from_vec 128
arrow/benches/array_from_vec.rs::benches::criterion_benchmark+1%
5.1 µs5.1 µs
array_from_vec 256
arrow/benches/array_from_vec.rs::benches::criterion_benchmark+1%
5.4 µs5.3 µs
not
arrow/benches/boolean_kernels.rs::benches::add_benchmark+1%
10.9 µs10.9 µs
equal_512
arrow/benches/equal.rs::benches::add_benchmark+1%
5.5 µs5.5 µs
occupancy(values: 512, occupancy: 0.1, null_percent: 0.1)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark+1%
17.9 µs17.8 µs
max nonnull false
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool0%
6 µs6 µs
or nonnull false
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool0%
6.1 µs6 µs
not_sliced
arrow/benches/boolean_kernels.rs::benches::add_benchmark0%
13 µs12.9 µs
array_from_vec 512
arrow/benches/array_from_vec.rs::benches::criterion_benchmark0%
7 µs7 µs
Commits
Click on a commit to change the comparison rangeBase
master
d065e8e
+17.07%
byte_stream_split encoding for fixed_len_byte_array
1c1af32
2 years ago
by etseidl-17.02%
revert changes to Decoder and add VariableWidthByteStreamSplitDecoder
75ea319
2 years ago
by etseidl+65.32%
begin implementing roundtrip test
e7829c3
2 years ago
by etseidl-0.05%
move test
c0eb828
2 years ago
by etseidl