lazily compute for null count when it is expansive to calculate it
#57Comparing
fork-6155-Rachelint/lazy-compute-null-count
(63a5af9
) withmaster
(195bad1
)-31%
- Improvement
- 8
- Regression
- 4
- Untouched
- 926
- Ignored
- 1
Benchmarks
939 total
min nullable mixed
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool-31%
636.9 ns918.6 ns
min nullable false
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool-28%
657.8 ns910.3 ns
min nonnull true
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool-20%
222.7 µs277.3 µs
4096 values primitive list
parquet/benches/arrow_writer.rs::benches::bench_nested_writer::write_batch nested-10%
6.9 ms7.6 ms
array_slice 2048
arrow/benches/array_slice.rs::benches::array_slice_benchmark+33%
3.6 µs2.7 µs
array_slice 512
arrow/benches/array_slice.rs::benches::array_slice_benchmark+27%
3.4 µs2.7 µs
4096 values string dictionary
parquet/benches/arrow_writer.rs::benches::bench_primitive_writer::write_batch primitive+23%
3.3 ms2.7 ms
array_slice 128
arrow/benches/array_slice.rs::benches::array_slice_benchmark+22%
3.3 µs2.7 µs
cast date32 to date64 512
arrow/benches/cast_kernels.rs::benches::add_benchmark+12%
11.9 µs10.6 µs
cast time32s to time32ms 512
arrow/benches/cast_kernels.rs::benches::add_benchmark+12%
10.3 µs9.2 µs
cast date64 to date32 512
arrow/benches/cast_kernels.rs::benches::add_benchmark+11%
12.5 µs11.3 µs
4096 values string non-null
parquet/benches/arrow_writer.rs::benches::bench_primitive_writer::write_batch primitive+11%
6.9 ms6.2 ms
4096 values string dictionary with bloom filter
parquet/benches/arrow_writer.rs::benches::bench_primitive_writer::write_batch primitive+7%
5.8 ms5.4 ms
4096 StringView(10, 0) - 4096
arrow/benches/csv_reader.rs::benches::criterion_benchmark+5%
847.5 µs804.4 µs
max nonnull mixed
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool+5%
586.7 ns557.2 ns
max nonnull true
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool+5%
586.7 ns557.2 ns
or nonnull mixed
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool+5%
645.6 ns616.1 ns
or nonnull true
arrow/benches/aggregate_kernels.rs::benches::add_benchmark::bool+5%
645.6 ns616.1 ns
4096 StringView(100, 0.5) - 4096
arrow/benches/csv_reader.rs::benches::criterion_benchmark+5%
2 ms1.9 ms
2020-9-8
arrow-cast/benches/parse_date.rs::benches::criterion_benchmark+4%
713.6 ns684.4 ns
4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0) - 4096
arrow/benches/csv_reader.rs::benches::criterion_benchmark+3%
6.8 ms6.6 ms
dictionary encoded, mandatory, no NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/INT64/Decimal128Array+3%
3.7 ms3.6 ms
plain encoded, mandatory, no NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/INT64/Decimal128Array+3%
4.1 ms4 ms
array_from_vec 128
arrow/benches/array_from_vec.rs::benches::criterion_benchmark+3%
5 µs4.9 µs
cast time32s to time64us 512
arrow/benches/cast_kernels.rs::benches::add_benchmark+3%
11.6 µs11.3 µs
Commits
Click on a commit to change the comparison rangeBase
master
195bad1
-30.66%
lazily compute for null count when it is expansive to calculate it.
1c3a1be
2 years ago
by Rachelint-25.01%
fix test.
9c225fc
2 years ago
by Rachelint+25.01%
fix comment.
63a5af9
2 years ago
by Rachelint