Use approximate cardinality to decide whether to use dict compression
#7759Comparing
rk/cardinality-estimator
(7fa9309
) withdevelop
(5e5572b
)-25%
- Improvement
- 3
- Regression
- 4
- Untouched
- 1162
- Skipped
- 138
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
1307 total
new_bp_prim_test_between[i64, 32768]
encodings/fastlanes/benches/compute_between.rs::bitpack-25%
177.3 µs236.1 µs
varbinview_zip_block_mask
vortex-array/benches/varbinview_zip.rs-22%
2.9 ms3.7 ms
decode_primitives[u8, (1000, 2)]
vortex-array/benches/dict_compress.rs-10%
15.8 µs17.6 µs
varbinview_zip_fragmented_mask
vortex-array/benches/varbinview_zip.rs-10%
6.5 ms7.3 ms
encode_varbinview[(1000, 2)]
vortex-array/benches/dict_compress.rs+45%
243.8 µs168.1 µs
dict_compress_string
vortex/benches/single_encoding_throughput.rs+11%
8.2 ms7.4 ms
encode_varbin[(10000, 512)]
vortex-array/benches/dict_compress.rs+10%
1,029.1 µs934.6 µs
encode_varbinview[(10000, 8)]
vortex-array/benches/dict_compress.rs+10%
1,019.1 µs929.9 µs
encode_varbinview[(10000, 32)]
vortex-array/benches/dict_compress.rs+10%
1,024 µs934.6 µs
encode_varbinview[(10000, 512)]
vortex-array/benches/dict_compress.rs+9%
1.1 ms1 ms
encode_varbinview[(1000, 512)]
vortex-array/benches/dict_compress.rs+9%
224.5 µs205.8 µs
encode_varbin[(10000, 32)]
vortex-array/benches/dict_compress.rs+9%
938.9 µs860.9 µs
encode_varbinview[(10000, 4)]
vortex-array/benches/dict_compress.rs+9%
1,019.2 µs934.7 µs
encode_varbin[(10000, 4)]
vortex-array/benches/dict_compress.rs+9%
935.5 µs858.1 µs
encode_varbin[(10000, 8)]
vortex-array/benches/dict_compress.rs+9%
935.2 µs859.5 µs
new_alp_prim_test_between[f32, 32768]
encodings/fastlanes/benches/compute_between.rs::alp+9%
183.7 µs169.1 µs
encode_varbinview[(10000, 2)]
vortex-array/benches/dict_compress.rs+9%
1.1 ms1 ms
encode_varbin[(10000, 2)]
vortex-array/benches/dict_compress.rs+8%
935.3 µs863 µs
encode_primitives[u8, (10000, 512)]
vortex-array/benches/dict_compress.rs+8%
371.6 µs345.6 µs
encode_varbin[(1000, 2)]
vortex-array/benches/dict_compress.rs+7%
166 µs154.6 µs
encode_varbin[(1000, 4)]
vortex-array/benches/dict_compress.rs+7%
167 µs155.6 µs
null_count_run_end[(10000, 256, 0.01)]
encodings/runend/benches/run_end_null_count.rs+7%
4.5 µs4.2 µs
null_count_run_end[(10000, 1024, 0.01)]
encodings/runend/benches/run_end_null_count.rs+7%
4.5 µs4.2 µs
encode_primitives[u8, (10000, 2)]
vortex-array/benches/dict_compress.rs+7%
353.6 µs330.3 µs
encode_primitives[u8, (10000, 4)]
vortex-array/benches/dict_compress.rs+7%
352.8 µs329.6 µs
Commits
Click on a commit to change the comparison rangeBase
develop
5e5572b
-24.9%
feat: use cardinality estimator for distinct count stats
7fa9309
9 days ago
by robert3005