Avatar for the vortex-data user
vortex-data
vortex
BlogDocsChangelog

Sparse Dictionary Canonicalize

#7841
Comparing
ngates/sparse-dict
(
54b8dba
) with
develop
(
f3d5f09
)
CodSpeed Performance Gauge
+25%
Improvement
8
Untouched
1200

Benchmarks

1208 total
bench_sparse_coverage[0.1]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+25%
364.8 µs292.1 µs
bench_sparse_coverage[0.5]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+25%
364.8 µs292.2 µs
bench_sparse_coverage[0.01]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+25%
366.4 µs293.8 µs
bench_many_codes_few_values[2048]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+25%
368.5 µs295.9 µs
bench_many_codes_few_values[4096]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+24%
374.3 µs301.7 µs
bench_many_codes_few_values[1024]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+22%
397.5 µs325.1 µs
bench_many_nulls[0.9]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+18%
537.1 µs456.4 µs
bench_many_nulls[0.5]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+14%
361.8 µs317.6 µs
true_count_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+8%
784.7 ns726.4 ns
true_count_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+6%
994.7 ns936.4 ns
true_count_arrow_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+6%
1.1 µs1 µs
bench_many_nulls[0.1]
vortex-array/benches/dict_unreferenced_mask.rs
CodSpeed Performance Gauge
+5%
165.1 µs157.3 µs
decode_primitives[f32, (1000, 2)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
+5%
18.2 µs17.4 µs
true_count_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs
CodSpeed Performance Gauge
+5%
648.9 ns619.7 ns
decode_primitives[f32, (1000, 512)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
+5%
19.8 µs18.9 µs
cuda/for_bitpacked_6bw/dispatch_u32[100M]
vortex-cuda/benches/dynamic_dispatch_cuda.rs::benches::benchmark_dynamic_dispatch::cuda
CodSpeed Performance Gauge
+5%
1.1 ms1 ms
decode_primitives[f32, (1000, 4)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
+4%
18.2 µs17.4 µs
decode_primitives[f32, (1000, 32)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
+4%
18.2 µs17.5 µs
decode_primitives[f32, (1000, 8)]
vortex-array/benches/dict_compress.rs
CodSpeed Performance Gauge
+4%
18.2 µs17.5 µs
cuda/alp_f32/0%[100M]
vortex-cuda/benches/alp_cuda.rs::benches::benchmark_alp_decode::cuda
CodSpeed Performance Gauge
+4%
2.5 ms2.4 ms
chunked_dict_primitive_into_canonical[u32, (1000, 10, 100)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+3%
744.6 µs720.5 µs
chunked_dict_primitive_canonical_into[u32, (1000, 10, 100)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+3%
716.5 µs693.3 µs
chunked_dict_primitive_into_canonical[u32, (1000, 100, 100)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+3%
779.9 µs754.8 µs
chunked_dict_primitive_canonical_into[u32, (1000, 100, 100)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+3%
732.3 µs708.8 µs
chunked_dict_primitive_canonical_into[u32, (1000, 10, 10)]
vortex-array/benches/chunked_dict_builder.rs
CodSpeed Performance Gauge
+3%
89.6 µs86.7 µs

Commits

Click on a commit to change the comparison range
Base
develop
f3d5f09
-61.56%
Merge remote-tracking branch 'origin/develop' into ngates/sparse-dict
c3e209d
3 hours ago
by gatesn
0%
Skip sparse dict compaction for referenced dictionaries
4ab2dc5
2 hours ago
by gatesn
+0.01%
Avoid sparse dict overhead on dense paths
13ae594
2 hours ago
by gatesn
0%
Merge remote-tracking branch 'origin/develop' into ngates/sparse-dict
6a07393
2 hours ago
by gatesn
-0.01%
Gate sparse dict sampling by shape
fd59336
1 hour ago
by gatesn
-0.01%
Keep sparse dict helpers cold
58bb1d4
1 hour ago
by gatesn
0%
Merge remote-tracking branch 'origin/develop' into ngates/sparse-dict
cc38823
1 hour ago
by gatesn
+36.7%
Avoid sparse dict compaction over filters
d6e1096
41 minutes ago
by gatesn
+49.73%
Skip sparse dict gate for filter values
54b8dba
30 minutes ago
by gatesn
© 2026 CodSpeed Technology
Home Terms Privacy Docs