chore:optimize next_coalesced() by tracking removed ids in a HashSet
#6353Comparing
caicancai:perf/io-coalesce-hashset
(91257b9
) withdevelop
(cfd9116
)0%
- Untouched
- 1138
- Skipped
- 1265
Benchmarks
2403 total
take_map[(0.1, 0.5)]
vortex-array/benches/take_patches.rs+3%
2.2 ms2.1 ms
chunked_bool_canonical_into[(1000, 10)]
vortex-array/benches/chunk_array_builder.rs+3%
67.3 µs65.7 µs
true_count_vortex_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
1.2 µs1.2 µs
true_count_vortex_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
1.4 µs1.4 µs
take_map[(0.005, 0.1)]
vortex-array/benches/take_patches.rs+2%
304.8 µs298.5 µs
map_new_output[128]
vortex-buffer/benches/vortex_buffer.rs+2%
1.5 µs1.5 µs
take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs+2%
30.6 µs30 µs
take_map[(0.1, 1.0)]
vortex-array/benches/take_patches.rs+1%
3.7 ms3.6 ms
chunked_dict_primitive_canonical_into[u32, (1000, 10, 10)]
vortex-array/benches/chunked_dict_builder.rs+1%
93.6 µs92.4 µs
chunked_dict_primitive_canonical_into[u32, (1000, 100, 10)]
vortex-array/benches/chunked_dict_builder.rs+1%
95.1 µs94 µs
chunked_dict_primitive_canonical_into[u64, (1000, 100, 100)]
vortex-array/benches/chunked_dict_builder.rs+1%
1.2 ms1.2 ms
take_map[(0.1, 0.05)]
vortex-array/benches/take_patches.rs+1%
803 µs793.8 µs
append_n_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
2.7 µs2.6 µs
ScalarBuffer<i32>>, 128]
vortex-buffer/benches/vortex_buffer.rs::from_iter[Arrow<arrow_buffer::buffer::scalar+1%
2.9 µs2.8 µs
decode_varbin[(1000, 4)]
vortex-array/benches/dict_compress.rs+1%
34.5 µs34.1 µs
take_map[(0.1, 0.1)]
vortex-array/benches/take_patches.rs+1%
951.7 µs942.4 µs
ScalarBuffer<i32>>, 128]
vortex-buffer/benches/vortex_buffer.rs::map_each[Arrow<arrow_buffer::buffer::scalar+1%
3 µs3 µs
chunked_dict_primitive_canonical_into[f32, (1000, 1000, 10)]
vortex-array/benches/chunked_dict_builder.rs+1%
112.8 µs111.8 µs
append_n_arrow_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
3.1 µs3.1 µs
encode_primitives[u8, (1000, 2)]
vortex-array/benches/dict_compress.rs+1%
91.5 µs90.7 µs
append_n_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
3.3 µs3.3 µs
true_count_vortex_buffer[16384]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
3.8 µs3.7 µs
decode_primitives[f32, (10000, 4)]
vortex-array/benches/dict_compress.rs+1%
59.4 µs59 µs
bitwise_and_vortex_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+1%
4 µs4 µs
from_iter[Buffer<i32>, 128]
vortex-buffer/benches/vortex_buffer.rs+1%
4.1 µs4.1 µs
Commits
Click on a commit to change the comparison rangeBase
develop
cfd9116
-0.01%
chore: optimize next_coalesced() by tracking removed ids in a HashSet
91257b9
2 days ago
by caicancai