asubiotto/ree - Branch - vortex-data/vortex

fix[vortex-array]: handle lazily sliced REE to_arrow

#7011Merged

Comparing

asubiotto/ree

(

61d0bb2

) with

develop

(

c63a800

)

+11%

Improvement: 1

Untouched: 991

Archived: 1532

Benchmarks

2524 total

compact_sliced[(4096, 10)]

vortex-array/benches/varbinview_compact.rs

551.6 µs551.6 µs

chunked_dict_primitive_canonical_into[f32, (1000, 1000, 100)]

vortex-array/benches/chunked_dict_builder.rs

1.1 ms1.1 ms

for_decompress_i32

vortex/benches/single_encoding_throughput.rs

745 µs745.1 µs

from_iter_bit_buffer[65536]

vortex-buffer/benches/vortex_bitbuffer.rs

241.8 µs241.8 µs

untranspose_scalar_throughput

encodings/fastlanes/benches/bit_transpose.rs

481.9 µs482 µs

decompress_utf8[(100000, 4)]

encodings/runend/benches/run_end_compress.rs

1.9 ms1.9 ms

canonicalize_compare[(10000, 64, 4)]

encodings/fsst/benches/fsst_compress.rs

2.9 ms2.9 ms

take_indices[(100000, 4)]

encodings/runend/benches/run_end_compress.rs

1.6 ms1.6 ms

dict_canonicalize_zipfian[256, 100000]

vortex-array/benches/take_primitive.rs

553.4 µs553.5 µs

decode_bool_nullable[10000_2_alternating_mostly_valid]

encodings/runend/benches/run_end_decode.rs

226.9 µs226.9 µs

chunked_bool_canonical_into[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

1.7 ms1.7 ms

dict_canonicalize_uniform[16, 100000]

vortex-array/benches/take_primitive.rs

552.7 µs552.7 µs

dict_canonicalize_zipfian[16, 100000]

vortex-array/benches/take_primitive.rs

552.5 µs552.5 µs

take_search[(0.01, 0.05)]

vortex-array/benches/take_patches.rs

230 µs230 µs

case_when_simple[100000]

vortex-array/benches/expr/case_when_bench.rs

1.3 ms1.3 ms

take_search[(0.005, 0.05)]

vortex-array/benches/take_patches.rs

214.7 µs214.8 µs

decompress[u32, (100000, 16)]

encodings/runend/benches/run_end_compress.rs

504.3 µs504.4 µs

decompress[u64, (100000, 16)]

encodings/runend/benches/run_end_compress.rs

680.1 µs680.2 µs

eq_pushdown_low_match

encodings/fsst/benches/fsst_url_compare.rs

2.3 ms2.3 ms

decompress_utf8[(100000, 16)]

encodings/runend/benches/run_end_compress.rs

1.2 ms1.2 ms

chunked_constant_utf8_append_to_builder[("hello world!!", 1000, 10)]

vortex-array/benches/chunk_array_builder.rs

820.7 µs820.8 µs

map_new_output[16384]

vortex-buffer/benches/vortex_buffer.rs

160.1 µs160.1 µs

decompress_utf8[(100000, 4096)]

encodings/runend/benches/run_end_compress.rs

945.1 µs945.2 µs

chunked_constant_i32_append_to_builder[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

325 µs325 µs

chunked_dict_primitive_into_canonical[u32, (1000, 1000, 100)]

vortex-array/benches/chunked_dict_builder.rs

1.1 ms1.1 ms

Commits

Click on a commit to change the comparison range

Base

develop

c63a800

+11.12%

fix[vortex-array]: handle lazily sliced REE to_arrow

61d0bb2

1 month ago

by asubiotto

Home Terms Privacy Docs