Use async_fs file for java and python writes to avoid object_store buffering on local disks
#7920MergedComparing
rk/asyncfscreate
(214dfb1
) withdevelop
(7349cd6
)+20%
- Improvement
- 6
- Untouched
- 1199
- Archived
- 35
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
1240 total
new_bp_prim_test_between[i64, 32768]
encodings/fastlanes/benches/compute_between.rs::bitpack+33%
236.7 µs178 µs
new_bp_prim_test_between[i64, 16384]
encodings/fastlanes/benches/compute_between.rs::bitpack+25%
144.4 µs115.1 µs
new_bp_prim_test_between[i32, 32768]
encodings/fastlanes/benches/compute_between.rs::bitpack+20%
169.9 µs141.1 µs
new_alp_prim_test_between[f64, 16384]
encodings/fastlanes/benches/compute_between.rs::alp+17%
148.8 µs126.9 µs
new_bp_prim_test_between[i32, 16384]
encodings/fastlanes/benches/compute_between.rs::bitpack+15%
109.1 µs94.8 µs
new_bp_prim_test_between[i16, 32768]
encodings/fastlanes/benches/compute_between.rs::bitpack+12%
134.1 µs120.2 µs
new_alp_prim_test_between[f32, 32768]
encodings/fastlanes/benches/compute_between.rs::alp+9%
169 µs155.1 µs
bitwise_not_vortex_buffer_mut[128]
vortex-buffer/benches/vortex_bitbuffer.rs-9%
304.4 ns333.6 ns
new_bp_prim_test_between[i16, 16384]
encodings/fastlanes/benches/compute_between.rs::bitpack+8%
90 µs83 µs
bitwise_not_vortex_buffer_mut[1024]
vortex-buffer/benches/vortex_bitbuffer.rs-8%
336.9 ns366.1 ns
bitwise_not_vortex_buffer_mut[2048]
vortex-buffer/benches/vortex_bitbuffer.rs-7%
400.6 ns429.7 ns
new_alp_prim_test_between[f32, 16384]
encodings/fastlanes/benches/compute_between.rs::alp+7%
112.7 µs105.7 µs
iter_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs-7%
831.9 ns890.3 ns
new_alp_prim_test_between[f64, 32768]
encodings/fastlanes/benches/compute_between.rs::alp+6%
252.1 µs237 µs
new_bp_prim_test_between[i64, 2048]
encodings/fastlanes/benches/compute_between.rs::bitpack+6%
63.5 µs59.9 µs
set_indices_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs-6%
951.9 ns1,010.3 ns
new_alp_prim_test_between[f64, 2048]
encodings/fastlanes/benches/compute_between.rs::alp+5%
71.8 µs68.1 µs
cuda/alp_for_bp_6bw_f32/dispatch_f32[100M]
vortex-cuda/benches/dynamic_dispatch_cuda.rs::benches::benchmark_dynamic_dispatch::cuda+5%
1.1 ms1 ms
binary_search_std
vortex-array/benches/search_sorted.rs-5%
515.3 ns544.4 ns
cuda/for_bitpacked_6bw/dispatch_u32[100M]
vortex-cuda/benches/dynamic_dispatch_cuda.rs::benches::benchmark_dynamic_dispatch::cuda+5%
1.1 ms1 ms
cuda/dict_256vals_bp8bw_codes/dispatch_u32[100M]
vortex-cuda/benches/dynamic_dispatch_cuda.rs::benches::benchmark_dynamic_dispatch::cuda+5%
1.1 ms1.1 ms
cuda/dict_widen_u16_to_u32/dispatch_u32[100M]
vortex-cuda/benches/dynamic_dispatch_cuda.rs::benches::benchmark_dynamic_dispatch::cuda+5%
1,011.7 µs962.6 µs
true_count_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+4%
678.1 ns648.9 ns
binary_search_vortex
vortex-array/benches/search_sorted.rs-4%
698.1 ns727.2 ns
map_new_output[128]
vortex-buffer/benches/vortex_buffer.rs-4%
789.4 ns818.6 ns
Commits
Click on a commit to change the comparison rangeBase
develop
7349cd6
+20.27%
Use async_fs instead of LocalFileSystem for local disk writes
214dfb1
2 months ago
by robert3005