Add spark value writers for Date/Timestamp/TimestampNTZ and Struct types
#7424Comparing
rk/sparkwriters
(98b6423
) withdevelop
(d222c87
)0%
- Untouched
- 1123
- Skipped
- 1455
No successful run was found on develop ( d674aa2) during the generation of this report, so d222c87 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
2578 total
binary_search_std
vortex-array/benches/search_sorted.rs+6%
515.3 ns486.1 ns
patched_take_10_contiguous
encodings/fastlanes/benches/bitpacking_take.rs+4%
31 µs29.8 µs
null_count_run_end[(10000, 1024, 0.01)]
encodings/runend/benches/run_end_null_count.rs+4%
4.2 µs4 µs
null_count_run_end[(10000, 256, 0.01)]
encodings/runend/benches/run_end_null_count.rs+4%
4.2 µs4 µs
null_count_run_end[(100000, 1024, 0.01)]
encodings/runend/benches/run_end_null_count.rs+4%
4.2 µs4 µs
iter_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+4%
861.1 ns831.9 ns
true_count_vortex_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
898.3 ns869.2 ns
true_count_vortex_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
998.3 ns969.2 ns
value_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
1,011.1 ns981.9 ns
set_indices_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
1 µs1 µs
new_bp_prim_test_between[i16, 2048]
encodings/fastlanes/benches/compute_between.rs::bitpack+3%
50.9 µs49.5 µs
bitwise_not_vortex_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+3%
3.6 µs3.5 µs
set_indices_arrow_buffer[1024]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
2.4 µs2.3 µs
push_vortex_buffer[128]
vortex-buffer/benches/vortex_buffer.rs+2%
1.2 µs1.2 µs
bitwise_not_vortex_buffer[2048]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
3.7 µs3.6 µs
patched_take_10_stratified
encodings/fastlanes/benches/bitpacking_take.rs+2%
28.7 µs28.1 µs
bitwise_not_vortex_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
4.4 µs4.3 µs
new_raw_prim_test_between[f32, 2048]
encodings/fastlanes/benches/compute_between.rs::primitive+2%
34.1 µs33.5 µs
append_buffer_arrow_buffer[128]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
3.3 µs3.3 µs
push_n_vortex_buffer[u32, 128]
vortex-buffer/benches/vortex_buffer.rs+2%
1.8 µs1.7 µs
transpose_bmi2
encodings/fastlanes/benches/bit_transpose.rs::x86+2%
1.8 µs1.8 µs
untranspose_bmi2
encodings/fastlanes/benches/bit_transpose.rs::x86+2%
1.8 µs1.8 µs
take_10_stratified
encodings/fastlanes/benches/bitpacking_take.rs+2%
23.6 µs23.2 µs
push_n_vortex_buffer[u8, 128]
vortex-buffer/benches/vortex_buffer.rs+2%
1.9 µs1.9 µs
true_count_vortex_buffer[16384]
vortex-buffer/benches/vortex_bitbuffer.rs+2%
2 µs1.9 µs
Commits
Click on a commit to change the comparison rangeBase
develop
d222c87
-0.01%
Add missing value writers to spark datasource
98b6423
17 hours ago
by robert3005