claude/benchmarks-v3-cleanup - Branch - vortex-data/vortex

[claude] benchmarks v3 cleanup

#7745Merged

Comparing

claude/benchmarks-v3-cleanup

(

fda2b44

) with

ct/benchmarks-v3

(

ab5592f

)

-61%

Improvement: 10

Regression: 14

Untouched: 1174

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.

Benchmarks

1198 total

decompress_rd[f32, (100000, 0.0)]

encodings/alp/benches/alp_compress.rs

-61%

495.9 µs1,286.7 µs

decompress_rd[f32, (100000, 0.01)]

encodings/alp/benches/alp_compress.rs

-58%

582.8 µs1,374.8 µs

decompress_rd[f32, (100000, 0.1)]

encodings/alp/benches/alp_compress.rs

-58%

582.8 µs1,374.3 µs

decompress_rd[f64, (100000, 0.0)]

encodings/alp/benches/alp_compress.rs

-57%

979.1 µs2,294.2 µs

decompress_rd[f64, (100000, 0.01)]

encodings/alp/benches/alp_compress.rs

-56%

1 ms2.3 ms

decompress_rd[f64, (100000, 0.1)]

encodings/alp/benches/alp_compress.rs

-56%

1 ms2.3 ms

alp_rd_decompress_f64

vortex/benches/single_encoding_throughput.rs

-55%

1.1 ms2.4 ms

decompress_rd[f64, (10000, 0.01)]

encodings/alp/benches/alp_compress.rs

-53%

122.3 µs258.1 µs

decompress_rd[f64, (10000, 0.1)]

encodings/alp/benches/alp_compress.rs

-53%

122.4 µs258.2 µs

decompress_rd[f64, (10000, 0.0)]

encodings/alp/benches/alp_compress.rs

-52%

122.4 µs257.7 µs

decompress_rd[f32, (10000, 0.01)]

encodings/alp/benches/alp_compress.rs

-50%

82.2 µs165.8 µs

decompress_rd[f32, (10000, 0.1)]

encodings/alp/benches/alp_compress.rs

-50%

82.1 µs165.5 µs

decompress_rd[f32, (10000, 0.0)]

encodings/alp/benches/alp_compress.rs

-48%

86 µs165.8 µs

decompress[alp_for_bp_f64]

vortex/benches/common_encoding_tree_throughput.rs

-37%

1.8 ms2.8 ms

decompress[datetime_for_bp]

vortex/benches/common_encoding_tree_throughput.rs

+46%

2.4 ms1.6 ms

chunked_opt_bool_into_canonical[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

+36%

1.4 ms1 ms

new_bp_prim_test_between[i64, 32768]

encodings/fastlanes/benches/compute_between.rs::bitpack

+34%

236.2 µs176.6 µs

dict[10M_u32_values_u16_codes]

vortex-cuda/benches/dict_cuda.rs::benches::benchmark_dict::dict_cuda

+24%

182.2 µs146.6 µs

chunked_varbinview_into_canonical[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

+21%

2.1 ms1.7 ms

chunked_opt_bool_into_canonical[(100, 100)]

vortex-array/benches/chunk_array_builder.rs

+16%

259.6 µs223.1 µs

dict[10M_u64_values_u8_codes]

vortex-cuda/benches/dict_cuda.rs::benches::benchmark_dict::dict_cuda

+16%

251.3 µs216.2 µs

chunked_varbinview_opt_into_canonical[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

+16%

2.9 ms2.5 ms

new_bp_prim_test_between[i16, 32768]

encodings/fastlanes/benches/compute_between.rs::bitpack

+10%

134.2 µs121.5 µs

chunked_opt_bool_into_canonical[(1000, 10)]

vortex-array/benches/chunk_array_builder.rs

+10%

68.4 µs62 µs

bitwise_not_vortex_buffer_mut[128]

vortex-buffer/benches/vortex_bitbuffer.rs

+10%

333.6 ns304.4 ns

Commits

Click on a commit to change the comparison range

Base

ct/benchmarks-v3

ab5592f

-61.46%

test(benchmarks-website): adopt Result<()> + ? in tests, drop unwraps

fda2b44

2 days ago

by claude

Home Terms Privacy Docs