claude/benchmarks-v3-refactor - Branch - vortex-data/vortex

[claude] add benchmarks website v3 design overview and plan

#7756

Comparing

claude/benchmarks-v3-refactor

(

f965259

) with

ct/benchmarks-v3

(

6b76221

)

-61%

Improvement: 9

Regression: 17

Untouched: 1172

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.

Benchmarks

1198 total

decompress_rd[f32, (100000, 0.0)]

encodings/alp/benches/alp_compress.rs

-61%

495.9 µs1,286.7 µs

decompress_rd[f32, (100000, 0.01)]

encodings/alp/benches/alp_compress.rs

-58%

582.8 µs1,374.8 µs

decompress_rd[f32, (100000, 0.1)]

encodings/alp/benches/alp_compress.rs

-58%

582.8 µs1,374.3 µs

decompress_rd[f64, (100000, 0.0)]

encodings/alp/benches/alp_compress.rs

-57%

979.1 µs2,294.2 µs

decompress_rd[f64, (100000, 0.01)]

encodings/alp/benches/alp_compress.rs

-56%

1 ms2.3 ms

decompress_rd[f64, (100000, 0.1)]

encodings/alp/benches/alp_compress.rs

-56%

1 ms2.3 ms

alp_rd_decompress_f64

vortex/benches/single_encoding_throughput.rs

-55%

1.1 ms2.4 ms

decompress_rd[f64, (10000, 0.01)]

encodings/alp/benches/alp_compress.rs

-53%

122.3 µs258.1 µs

decompress_rd[f64, (10000, 0.1)]

encodings/alp/benches/alp_compress.rs

-53%

122.4 µs258.2 µs

decompress_rd[f64, (10000, 0.0)]

encodings/alp/benches/alp_compress.rs

-52%

122.4 µs257.7 µs

decompress_rd[f32, (10000, 0.01)]

encodings/alp/benches/alp_compress.rs

-50%

82.2 µs165.8 µs

decompress_rd[f32, (10000, 0.1)]

encodings/alp/benches/alp_compress.rs

-50%

82.1 µs165.5 µs

decompress_rd[f32, (10000, 0.0)]

encodings/alp/benches/alp_compress.rs

-48%

86 µs165.8 µs

decompress[alp_for_bp_f64]

vortex/benches/common_encoding_tree_throughput.rs

-37%

1.8 ms2.8 ms

dict[10M_u32_values_u16_codes]

vortex-cuda/benches/dict_cuda.rs::benches::benchmark_dict::dict_cuda

-19%

146.5 µs181.7 µs

mix[0%_in/100%_out]

vortex-cuda/benches/throughput_cuda.rs::benches::benchmark_transfer_throughput::transfer_throughput_cuda

-18%

228.4 µs277.5 µs

mix[50%_in/50%_out]

vortex-cuda/benches/throughput_cuda.rs::benches::benchmark_transfer_throughput::transfer_throughput_cuda

-13%

338.9 µs391.2 µs

decompress[datetime_for_bp]

vortex/benches/common_encoding_tree_throughput.rs

+46%

2.4 ms1.6 ms

chunked_opt_bool_into_canonical[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

+36%

1.4 ms1 ms

chunked_varbinview_into_canonical[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

+21%

2.1 ms1.7 ms

runend[10M_i32_runlen_10]

vortex-cuda/benches/runend_cuda.rs::benches::benchmark_runend::runend_cuda

+21%

194.2 µs161.1 µs

10M_10%[1000000]

vortex-cuda/benches/filter_cuda.rs::benches::benchmark_filter::filter_cuda_i32

+21%

160 µs132.8 µs

10M_50%[5000000]

vortex-cuda/benches/filter_cuda.rs::benches::benchmark_filter::filter_cuda_i32

+20%

182.8 µs153 µs

chunked_opt_bool_into_canonical[(100, 100)]

vortex-array/benches/chunk_array_builder.rs

+16%

259.6 µs223.1 µs

chunked_varbinview_opt_into_canonical[(10, 1000)]

vortex-array/benches/chunk_array_builder.rs

+16%

2.9 ms2.5 ms

Commits

Click on a commit to change the comparison range

Base

ct/benchmarks-v3

6b76221

-16.45%

style(benchmarks-website): cargo +nightly fmt

d6032f0

1 day ago

by claude

-45.02%

fix(benchmarks-website/migrate): qualify Source::Local intra-doc link

1a39b35

11 hours ago

by claude

fix(benchmarks-website): clean up rustdoc intra-doc-link errors

f965259

10 hours ago

by claude

Home Terms Privacy Docs