Avatar for the pydantic user
pydantic
arrow-rs
BlogDocsChangelog

Parquet page size mid batch

#12
Comparing
parquet-page-size-mid-batch
(
0b13cb9
) with
main
(
2dc7a67
)
CodSpeed Performance Gauge
-31%
Improvement
4
Regression
4
Untouched
600
New
13
Skipped
2169

Benchmarks

2790 total
read f32 byte_stream_split
parquet/benches/parquet_round_trip.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
-58%
7.8 ms18.6 ms
read int32 byte_stream_split
parquet/benches/parquet_round_trip.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
-57%
8.1 ms18.9 ms
read f64 byte_stream_split
parquet/benches/parquet_round_trip.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
-57%
15.9 ms36.6 ms
read int64 byte_stream_split
parquet/benches/parquet_round_trip.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
-56%
16 ms36.7 ms
plain encoded, mandatory, no NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+14%
3.6 ms3.1 ms
plain encoded, optional, no NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+13%
3.6 ms3.1 ms
plain encoded, optional, half NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+13%
3.8 ms3.3 ms
plain encoded, mandatory, no NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+10%
5.4 ms4.9 ms
values[10000]
parquet/benches/bloom_filter.rs::benches::bench_insert_and_fold::insert_and_fold
CodSpeed Performance Gauge
N/A
N/A1.4 ms
values[1000]
parquet/benches/bloom_filter.rs::benches::bench_insert_only::insert_only
CodSpeed Performance Gauge
N/A
N/A551.8 µs
values[100000]
parquet/benches/bloom_filter.rs::benches::bench_insert_and_fold::insert_and_fold
CodSpeed Performance Gauge
N/A
N/A4.1 ms
values[100000]
parquet/benches/bloom_filter.rs::benches::bench_insert_only::insert_only
CodSpeed Performance Gauge
N/A
N/A3.5 ms
ndv[10000]
parquet/benches/bloom_filter.rs::benches::bench_fold_to_target_fpp::fold_to_target_fpp
CodSpeed Performance Gauge
N/A
N/A1.1 ms
values[1000]
parquet/benches/bloom_filter.rs::benches::bench_insert_and_fold::insert_and_fold
CodSpeed Performance Gauge
N/A
N/A1.2 ms
values[10000]
parquet/benches/bloom_filter.rs::benches::bench_insert_only::insert_only
CodSpeed Performance Gauge
N/A
N/A819 µs
ndv[100000]
parquet/benches/bloom_filter.rs::benches::bench_fold_to_target_fpp::fold_to_target_fpp
CodSpeed Performance Gauge
N/A
N/A1.1 ms
ndv[1000]
parquet/benches/bloom_filter.rs::benches::bench_fold_to_target_fpp::fold_to_target_fpp
CodSpeed Performance Gauge
N/A
N/A1.1 ms
from_filters
parquet/benches/row_selector.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
N/A
N/A4 ms
intersection
parquet/benches/row_selector.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
N/A
N/A7.6 ms
and_then
parquet/benches/row_selector.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
N/A
N/A4.6 ms
union
parquet/benches/row_selector.rs::benches::criterion_benchmark
CodSpeed Performance Gauge
N/A
N/A8.2 ms
plain encoded, optional, no NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+10%
5.4 ms5 ms
byte_stream_split encoded, optional, half NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+8%
5.6 ms5.2 ms
plain encoded, optional, half NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+7%
3.9 ms3.7 ms
byte_stream_split encoded, mandatory, no NULLs
parquet/benches/arrow_reader.rs::benches::decimal_benches::arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array
CodSpeed Performance Gauge
+6%
7.2 ms6.8 ms

Commits

Click on a commit to change the comparison range
Base
main
2dc7a67
-30.6%
perf(parquet): mark cold paths #[cold] so they move out of hot icache
0b13cb9
2 days ago
by adriangb
© 2026 CodSpeed Technology
Home Terms Privacy Docs