Avatar for the pydantic user
pydantic
arrow-rs
BlogDocsChangelog

Parquet page size mid batch

#12
Comparing
parquet-page-size-mid-batch
(
0b13cb9
) with
main
(
2dc7a67
)
CodSpeed Performance Gauge
-31%
Improvement
4
Regression
4
Untouched
600
New
13
Skipped
2169

Benchmarks

2169 total
or
arrow/benches/buffer_bit_ops.rs::benches::bit_ops_benchmark::buffer_binary_ops
Skipped
11.3 µs*
not_with_offset
arrow/benches/buffer_bit_ops.rs::benches::bit_ops_benchmark::buffer_unary_ops
Skipped
8.5 µs*
or_with_offset
arrow/benches/buffer_bit_ops.rs::benches::bit_ops_benchmark::buffer_binary_ops
Skipped
16.7 µs*
not
arrow/benches/buffer_bit_ops.rs::benches::bit_ops_benchmark::buffer_unary_ops
Skipped
8.4 µs*
and
arrow/benches/buffer_bit_ops.rs::benches::bit_ops_benchmark::buffer_binary_ops
Skipped
11 µs*
and_with_offset
arrow/benches/buffer_bit_ops.rs::benches::bit_ops_benchmark::buffer_binary_ops
Skipped
16.7 µs*
project[1000x8192 -> 500x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
85.9 µs*
project[1000x8192 -> 999x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
167.1 µs*
project[100x8192 -> 1x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
4.5 µs*
project[10x8192 -> 5x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
8.2 µs*
project[1000x8192 -> 1x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
4.5 µs*
project[100x8192 -> 50x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
16.6 µs*
project[10x8192 -> 9x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
9.6 µs*
project[100x8192 -> 99x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
23.3 µs*
project[10x8192 -> 1x8192]
arrow-array/benches/record_batch.rs::benches::criterion_benchmark
Skipped
4.6 µs*
StreamWriter/write_10/zstd
arrow-ipc/benches/ipc_writer.rs::benches::criterion_benchmark::arrow_ipc_stream_writer
Skipped
43.7 ms*
StreamWriter/write_10
arrow-ipc/benches/ipc_writer.rs::benches::criterion_benchmark::arrow_ipc_stream_writer
Skipped
9.7 ms*
FileWriter/write_10
arrow-ipc/benches/ipc_writer.rs::benches::criterion_benchmark::arrow_ipc_stream_writer
Skipped
10.7 ms*
occupancy(values: 10, occupancy: 0.1, null_percent: 0)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark
Skipped
8.7 µs*
occupancy(values: 10, occupancy: 0.1, null_percent: 0.1)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark
Skipped
15.7 µs*
occupancy(values: 100, occupancy: 0.5, null_percent: 0.9)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark
Skipped
5.9 µs*
occupancy(values: 10, occupancy: 0.1, null_percent: 0.5)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark
Skipped
9.1 µs*
occupancy(values: 100, occupancy: 1, null_percent: 0)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark
Skipped
8.7 µs*
occupancy(values: 512, occupancy: 0.5, null_percent: 0.5)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark
Skipped
8.9 µs*
occupancy(values: 100, occupancy: 1, null_percent: 0.1)
arrow-array/benches/occupancy.rs::benches::criterion_benchmark
Skipped
14.2 µs*

Commits

Click on a commit to change the comparison range
Base
main
2dc7a67
-30.6%
perf(parquet): mark cold paths #[cold] so they move out of hot icache
0b13cb9
3 months ago
by adriangb
© 2026 CodSpeed Technology
Home Terms Privacy Docs