Eventual-Inc
Daft
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
feat(parquet): Target parquet writes by size bytes instead of rows
#3457
Merged
Comparing
colin/swordfish-parquet-size-based-writes
(
a89724a
) with
main
(
8009155
)
CodSpeed Performance Gauge
+1%
Improvements
0
Regressions
0
Untouched
17
New
0
Dropped
0
Ignored
1
Benchmarks
Passed
test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
CodSpeed Performance Gauge
+8%
185.7 ms
172.1 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
CodSpeed Performance Gauge
+4%
3.4 ms
3.3 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
CodSpeed Performance Gauge
+2%
134 ms
131.5 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
CodSpeed Performance Gauge
+1%
99.9 ms
98.5 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
CodSpeed Performance Gauge
+1%
140.1 ms
138.9 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
CodSpeed Performance Gauge
0%
71.9 ms
71.6 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
CodSpeed Performance Gauge
0%
451.7 ms
450.5 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
CodSpeed Performance Gauge
0%
144 ms
143.6 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
CodSpeed Performance Gauge
0%
11.4 ms
11.3 ms
test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
CodSpeed Performance Gauge
0%
15.5 ms
15.5 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
CodSpeed Performance Gauge
0%
200.1 ms
199.8 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
CodSpeed Performance Gauge
0%
316.3 ms
316.5 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
CodSpeed Performance Gauge
0%
157.4 ms
157.6 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
28.8 ms
28.9 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
CodSpeed Performance Gauge
-1%
100.2 ms
101.2 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
CodSpeed Performance Gauge
-1%
8.3 ms
8.4 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
CodSpeed Performance Gauge
-1%
435.8 ms
442 ms
Ignored
test_explain[1 Small File]
Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
CodSpeed Performance Gauge
+3%
1.9 ms
1.9 ms
Commits
Click on a commit to change the comparison range
Base
main
8009155
-35%
clean up
ee4b2f0
2 months ago
-16%
style
cda2da7
2 months ago
+16%
set file size first
f7432f5
2 months ago
-5%
adaptively update inflation factor + buffer batch writer better
a4a416e
2 months ago
-2%
fix logic
97c939e
2 months ago
-2%
fix test
8d86636
2 months ago
-11%
clean up file size writer
0d930d5
2 months ago
+13%
add comments
6c1a12c
2 months ago
+18%
catch empty buffer
d1c6eb4
2 months ago
+134%
use mutex
d35b1b0
2 months ago
-68%
refactor size based buffer
1862548
2 months ago
-41%
update bytes written comment
a89724a
2 months ago
© 2025 CodSpeed Technology
Home
Terms
Privacy
Docs