BlogDocs

perf: Fix pathological small chunk parquet writing(#16433)

Merged
Merging
parquet
(
b152463
) into
main
(
462bc8b
)
+1%
IMPROVEMENTS
0
REGRESSIONS
0
UNTOUCHED
37
NEW
0
DROPPED
0
IGNORED
1

Benchmarks

Passing

test_to_numpy_series_chunked
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_chunked
0%
274.4 µs
274.1 µs
test_to_numpy_series_with_nulls
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_with_nulls
0%
311.8 µs
311.5 µs
test_to_numpy_series_zero_copy
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_zero_copy
0%
128 µs
127.7 µs
test_filter1
py-polars/tests/benchmark/test_filter.py::test_filter1
-1%
714.4 µs
721.9 µs
test_groupby_h2oai_q1
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q1
-3%
2.2 ms
2.2 ms
test_groupby_h2oai_q10
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q10
0%
6.3 ms
6.2 ms
test_groupby_h2oai_q2
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q2
-2%
4.1 ms
4.2 ms
test_groupby_h2oai_q3
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q3
+3%
2.2 ms
2.1 ms
test_groupby_h2oai_q4
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q4
+9%
1.9 ms
1.8 ms
test_groupby_h2oai_q5
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q5
+7%
1.9 ms
1.7 ms
test_groupby_h2oai_q6
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q6
0%
12 ms
11.9 ms
test_groupby_h2oai_q7
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q7
+4%
2.1 ms
2 ms
test_groupby_h2oai_q8
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q8
0%
2.6 ms
2.6 ms
test_groupby_h2oai_q9
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q9
0%
24 ms
24 ms
test_write_read_scan_large_csv
py-polars/tests/benchmark/test_io.py::test_write_read_scan_large_csv
0%
33.5 ms
33.3 ms
test_tpch_q1
py-polars/tests/benchmark/test_tpch.py::test_tpch_q1
+2%
16.9 ms
16.5 ms
test_tpch_q10
py-polars/tests/benchmark/test_tpch.py::test_tpch_q10
+2%
6.2 ms
6.1 ms
test_tpch_q11
py-polars/tests/benchmark/test_tpch.py::test_tpch_q11
+2%
3.8 ms
3.8 ms
test_tpch_q12
py-polars/tests/benchmark/test_tpch.py::test_tpch_q12
+7%
5.9 ms
5.5 ms
test_tpch_q13
py-polars/tests/benchmark/test_tpch.py::test_tpch_q13
-2%
9.3 ms
9.5 ms
test_tpch_q14
py-polars/tests/benchmark/test_tpch.py::test_tpch_q14
+2%
2 ms
1.9 ms
test_tpch_q15
py-polars/tests/benchmark/test_tpch.py::test_tpch_q15
+15%
2.4 ms
2.1 ms
test_tpch_q16
py-polars/tests/benchmark/test_tpch.py::test_tpch_q16
+2%
6.6 ms
6.5 ms
test_tpch_q17
py-polars/tests/benchmark/test_tpch.py::test_tpch_q17
+4%
6.5 ms
6.3 ms
test_tpch_q18
py-polars/tests/benchmark/test_tpch.py::test_tpch_q18
+1%
11 ms
10.9 ms
test_tpch_q19
py-polars/tests/benchmark/test_tpch.py::test_tpch_q19
0%
7.2 ms
7.3 ms
test_tpch_q2
py-polars/tests/benchmark/test_tpch.py::test_tpch_q2
-4%
3.9 ms
4.1 ms
test_tpch_q20
py-polars/tests/benchmark/test_tpch.py::test_tpch_q20
+1%
6.1 ms
6.1 ms
test_tpch_q21
py-polars/tests/benchmark/test_tpch.py::test_tpch_q21
0%
192 ms
191.3 ms
test_tpch_q22
py-polars/tests/benchmark/test_tpch.py::test_tpch_q22
-3%
5.9 ms
6.1 ms
test_tpch_q3
py-polars/tests/benchmark/test_tpch.py::test_tpch_q3
+1%
5.5 ms
5.4 ms
test_tpch_q4
py-polars/tests/benchmark/test_tpch.py::test_tpch_q4
+6%
4.4 ms
4.1 ms
test_tpch_q5
py-polars/tests/benchmark/test_tpch.py::test_tpch_q5
+4%
4.5 ms
4.3 ms
test_tpch_q6
py-polars/tests/benchmark/test_tpch.py::test_tpch_q6
-3%
1.8 ms
1.9 ms
test_tpch_q7
py-polars/tests/benchmark/test_tpch.py::test_tpch_q7
-2%
8.2 ms
8.4 ms
test_tpch_q8
py-polars/tests/benchmark/test_tpch.py::test_tpch_q8
0%
5.5 ms
5.5 ms
test_tpch_q9
py-polars/tests/benchmark/test_tpch.py::test_tpch_q9
+1%
25.2 ms
24.9 ms

Ignored

test_filter2Ignored
py-polars/tests/benchmark/test_filter.py::test_filter2
+2%
1 ms
1 ms

Commits

Click on a commit to change the comparison range
base
main
462bc8b
0%
perf: Fix pathological small chunk parquet writing
2d4c7cd
2 months ago
by ritchie46
0%
fix
472e22e
2 months ago
by ritchie46
+1%
fix
b152463
2 months ago
by ritchie46
ResourcesHomePricingDocsBlogGitHub
Copyright © 2024 CodSpeed Technology SAS. All rights reserved.