Avatar for the pola-rs user
pola-rs
polars
BlogDocsChangelog

fix: Scanning hive partitioned files where hive columns are partially included in the file

#18626Merged
Comparing
nameexhaustion:hive-partial
(
800f4e6
) with
main
(
253057a
)
CodSpeed Performance Gauge
-1%
Improvements
0
Regressions
0
Untouched
39
New
0
Dropped
0
Ignored
1

Benchmarks

Passed

test_pdsh_q15
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q15
CodSpeed Performance Gauge
+10%
2.6 ms
2.4 ms
test_pdsh_q2
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q2
CodSpeed Performance Gauge
+7%
3.8 ms
3.6 ms
test_pdsh_q3
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q3
CodSpeed Performance Gauge
+6%
6.1 ms
5.8 ms
test_groupby_h2oai_q3
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q3
CodSpeed Performance Gauge
+5%
2.5 ms
2.4 ms
test_pdsh_q10
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q10
CodSpeed Performance Gauge
+5%
6.5 ms
6.2 ms
test_groupby_h2oai_q8
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q8
CodSpeed Performance Gauge
+4%
2.9 ms
2.8 ms
test_write_read_scan_large_csv
py-polars/tests/benchmark/test_io.py::test_write_read_scan_large_csv
CodSpeed Performance Gauge
+3%
32.1 ms
31.3 ms
test_pdsh_q17
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q17
CodSpeed Performance Gauge
+2%
7 ms
6.8 ms
test_pdsh_q18
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q18
CodSpeed Performance Gauge
+2%
11.7 ms
11.5 ms
test_pdsh_q19
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q19
CodSpeed Performance Gauge
+2%
7.6 ms
7.5 ms
test_pdsh_q11
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q11
CodSpeed Performance Gauge
+2%
4.2 ms
4.1 ms
test_pdsh_q14
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q14
CodSpeed Performance Gauge
+1%
2.3 ms
2.3 ms
test_pdsh_q21
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q21
CodSpeed Performance Gauge
+1%
214.7 ms
212.9 ms
test_non_strict_inequalities
py-polars/tests/benchmark/test_join_where.py::test_non_strict_inequalities
CodSpeed Performance Gauge
0%
174.7 ms
173.9 ms
test_pdsh_q7
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q7
CodSpeed Performance Gauge
0%
9.5 ms
9.5 ms
test_to_numpy_series_zero_copy
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_zero_copy
CodSpeed Performance Gauge
0%
123.5 µs
123.1 µs
test_to_numpy_series_chunked
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_chunked
CodSpeed Performance Gauge
0%
271.2 µs
270.6 µs
test_to_numpy_series_with_nulls
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_with_nulls
CodSpeed Performance Gauge
0%
435.6 µs
435.1 µs
test_groupby_h2oai_q5
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q5
CodSpeed Performance Gauge
0%
1.9 ms
1.9 ms
test_strict_inequalities
py-polars/tests/benchmark/test_join_where.py::test_strict_inequalities
CodSpeed Performance Gauge
0%
168.5 ms
168.6 ms
test_pdsh_q20
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q20
CodSpeed Performance Gauge
0%
6.2 ms
6.2 ms
test_groupby_h2oai_q7
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q7
CodSpeed Performance Gauge
0%
2.1 ms
2.1 ms
test_pdsh_q12
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q12
CodSpeed Performance Gauge
0%
6.3 ms
6.3 ms
test_pdsh_q16
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q16
CodSpeed Performance Gauge
-1%
7.1 ms
7.2 ms
test_pdsh_q22
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q22
CodSpeed Performance Gauge
-1%
6.6 ms
6.6 ms
test_pdsh_q13
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q13
CodSpeed Performance Gauge
-1%
9.9 ms
10 ms
test_groupby_h2oai_q6
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q6
CodSpeed Performance Gauge
-1%
12.8 ms
12.9 ms
test_groupby_h2oai_q9
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q9
CodSpeed Performance Gauge
-2%
26.1 ms
26.6 ms
test_pdsh_q4
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q4
CodSpeed Performance Gauge
-2%
4.8 ms
4.9 ms
test_pdsh_q6
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q6
CodSpeed Performance Gauge
-2%
1.9 ms
1.9 ms
test_pdsh_q9
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q9
CodSpeed Performance Gauge
-3%
25.2 ms
26 ms
test_pdsh_q1
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q1
CodSpeed Performance Gauge
-4%
16.1 ms
16.8 ms
test_groupby_h2oai_q10
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q10
CodSpeed Performance Gauge
-6%
6.1 ms
6.4 ms
test_pdsh_q8
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q8
CodSpeed Performance Gauge
-6%
5.2 ms
5.6 ms
test_groupby_h2oai_q2
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q2
CodSpeed Performance Gauge
-7%
4.5 ms
4.8 ms
test_groupby_h2oai_q1
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q1
CodSpeed Performance Gauge
-7%
2.3 ms
2.5 ms
test_filter1
py-polars/tests/benchmark/test_filter.py::test_filter1
CodSpeed Performance Gauge
-7%
745.2 µs
803.7 µs
test_pdsh_q5
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q5
CodSpeed Performance Gauge
-8%
4.7 ms
5.1 ms
test_groupby_h2oai_q4
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q4
CodSpeed Performance Gauge
-11%
1.8 ms
2 ms

Ignored

test_filter2Ignored
py-polars/tests/benchmark/test_filter.py::test_filter2
CodSpeed Performance Gauge
+7%
1.1 ms
1.1 ms

Commits

Click on a commit to change the comparison range
Base
main
253057a
+1%
exclude partial hive columns from projection
ebbc27b
4 months ago
by nameexhaustion
-2%
chop log
800f4e6
4 months ago
by nameexhaustion
© 2025 CodSpeed Technology
Home Terms PrivacyDocs