Avatar for the pola-rs user
pola-rs
polars
BlogDocsChangelog

perf: Use bitmask to filter Parquet predicate-pushdown items

#17993Merged
Comparing
coastalwhite:parquet-mask-filter
(
06f409a
) with
main
(
fd00ee6
)
CodSpeed Performance Gauge
-1%
Improvements
0
Regressions
0
Untouched
37
New
0
Dropped
0
Ignored
1

Benchmarks

Passed

test_groupby_h2oai_q2
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q2
CodSpeed Performance Gauge
+8%
4.6 ms
4.3 ms
test_groupby_h2oai_q5
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q5
CodSpeed Performance Gauge
+5%
1.9 ms
1.8 ms
test_tpch_q12
py-polars/tests/benchmark/test_tpch.py::test_tpch_q12
CodSpeed Performance Gauge
+4%
6.2 ms
6 ms
test_tpch_q6
py-polars/tests/benchmark/test_tpch.py::test_tpch_q6
CodSpeed Performance Gauge
+4%
1.9 ms
1.9 ms
test_tpch_q5
py-polars/tests/benchmark/test_tpch.py::test_tpch_q5
CodSpeed Performance Gauge
+3%
5.1 ms
5 ms
test_tpch_q16
py-polars/tests/benchmark/test_tpch.py::test_tpch_q16
CodSpeed Performance Gauge
+2%
7.2 ms
7.1 ms
test_groupby_h2oai_q7
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q7
CodSpeed Performance Gauge
+2%
2.1 ms
2.1 ms
test_tpch_q15
py-polars/tests/benchmark/test_tpch.py::test_tpch_q15
CodSpeed Performance Gauge
+2%
2.5 ms
2.5 ms
test_groupby_h2oai_q10
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q10
CodSpeed Performance Gauge
+2%
6.5 ms
6.4 ms
test_groupby_h2oai_q9
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q9
CodSpeed Performance Gauge
+2%
27 ms
26.5 ms
test_tpch_q1
py-polars/tests/benchmark/test_tpch.py::test_tpch_q1
CodSpeed Performance Gauge
+1%
16.6 ms
16.4 ms
test_tpch_q14
py-polars/tests/benchmark/test_tpch.py::test_tpch_q14
CodSpeed Performance Gauge
+1%
2.1 ms
2.1 ms
test_tpch_q20
py-polars/tests/benchmark/test_tpch.py::test_tpch_q20
CodSpeed Performance Gauge
+1%
6.3 ms
6.2 ms
test_write_read_scan_large_csv
py-polars/tests/benchmark/test_io.py::test_write_read_scan_large_csv
CodSpeed Performance Gauge
+1%
33.4 ms
33 ms
test_tpch_q19
py-polars/tests/benchmark/test_tpch.py::test_tpch_q19
CodSpeed Performance Gauge
+1%
7.3 ms
7.2 ms
test_tpch_q21
py-polars/tests/benchmark/test_tpch.py::test_tpch_q21
CodSpeed Performance Gauge
0%
216.2 ms
215.6 ms
test_filter1
py-polars/tests/benchmark/test_filter.py::test_filter1
CodSpeed Performance Gauge
0%
778 µs
775.8 µs
test_to_numpy_series_chunked
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_chunked
CodSpeed Performance Gauge
0%
275.4 µs
275.4 µs
test_to_numpy_series_with_nulls
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_with_nulls
CodSpeed Performance Gauge
0%
310.6 µs
310.7 µs
test_tpch_q9
py-polars/tests/benchmark/test_tpch.py::test_tpch_q9
CodSpeed Performance Gauge
0%
25.4 ms
25.4 ms
test_to_numpy_series_zero_copy
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_zero_copy
CodSpeed Performance Gauge
0%
127.2 µs
127.4 µs
test_groupby_h2oai_q8
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q8
CodSpeed Performance Gauge
0%
2.8 ms
2.8 ms
test_tpch_q10
py-polars/tests/benchmark/test_tpch.py::test_tpch_q10
CodSpeed Performance Gauge
-1%
6.2 ms
6.2 ms
test_groupby_h2oai_q6
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q6
CodSpeed Performance Gauge
-1%
12.9 ms
13.1 ms
test_tpch_q13
py-polars/tests/benchmark/test_tpch.py::test_tpch_q13
CodSpeed Performance Gauge
-1%
9.5 ms
9.6 ms
test_tpch_q17
py-polars/tests/benchmark/test_tpch.py::test_tpch_q17
CodSpeed Performance Gauge
-2%
6.5 ms
6.7 ms
test_tpch_q3
py-polars/tests/benchmark/test_tpch.py::test_tpch_q3
CodSpeed Performance Gauge
-3%
6 ms
6.2 ms
test_tpch_q18
py-polars/tests/benchmark/test_tpch.py::test_tpch_q18
CodSpeed Performance Gauge
-3%
11.3 ms
11.6 ms
test_tpch_q7
py-polars/tests/benchmark/test_tpch.py::test_tpch_q7
CodSpeed Performance Gauge
-3%
9.4 ms
9.7 ms
test_groupby_h2oai_q3
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q3
CodSpeed Performance Gauge
-4%
2.3 ms
2.4 ms
test_groupby_h2oai_q4
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q4
CodSpeed Performance Gauge
-4%
1.9 ms
2 ms
test_tpch_q4
py-polars/tests/benchmark/test_tpch.py::test_tpch_q4
CodSpeed Performance Gauge
-6%
4.8 ms
5.1 ms
test_tpch_q8
py-polars/tests/benchmark/test_tpch.py::test_tpch_q8
CodSpeed Performance Gauge
-6%
5.3 ms
5.6 ms
test_tpch_q2
py-polars/tests/benchmark/test_tpch.py::test_tpch_q2
CodSpeed Performance Gauge
-6%
3.7 ms
3.9 ms
test_groupby_h2oai_q1
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q1
CodSpeed Performance Gauge
-6%
2.4 ms
2.5 ms
test_tpch_q22
py-polars/tests/benchmark/test_tpch.py::test_tpch_q22
CodSpeed Performance Gauge
-8%
6.3 ms
6.8 ms
test_tpch_q11
py-polars/tests/benchmark/test_tpch.py::test_tpch_q11
CodSpeed Performance Gauge
-11%
3.6 ms
4.1 ms

Ignored

test_filter2Ignored
py-polars/tests/benchmark/test_filter.py::test_filter2
CodSpeed Performance Gauge
-1%
1.1 ms
1.1 ms

Commits

Click on a commit to change the comparison range
Base
main
fd00ee6
0%
typos
d91fcd2
5 months ago
by coastalwhite
-1%
add unstable warning
06f409a
5 months ago
by coastalwhite
Home Terms PrivacyDocs