BlogDocs

refactor(rust): Scan from BytesIO in new-streaming parquet source(#18643)

Merged
Merging
nameexhaustion:pq-s-source
(
5327254
) into
main
(
5ccb238
)
-1%
IMPROVEMENTS
0
REGRESSIONS
0
UNTOUCHED
39
NEW
0
DROPPED
0
IGNORED
1

Benchmarks

Passed

test_pdsh_q22
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q22
+11%
7 ms
6.3 ms
test_pdsh_q4
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q4
+8%
5.1 ms
4.7 ms
test_pdsh_q2
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q2
+7%
3.8 ms
3.5 ms
test_pdsh_q7
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q7
+3%
9.7 ms
9.5 ms
test_groupby_h2oai_q4
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q4
+3%
1.9 ms
1.9 ms
test_pdsh_q1
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q1
+2%
16.3 ms
16 ms
test_pdsh_q8
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q8
+2%
5.5 ms
5.4 ms
test_pdsh_q13
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q13
+1%
9.8 ms
9.7 ms
test_groupby_h2oai_q6
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q6
+1%
12.7 ms
12.6 ms
test_pdsh_q16
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q16
+1%
7 ms
7 ms
test_strict_inequalities
py-polars/tests/benchmark/test_join_where.py::test_strict_inequalities
+1%
169.5 ms
168.4 ms
test_pdsh_q19
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q19
0%
7.6 ms
7.6 ms
test_pdsh_q17
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q17
0%
6.7 ms
6.7 ms
test_pdsh_q6
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q6
0%
1.9 ms
1.9 ms
test_non_strict_inequalities
py-polars/tests/benchmark/test_join_where.py::test_non_strict_inequalities
0%
174.4 ms
173.9 ms
test_groupby_h2oai_q9
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q9
0%
26.3 ms
26.3 ms
test_groupby_h2oai_q2
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q2
0%
4.4 ms
4.4 ms
test_pdsh_q21
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q21
0%
213.5 ms
213.3 ms
test_to_numpy_series_zero_copy
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_zero_copy
0%
123.5 µs
123.4 µs
test_to_numpy_series_with_nulls
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_with_nulls
0%
435.2 µs
435.2 µs
test_to_numpy_series_chunked
py-polars/tests/benchmark/interop/test_numpy.py::test_to_numpy_series_chunked
0%
270.9 µs
271.2 µs
test_pdsh_q11
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q11
0%
4 ms
4 ms
test_pdsh_q18
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q18
-1%
11.8 ms
11.9 ms
test_groupby_h2oai_q10
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q10
-1%
6.2 ms
6.2 ms
test_filter1
py-polars/tests/benchmark/test_filter.py::test_filter1
-2%
796.4 µs
810.1 µs
test_pdsh_q12
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q12
-2%
6 ms
6.1 ms
test_groupby_h2oai_q5
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q5
-2%
1.9 ms
1.9 ms
test_pdsh_q9
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q9
-2%
25.3 ms
25.9 ms
test_groupby_h2oai_q3
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q3
-2%
2.6 ms
2.7 ms
test_pdsh_q14
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q14
-3%
2.1 ms
2.2 ms
test_groupby_h2oai_q1
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q1
-3%
2.2 ms
2.3 ms
test_pdsh_q15
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q15
-4%
2.3 ms
2.4 ms
test_write_read_scan_large_csv
py-polars/tests/benchmark/test_io.py::test_write_read_scan_large_csv
-4%
30.9 ms
32.2 ms
test_pdsh_q3
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q3
-4%
5.8 ms
6.1 ms
test_pdsh_q10
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q10
-6%
6 ms
6.4 ms
test_groupby_h2oai_q8
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q8
-7%
2.9 ms
3.1 ms
test_pdsh_q5
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q5
-11%
4.7 ms
5.2 ms
test_pdsh_q20
py-polars/tests/benchmark/test_pdsh.py::test_pdsh_q20
-11%
6.1 ms
6.9 ms
test_groupby_h2oai_q7
py-polars/tests/benchmark/test_group_by.py::test_groupby_h2oai_q7
-12%
2.1 ms
2.4 ms

Ignored

test_filter2Ignored
py-polars/tests/benchmark/test_filter.py::test_filter2
-5%
1.1 ms
1.1 ms

Commits

Click on a commit to change the comparison range
base
main
5ccb238
-1%
c
5327254
11 days ago
by nameexhaustion
ResourcesHomePricingDocsBlogGitHubChangelog
Copyright © 2024 CodSpeed Technology SAS. All rights reserved.