Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocs

[PERF] Remove upfront buffer allocations for local CSV reader

#3242Merged
Comparing
desmondcheongzx:remove-upfront-csv-buffer-allocations
(
25cb584
) with
main
(
baca61e
)
-1%
Improvements
0
Regressions
0
Untouched
17
New
0
Dropped
0
Ignored
1

Benchmarks

Passed

test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
0%
140.5 ms
140.1 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
0%
144.1 ms
143.7 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
0%
127.4 ms
127.1 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
0%
101.9 ms
101.9 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
0%
28.7 ms
28.7 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
0%
383 ms
382.9 ms
test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
0%
9.5 s
9.5 s
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
0%
369.7 ms
370.7 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
0%
133.8 ms
134.1 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
-1%
195.4 ms
197.1 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
-1%
339.1 ms
343.9 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
-1%
7 ms
7.1 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
-1%
439.1 ms
445.6 ms
test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
-2%
16.2 ms
16.5 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
-2%
98.8 ms
100.7 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
-2%
4.1 ms
4.2 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
-4%
12.9 ms
13.4 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
-2%
1.8 ms
1.9 ms

Commits

Click on a commit to change the comparison range
Base
main
baca61e
-1%
Remove allocations
25cb584
22 days ago
by desmondcheongzx
Home Terms PrivacyDocs