BlogDocs

[FEAT] Dynamically parallel local parquet reader(#3310)

Comparing
colin/dynamic-parquet
(
460b060
) with
main
(
274f300
)
-15%
IMPROVEMENTS
1
REGRESSIONS
1
UNTOUCHED
15
NEW
0
DROPPED
0
IGNORED
1

Benchmarks

Failed

test_show[100 Small Files]Regression
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
-15%
23.9 ms
28 ms

Improved

test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
+64%
378.4 ms
230.9 ms

Passed

test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
+7%
11.7 ms
11 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
+1%
102 ms
100.7 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
+1%
445.3 ms
439.6 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
+1%
7.3 ms
7.2 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
+1%
97.7 ms
96.8 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
+1%
378.7 ms
375.4 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
0%
339.7 ms
338.1 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
0%
138.5 ms
137.8 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
0%
143.3 ms
142.9 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
0%
130.8 ms
130.8 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
0%
28.7 ms
28.7 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
-1%
192.6 ms
194.2 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
-1%
69.5 ms
70.4 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
-1%
368.9 ms
373.7 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
-4%
3.4 ms
3.5 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
+2%
2 ms
2 ms

Commits

Click on a commit to change the comparison range
base
main
274f300
-29%
dynamic parquet reading
f107208
7 days ago
+1%
table new with size
0ecb1ad
7 days ago
-1%
benchmarking test
1fc2019
7 days ago
+15%
more comments
460b060
6 days ago
ResourcesHomePricingDocsBlogGitHubChangelog
Getting StartedSample repositoryExplore repositoriesSupport
AboutCareersTwitterDiscordContact UsTerms of ServicePrivacy Policy
Copyright © 2024 CodSpeed Technology SAS. All rights reserved.