BlogDocs

[FEAT] Estimate materialized size of ScanTask better from Parquet reads(#3302)

Closed
Comparing
jay/better-scan-task-estimations-2
(
b6a7b7f
) with
main
(
60ae62f
)
+42%
IMPROVEMENTS
1
REGRESSIONS
0
UNTOUCHED
16
NEW
0
DROPPED
0
IGNORED
1

Benchmarks

Improved

test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
+42%
388.4 ms
273.1 ms

Passed

test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
+8%
7.4 ms
6.9 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
+2%
198.2 ms
195 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
+1%
342.7 ms
340 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
+1%
144.1 ms
143.2 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
0%
364.9 ms
363.3 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
0%
28.7 ms
28.7 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
0%
102.3 ms
102.1 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
0%
131.3 ms
131 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
0%
380.3 ms
380.6 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
-1%
11.7 ms
11.7 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
-1%
97.5 ms
98.1 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
-1%
137.9 ms
138.8 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
-1%
437.8 ms
441.6 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
-1%
69.5 ms
70.4 ms
test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
-3%
23.1 ms
23.7 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
-3%
3.3 ms
3.4 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
-1%
1.9 ms
2 ms

Commits

Click on a commit to change the comparison range
base
main
60ae62f
-1%
nit
e516c54
4 days ago
+41%
Add unit tests
6bcece7
2 days ago
+2%
Rename for clarity
b6a7b7f
2 days ago
ResourcesHomePricingDocsBlogGitHubChangelog
Getting StartedSample repositoryExplore repositoriesSupport
AboutCareersTwitterDiscordContact UsTerms of ServicePrivacy Policy
Copyright © 2024 CodSpeed Technology SAS. All rights reserved.