Eventual-Inc
Daft
BlogDocs

[PERF] Improve hash table probe side decisions for Swordfish

#3327
Comparing
desmondcheongzx:lift-stats-to-logical-plan
(
68324a9
) with
main
(
5dce4fb
)
-19%
Improvements
4
Regressions
1
Untouched
12
New
0
Dropped
0
Ignored
1

Benchmarks

Failed

test_tpch[1-in-memory-native-9]Regression
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
-19%
363.1 ms
447.8 ms

Improved

test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
×2.2
341.9 ms
157.4 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
+21%
383 ms
316.6 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
+21%
7.2 ms
6 ms
test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
+20%
29.8 ms
24.8 ms

Passed

test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
+9%
378.7 ms
347.9 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
+1%
445.6 ms
440.3 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
0%
102 ms
101.7 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
0%
131.2 ms
131.4 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
0%
28.7 ms
28.9 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
-1%
137.8 ms
138.7 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
-1%
143.2 ms
144.1 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
-1%
97.4 ms
98.4 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
-2%
11.6 ms
11.9 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
-2%
195.2 ms
199.9 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
-2%
70.1 ms
71.8 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
-8%
3.5 ms
3.8 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
+10%
2 ms
1.8 ms

Commits

Click on a commit to change the comparison range
Base
main
5dce4fb
-25%
Implement
9510233
7 days ago
by desmondcheongzx
-7%
Fix case with generator scan operators
0792408
5 days ago
by desmondcheongzx
-23%
Merge branch 'main' into lift-stats-to-logical-plan
574ad0a
4 days ago
by desmondcheongzx
+15%
Fix outer joins
849083a
4 days ago
by desmondcheongzx
+21%
Undo debugging changes
8458c74
3 days ago
by desmondcheongzx
-10%
Fix
4ef4998
3 days ago
by desmondcheongzx
+11%
Cleanup
b3e4c3a
2 days ago
by desmondcheongzx
-1%
Clean up with materialized_stats()
a3aa463
2 days ago
by desmondcheongzx
0%
Clarify comment
307393b
2 days ago
by desmondcheongzx
-2%
Fix variable name
351d8fe
2 days ago
by desmondcheongzx
+1%
Rename variable
28b467f
2 days ago
by desmondcheongzx
+2%
Implement AlwaysSame
e175cba
2 days ago
by desmondcheongzx
-10%
Clean up comments
fc0d66b
2 days ago
by desmondcheongzx
+10%
Add inlines to AlwaysSame
3d15982
2 days ago
by desmondcheongzx
0%
Clarify two pass join algorithm
68324a9
2 days ago
by desmondcheongzx
Home Terms PrivacyDocs