Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocs

[FEAT] Add initial Spark Connect support

#3261Merged
Comparing
andrew/connect-config
(
a3c6037
) with
main
(
f290f40
)
-35%
Improvements
1
Regressions
2
Untouched
14
New
0
Dropped
0
Ignored
1

Benchmarks

Failed

test_count[1 Small File]Regression
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
-17%
3.3 ms
4 ms
test_iter_rows_first_row[100 Small Files]Regression
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
-35%
177.3 ms
271 ms

Improved

test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
+21%
51.1 ms
42.1 ms

Passed

test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
+2%
452.2 ms
445.1 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
+1%
387.1 ms
383.2 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
+1%
134.7 ms
133.3 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
+1%
196.2 ms
194.3 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
+1%
7.1 ms
7 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
+1%
102 ms
101.3 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
+1%
141.3 ms
140.5 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
+1%
143.2 ms
142.5 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
0%
98.4 ms
98 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
0%
70.4 ms
70.2 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
0%
369.6 ms
369.1 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
0%
338.8 ms
338.6 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
0%
28.7 ms
28.6 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
-2%
11.9 ms
12.1 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
-6%
1.9 ms
2 ms

Commits

Click on a commit to change the comparison range
Base
main
f290f40
-32%
improve tests
b256674
17 days ago
by andrewgazelka
-3%
fix test
c85e106
17 days ago
by andrewgazelka
+10%
add pyspark to requirements.txt
6df3662
17 days ago
by andrewgazelka
-22%
fix machete
9c3fb9d
17 days ago
by andrewgazelka
-1%
(machete) remove tempfile
4e01c36
17 days ago
by andrewgazelka
+106%
change err macros
3829304
17 days ago
by andrewgazelka
-93%
add grpcio
a1eb2ba
17 days ago
by andrewgazelka
+10%
add handle
a8e448e
17 days ago
by andrewgazelka
-32%
add gprc status
3343b32
17 days ago
by andrewgazelka
+33%
fix style
11914b0
17 days ago
by andrewgazelka
-11%
fix print
a3c6037
17 days ago
by andrewgazelka
Home Terms PrivacyDocs