Eventual-Inc
Daft
BlogDocsChangelog

[FEAT] Ray shuffle experiment

#2883Closed
Comparing
jay/shuffle-experiment
(
ade5e2f
) with
main
(
768f422
)
CodSpeed Performance Gauge
0%
Untouched
14
Ignored
4

Benchmarks

Passed

test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
+2%
96.3 ms94.5 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
0%
375.6 ms374.1 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
0%
192.4 ms191.8 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
0%
363 ms363.4 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
0%
28.9 ms29 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
0%
333.7 ms334.6 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
0%
129 ms129.6 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py
CodSpeed Performance Gauge
-1%
126.2 ms126.8 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
-1%
142.8 ms143.9 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py
CodSpeed Performance Gauge
-1%
95.8 ms96.6 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py
CodSpeed Performance Gauge
-1%
6.9 ms7 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
-1%
439.6 ms445.8 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py
CodSpeed Performance Gauge
-2%
137.1 ms139.9 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py
CodSpeed Performance Gauge
-6%
12.6 ms13.5 ms

Ignored

test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py
Ignored
CodSpeed Performance Gauge
-1%
15.9 ms16.1 ms
test_explain[1 Small File]
tests/benchmarks/test_interactive_reads.py
Ignored
CodSpeed Performance Gauge
+8%
1.9 ms1.8 ms
test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py
Ignored
CodSpeed Performance Gauge
0%
8.9 s8.9 s
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py
Ignored
CodSpeed Performance Gauge
+5%
4.4 ms4.2 ms

Commits

Click on a commit to change the comparison range
Base
main
768f422
+0.14%
Add another streaming push variant
cef8843
1 year ago
+0.11%
stub out the thing
005c804
1 year ago
-0.12%
Add simple pull-based shuffle
7e0f88d
1 year ago
-0.54%
Fixes it works locally
1e8b87d
1 year ago
+0.48%
Add node affinity for reducer and merger
37b1d8e
1 year ago
-0.55%
Fix math for number of returns from mapper
ade5e2f
1 year ago
© 2025 CodSpeed Technology
Home Terms Privacy Docs