Eventual-Inc
Daft
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
perf(shuffles): Incrementally retrieve metadata in reduce
#3545
Merged
Comparing
colin/incremental-metadata-retrieval
(
f15c7e5
) with
main
(
6157ad8
)
CodSpeed Performance Gauge
-14%
Untouched
24
Ignored
4
Benchmarks
Passed
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
CodSpeed Performance Gauge
+2%
105.1 ms
103 ms
test_tpch_sql[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-3]
CodSpeed Performance Gauge
+1%
139.9 ms
138.1 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
CodSpeed Performance Gauge
+1%
147 ms
145.3 ms
test_tpch_sql[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-9]
CodSpeed Performance Gauge
+1%
482.3 ms
478.7 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
CodSpeed Performance Gauge
+1%
101.8 ms
101.2 ms
test_tpch_sql[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-5]
CodSpeed Performance Gauge
0%
236.4 ms
235.7 ms
test_tpch_sql[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-2]
CodSpeed Performance Gauge
0%
226.5 ms
226 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
CodSpeed Performance Gauge
0%
72.5 ms
72.4 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
CodSpeed Performance Gauge
0%
11.7 ms
11.7 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
CodSpeed Performance Gauge
0%
467.3 ms
467.2 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
CodSpeed Performance Gauge
0%
6 ms
6 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
CodSpeed Performance Gauge
0%
220 ms
220.2 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
CodSpeed Performance Gauge
0%
469.1 ms
469.5 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
29 ms
29.1 ms
test_tpch_sql[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-4]
CodSpeed Performance Gauge
0%
106.4 ms
106.6 ms
test_tpch_sql[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
29.7 ms
29.8 ms
test_tpch_sql[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-7]
CodSpeed Performance Gauge
0%
712 ms
713.8 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
CodSpeed Performance Gauge
0%
148 ms
148.5 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
CodSpeed Performance Gauge
0%
107.1 ms
107.6 ms
test_tpch_sql[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-8]
CodSpeed Performance Gauge
-1%
146.4 ms
147.2 ms
test_tpch_sql[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-10]
CodSpeed Performance Gauge
-1%
222.1 ms
223.6 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
CodSpeed Performance Gauge
-1%
190 ms
191.3 ms
test_tpch_sql[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-1]
CodSpeed Performance Gauge
-1%
484.9 ms
491.1 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
CodSpeed Performance Gauge
-2%
323 ms
328.8 ms
Ignored
test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
Ignored
CodSpeed Performance Gauge
-3%
15.8 ms
16.4 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
Ignored
CodSpeed Performance Gauge
-9%
3.5 ms
3.9 ms
test_explain[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
Ignored
CodSpeed Performance Gauge
+5%
1.8 ms
1.7 ms
test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
Ignored
CodSpeed Performance Gauge
-14%
192.6 ms
223.5 ms
Commits
Click on a commit to change the comparison range
Base
main
6157ad8
-38.37%
cleanup
8ab38ea
9 months ago
×2.1
Merge branch 'main' into colin/incremental-metadata-retrieval
41cb49a
8 months ago
by colin-ho
-87.09%
cache metadata
f15c7e5
8 months ago
by colin-ho
© 2025 CodSpeed Technology
Home
Terms
Privacy
Docs