Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

feat: Limit number of sources in merged scan task

#3695Merged
Comparing
colin/cap-scan-task-merge
(
a5b9f5e
) with
main
(
603199f
)
CodSpeed Performance Gauge
-20%
Improvements
1
Regressions
1
Untouched
25
New
0
Dropped
0
Ignored
1

Benchmarks

Failed

test_iter_rows_first_row[100 Small Files]Regression
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
CodSpeed Performance Gauge
-20%
160.9 ms
200.3 ms

Improved

test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
CodSpeed Performance Gauge
+22%
20.2 ms
16.6 ms

Passed

test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
CodSpeed Performance Gauge
+2%
11.7 ms
11.4 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
CodSpeed Performance Gauge
+2%
97.8 ms
95.8 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
CodSpeed Performance Gauge
+2%
189 ms
185.7 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
CodSpeed Performance Gauge
+2%
73.1 ms
72 ms
test_tpch_sql[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-5]
CodSpeed Performance Gauge
+2%
231.9 ms
228.4 ms
test_tpch_sql[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-4]
CodSpeed Performance Gauge
+1%
103 ms
102.3 ms
test_tpch_sql[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-10]
CodSpeed Performance Gauge
+1%
210.3 ms
209 ms
test_tpch_sql[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-7]
CodSpeed Performance Gauge
0%
698.8 ms
695.3 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
CodSpeed Performance Gauge
0%
143.1 ms
142.7 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
CodSpeed Performance Gauge
0%
469.9 ms
469.3 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
CodSpeed Performance Gauge
0%
143.3 ms
143.2 ms
test_tpch_sql[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
28.7 ms
28.7 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
CodSpeed Performance Gauge
0%
210.7 ms
210.9 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
28.6 ms
28.7 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
CodSpeed Performance Gauge
0%
101.1 ms
101.4 ms
test_tpch_sql[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-8]
CodSpeed Performance Gauge
0%
134.4 ms
134.8 ms
test_tpch_sql[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-1]
CodSpeed Performance Gauge
0%
483.4 ms
485.1 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
CodSpeed Performance Gauge
-1%
6.1 ms
6.2 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
CodSpeed Performance Gauge
-1%
457.6 ms
461.4 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
CodSpeed Performance Gauge
-1%
317.4 ms
320.8 ms
test_tpch_sql[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-2]
CodSpeed Performance Gauge
-1%
204.5 ms
207 ms
test_tpch_sql[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-9]
CodSpeed Performance Gauge
-1%
469.7 ms
476.1 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
CodSpeed Performance Gauge
-1%
102.3 ms
103.7 ms
test_tpch_sql[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-3]
CodSpeed Performance Gauge
-2%
132.7 ms
135.5 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
CodSpeed Performance Gauge
-5%
3.3 ms
3.4 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
CodSpeed Performance Gauge
-1%
1.9 ms
1.9 ms

Commits

Click on a commit to change the comparison range
Base
main
603199f
+11%
rename to max sources
e129727
21 days ago
by colin-ho
-54%
clean up
18ca138
21 days ago
by colin-ho
+23%
test
a5b9f5e
10 days ago
Home Terms PrivacyDocs