Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

feat: Overwrite partitions mode

#3687Merged
Comparing
colin/overwrite-partitions
(
65f5da5
) with
main
(
6b302af
)
CodSpeed Performance Gauge
+43%
Improvements
1
Regressions
0
Untouched
26
New
0
Dropped
0
Ignored
1

Benchmarks

Improved

test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
CodSpeed Performance Gauge
+43%
193.5 ms
135.4 ms

Passed

test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
CodSpeed Performance Gauge
+8%
12.4 ms
11.5 ms
test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
CodSpeed Performance Gauge
+3%
16.5 ms
16.1 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
CodSpeed Performance Gauge
+3%
98.1 ms
95.7 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
CodSpeed Performance Gauge
+2%
144.9 ms
142.7 ms
test_tpch_sql[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-4]
CodSpeed Performance Gauge
0%
102.7 ms
102.4 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
CodSpeed Performance Gauge
0%
475.4 ms
474.1 ms
test_tpch_sql[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-7]
CodSpeed Performance Gauge
0%
703.3 ms
702.6 ms
test_tpch_sql[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-3]
CodSpeed Performance Gauge
0%
134 ms
134 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
CodSpeed Performance Gauge
0%
143.5 ms
143.5 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
CodSpeed Performance Gauge
0%
72.3 ms
72.4 ms
test_tpch_sql[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
28.7 ms
28.8 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
28.6 ms
28.6 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
CodSpeed Performance Gauge
0%
317.1 ms
318.1 ms
test_tpch_sql[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-1]
CodSpeed Performance Gauge
0%
483.1 ms
485.2 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
CodSpeed Performance Gauge
0%
187.1 ms
187.9 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
CodSpeed Performance Gauge
0%
462.8 ms
465 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
CodSpeed Performance Gauge
0%
101.7 ms
102.2 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
CodSpeed Performance Gauge
-1%
101.5 ms
102 ms
test_tpch_sql[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-8]
CodSpeed Performance Gauge
-1%
134.1 ms
135 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
CodSpeed Performance Gauge
-1%
3.3 ms
3.4 ms
test_tpch_sql[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-10]
CodSpeed Performance Gauge
-1%
208.8 ms
210.9 ms
test_tpch_sql[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-2]
CodSpeed Performance Gauge
-1%
207.1 ms
209.4 ms
test_tpch_sql[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-9]
CodSpeed Performance Gauge
-1%
470.6 ms
476.6 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
CodSpeed Performance Gauge
-2%
6 ms
6.1 ms
test_tpch_sql[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch_sql[1-in-memory-native-5]
CodSpeed Performance Gauge
-2%
228.9 ms
234.2 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
CodSpeed Performance Gauge
-2%
210.5 ms
215.5 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
CodSpeed Performance Gauge
0%
1.7 ms
1.7 ms

Commits

Click on a commit to change the comparison range
Base
main
6b302af
-34%
overwrite partitions
9bef3ae
9 days ago
+35%
refactor
23e1ab1
8 days ago
+43%
comment
65f5da5
8 days ago
Home Terms PrivacyDocs