Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

feat: Unity Catalog writes using `daft.DataFrame.write_deltalake()`

#3522Merged
Comparing
anilmenon14:uc-write-deltalake
(
cb4a2ee
) with
main
(
f23ee37
)
CodSpeed Performance Gauge
-13%
Untouched
14
Ignored
4

Benchmarks

Passed

test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
CodSpeed Performance Gauge
+1%
449.8 ms443.3 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
CodSpeed Performance Gauge
+1%
11.4 ms11.3 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
CodSpeed Performance Gauge
+1%
101.5 ms100.8 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
CodSpeed Performance Gauge
0%
143.5 ms143.1 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
CodSpeed Performance Gauge
0%
132.4 ms132 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
CodSpeed Performance Gauge
0%
28.9 ms28.8 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
CodSpeed Performance Gauge
0%
199 ms199.4 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
CodSpeed Performance Gauge
0%
448.8 ms450.2 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
CodSpeed Performance Gauge
0%
72 ms72.3 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
CodSpeed Performance Gauge
0%
315.7 ms317.2 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
CodSpeed Performance Gauge
-1%
138.5 ms139.6 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
CodSpeed Performance Gauge
-1%
98 ms98.8 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
CodSpeed Performance Gauge
-1%
157.6 ms159.4 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
CodSpeed Performance Gauge
-2%
8.3 ms8.4 ms

Ignored

test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
Ignored
CodSpeed Performance Gauge
+54%
23.8 ms15.5 ms
test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
Ignored
CodSpeed Performance Gauge
-13%
189.2 ms217.5 ms
test_explain[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
Ignored
CodSpeed Performance Gauge
-2%
1.9 ms1.9 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
Ignored
CodSpeed Performance Gauge
-5%
3.3 ms3.5 ms

Commits

Click on a commit to change the comparison range
Base
main
f23ee37
+71.35%
Adding pinned dependency for httpx due to known Unity catalog issue
ce3e753
9 months ago
by anilmenon14
+5.14%
Handling None values of io_config prior to invoking 'io_config_to_storage_options' to address mypy typing checks
8c22114
9 months ago
by anilmenon14
Update daft/unity_catalog/unity_catalog.py Updating error message to be descriptive about the table name passed along. Co-authored-by: Kev Wang <kev@kevwang.dev>
20ee1c4
9 months ago
by anilmenon14
+16.58%
Merge branch 'Eventual-Inc:main' into uc-write-deltalake
cb4a2ee
9 months ago
by anilmenon14
© 2025 CodSpeed Technology
Home Terms Privacy Docs