Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

Performance History

Latest Results

ci: Include New Contributers in Automated Draft Releases (#7234) ## Changes Made Auto-generate the new contributor list on release descriptions by using the native GitHub release drafter instead of the custom GitHub Actions we have. It should persist the other sections, but I'm not able to fully test until its merged into main.
main
2 hours ago
feat(writers): add single_file kwarg to write_parquet (#7004) ## Changes Made Add `single_file: bool = False` to `DataFrame.write_parquet`. When `True`, the data is coalesced into one Parquet file written at the exact path given, instead of a directory of UUID-named files. ```py df.write_parquet("out.parquet", single_file=True) ``` **How it works.** The flag is threaded from the Python API through the logical plan into the writer pipeline. A new non-rotating writer wrapper bypasses the usual target-file-size rollover so all input partitions stream into one writer. The filename helper uses the user's path verbatim, skipping partition-dir and UUID generation. Parent directories are auto-created. Row-group batching is preserved. For empty DataFrames, the writer is skipped and an empty Parquet file is emitted via the commit path at the exact destination. **Modes.** Both `append` (default) and `overwrite` work — Parquet has no append semantic, so each write truncates the target via `File::create`. `overwrite`'s pre-clean is a safe no-op for single-file paths. **Validation.** Raises a clear error when `single_file=True` is combined with `partition_cols`, `write_mode="overwrite-partitions"`, `write_success_file=True`, the Ray runner, or schemas that fall back to the PyArrow writer. **Scope.** Parquet on the native runner only. CSV/JSON, the PyArrow fallback, and a shuffle-to-one for the Ray runner are left as follow-ups — those paths currently error out instead of silently falling back to UUID-dir behavior. Tests cover the happy path, parent-dir auto-creation, large data that would otherwise split across multiple files, empty DataFrames, `overwrite` mode, and rejection of `partition_cols` / `write_success_file`. ## Related Issues Closes #2359
main
6 hours ago
docs: address checkpointing guide feedback
rohit/df-2049-checkpoint-user-guide
6 hours ago
feat: add egodex dataset API
everettVT/egodex-dataset
7 hours ago

Latest Branches

CodSpeed Performance Gauge
0%
feat(functions): add try_add, try_subtract, and try_multiply with null-on-overflow#7238
6 hours ago
5e9c86d
BABTUNA:feat/functions-try-arithmetic
CodSpeed Performance Gauge
0%
docs(checkpoint): add user guide and connector cross-references#6985
7 hours ago
5ea0ef8
rohit/df-2049-checkpoint-user-guide
CodSpeed Performance Gauge
0%
feat: add egodex dataset API#7233
10 hours ago
8e5ffcf
everettVT/egodex-dataset
© 2026 CodSpeed Technology
Home Terms Privacy Docs