Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

refactor(io): reuse Rust Hive helpers for ORC partitions Use private Python bindings to infer Hive partition schemas and convert directory values with the existing Rust helpers. Keep ORC missing-key nulls and directory-value precedence, and retain typed constants through pruning, serialization, and batch injection. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:orc-hive-partitioning

4 hours ago

refactor(io): unify ORC schemas and constant projection Pass Daft schemas from ORC sources to tasks and readers, and use a local fill map for path literals in the existing batch projection. Extend coverage for same-named physical fields, task projection and serialization, and remote filtering and row counts. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:orc-file-path-column

4 hours ago

test(io): make ORC subprocess check explicit Set check=False while retaining explicit exit-code and output assertions. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:orc-ignore-corrupt-files

4 hours ago

feat(io): support ignoring corrupt ORC files Add opt-in schema fallback and conservative ORC error filtering. Report skipped files through existing execution statistics while preserving emitted batches and unrelated error propagation. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:orc-ignore-corrupt-files

8 hours ago

feat(io): support Hive directory partitioning in read_orc Read Hive directory partition columns and prune ORC scan tasks using partition predicates. Preserve typed constants through projections and residual filtering, with reader tests and documentation. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:orc-hive-partitioning

8 hours ago

feat(io): support file_path_column in ORC reads Add a source path column through the existing ORC batch projection and cover schema, projection, filtering, URI, empty-file, and serialization behavior. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:orc-file-path-column

9 hours ago

feat(io): support explicit schema and schema hints in read_orc Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:orc-schema-hints

9 hours ago

fix(core): handle all-null literal batches for tensor/sparse_tensor/map Row-wise UDFs returning tensor, sparse_tensor, or map failed with "Need at least 1 series to perform concat" whenever every row in a batch was null (a UDF that returns None, or that raises on all rows). The Tensor, SparseTensor, and Map arms of `series_from_literals_iter` passed the all-None vec to `ListArray::from_series`, which concatenates zero child series and errors. Under `on_error="raise"` that error returned before the `errs` check at the end of the function, masking the UDF's real exception. Short-circuit to an all-null series of the target dtype when every value is None, mirroring the List fix from #7168. Execution then reaches the `errs` check, so `on_error="raise"` surfaces the real error while `on_error="ignore"` / all-None returns an all-null column. The Embedding and Image arms were already unaffected. Fixes #7584

hello-peter-tang:fix/7584-all-null-tensor-map-udf

11 hours ago

Latest Branches

0%

feat(io): support Hive directory partitioning in read_orc#7599

4 hours ago

66128e2

jiangxt2:orc-hive-partitioning

0%

feat(io): support file_path_column in ORC reads#7598

4 hours ago

7f87fc5

jiangxt2:orc-file-path-column

0%

feat(io): support ignoring corrupt ORC files#7600

5 hours ago

6c48783

jiangxt2:orc-ignore-corrupt-files

© 2026 CodSpeed Technology

Home Terms Privacy Docs