Eventual-Inc/Daft

Eventual-Inc

Daft

Blog Docs Changelog

Performance History

Latest Results

Merge branch 'main' into feature/webdataset-reader

rohankumardubey:feature/webdataset-reader

24 minutes ago

refactor(utf8): inline broadcast replacement template iterator Address review: build the translated replacement templates as one Box<dyn Iterator> instead of threading broadcast_template through translated_replacement_iter. Keeps the owning Cow in a local and repeats Cow::Borrowed so per-row cost stays a pointer copy rather than cloning the translated String.

jonasdedden:fix/7471-regexp-replace-backslash

44 minutes ago

fix(utf8): address review on to_datetime timezone handling - Allow Null input: plan Utf8 or Null, and build the planned all-null Timestamp directly in the kernel (with_utf8_array would pass Null through as Null and trip the dtype check). - Validate the resolved output timezone in get_return_field so a bad literal fails at planning time; share the parser with the kernel. - Parse the resolved output timezone in the kernel, merging the explicit-timezone and offset-coerced-to-UTC branches (with_timezone extracts the same instant as to_utc).

jonasdedden:fix-to-datetime-all-null-offset

1 hour ago

fix(sql): reject negative literals for unsigned table function options (#7479) ## Changes Made Negative literals for unsigned table function options wrapped around instead of erroring: ```python daft.sql("SELECT * FROM read_parquet('f.parquet', chunk_size => -1)") # accepted silently daft.sql("SELECT * FROM read_iceberg('...', snapshot_id => -1)") # ValueError: Snapshot not found: 18446744073709551615 ``` `impl SQLLiteral for usize` used `lit.as_i64().map(|v| v as usize)`, a wrapping cast. It now delegates to `daft_core::lit::Literal::try_as_usize`, the crate's existing policy, which also accepts integer widths `as_i64` rejected outright. The message stays ours, since the core error mentions `usize`. Scope is the options actually parsed as `usize` — `chunk_size`, `buffer_size`, `snapshot_id`, and the `HTTPConfig`/`TosConfig` numerics. `S3Config` and `AzureConfig` read theirs as `i64` and cast to `u32`, so those still wrap; that is a separate fix. ## Testing Parametrized rejection of negative `chunk_size`/`buffer_size` across `read_parquet`, `read_csv` and `read_json` — all five fail on `main`. native `tests/sql` 412 passed, ray 29, `make precommit` clean. ## AI usage disclosure Written with an AI coding assistant. I reviewed the full diff, reproduced the wraparound on an unpatched build, and reverted the fix to confirm the new tests fail without it. ## Related Issues Closes #7478. Split out of #7354; the `snapshot_id` typing is #7477. Co-authored-by: Srinivas Lade <srinulade1@gmail.com>

main

2 hours ago

build: bump ray to include 2.58 and uv to 0.12 (#7487) ## Changes Made * Bump ray to include support for `2.58` * Ignore yet another custom environment manager's env settings file * Bump `uv` to use latest `0.12.x` release in pre-commit, and sure up CI to install the right version automagically ## Related Issues  Co-authored-by: Neil Wadhvana <neil.wadhvana@torc.ai> Co-authored-by: Srinivas Lade <srinulade1@gmail.com>

main

2 hours ago

Merge branch 'main' into sql-unsigned-literal-validation

jackylee-ch:sql-unsigned-literal-validation

2 hours ago

Merge branch 'main' into ray-258

NellyWhads:ray-258

3 hours ago

fix(distributed): satisfy clippy type complexity in scheduler tests

hello-peter-tang:fix/downscale-reaper-hardening

14 hours ago

Latest Branches

feat(io): add WebDataset reader#7493

41 minutes ago

ab21474

rohankumardubey:feature/webdataset-reader

fix(utf8): preserve backslashes in regexp_replace replacement#7472

1 hour ago

33fb175

jonasdedden:fix/7471-regexp-replace-backslash

fix(utf8): resolve to_datetime output timezone up front#7473

2 hours ago

dd14645

jonasdedden:fix-to-datetime-all-null-offset

Home Terms Privacy Docs