Eventual-Inc
Daft
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
Performance History
Latest Results
also fix catalogs
slade/fix-integration
17 seconds ago
fix(utf8): preserve backslashes in regexp_replace replacement (#7472) ## Changes Made Replaces the `regex_replace_posix_groups` rewrite `(|\\)(\\d*)` with a single left-to-right scan that translates POSIX group references (`\\1` -> `${1}`) for the `regex` crate: - `\\\\` collapses to one backslash (escaped backslash, takes precedence so `\\\\1` stays literal `\\1`) - `\\` + digits becomes a group reference (`\\1`, `\\12`, `\\0`) - lone/trailing backslashes are preserved literally (e.g. `a\\b` stays `a\\b`), since the `regex` crate treats backslashes in replacements literally - `$1`/`${1}`/`$$` pass through untouched, keeping exact `regex`-crate semantics - returns `Cow<str>` (borrowed when no backslash is present) instead of running a regex engine and always allocating per row This goes beyond the suggested `\\d+` minimal fix, which would leave `\\\\` as two backslashes and misparse `\\\\1` as a group reference starting at the second backslash. ## Related Issues Closes #7471 ## Verification - `cargo test -p daft-functions-utf8 --lib replace`: 8 passed (2 new tests) - Issue repro via `daft.functions.regexp_replace`: `a\\b` -> `aa\\bc`, `\\\\` -> `a\\c`, `x\\` -> `ax\\c` (were `aabc`/`ac`/`axc`) - `DAFT_RUNNER=native pytest tests/recordbatch/utf8/test_replace.py`: 16 passed (9 new parametrized cases) - `DAFT_RUNNER=native pytest tests/expressions/test_utf8.py tests/sql/test_utf8_exprs.py`: 23 passed --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
main
1 hour ago
feat(io): add WebDataset reader (#7493) Added read_webdataset for reading uncompressed WebDataset TAR shards through Daft's DataSource API. - Group archive members into samples using their filename prefixes - Decode JSON, text, and integer metadata fields - expose binary media as lazy byte-range-backed File columns - Support local and remote paths, globs, directories, and multiple shards - Add WebDataset support to read_huggingface - Document the API and add reader and integration tests Closes Eventual-Inc/Daft#7342
main
1 hour ago
save
slade/add-mutable-check
2 hours ago
Merge branch 'main' into slade/fix-integration
slade/fix-integration
2 hours ago
fix integration test
slade/fix-integration
3 hours ago
Merge branch 'main' into scan-stats
manucorporat:scan-stats
3 hours ago
Merge branch 'main' into feature/webdataset-reader
rohankumardubey:feature/webdataset-reader
6 hours ago
Latest Branches
CodSpeed Performance Gauge
0%
chore: Add check for mutable values in default arguments
#7494
16 hours ago
f92e568
slade/add-mutable-check
CodSpeed Performance Gauge
0%
fix: Fix startup of IO-Integration Docker Compose
#7499
2 hours ago
535600a
slade/fix-integration
CodSpeed Performance Gauge
0%
feat(io): add I/O statistics reporting to DataSourceTask
#7497
3 hours ago
1328abb
manucorporat:scan-stats
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs