Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

feat: add DROID trajectory helpers

everettVT/droid-hdf5-stack

4 hours ago

feat: add HDF5 file support (#7159) ## Summary Adds first-class HDF5 file support without the DROID dataset follow-up changes. This PR introduces `daft.Hdf5File`, HDF5 media type plumbing, `hdf5_file`, `hdf5_keys`, `hdf5_visit`, `hdf5_read`, and `hdf5_read_many`, plus MIME detection for `application/vnd.hdfgroup.hdf5` including HDF5 user-block signatures. It keeps the base `File.open()` byte-stream contract intact and exposes HDF5-specific access through `open_h5py()` and convenience methods. Docs and examples add a Files guide HDF5 section and an HDF5 usage notebook backed by a small local sample trajectory file. ## Testing - `make build` - `/Users/everettkleven/conductor/workspaces/daft/asuncion-v1/.venv/bin/ruff check daft/file/hdf5.py daft/functions/hdf5.py tests/file/test_hdf5.py tests/expressions/test_guess_mime_type.py` - `/Users/everettkleven/conductor/workspaces/daft/asuncion-v1/.venv/bin/ruff check examples/hdf5_file_usage.ipynb` - `uvx ty check examples/hdf5_file_usage.ipynb` - `DAFT_RUNNER=native /Users/everettkleven/conductor/workspaces/daft/asuncion-v1/.venv/bin/python -m pytest tests/file/test_hdf5.py tests/expressions/test_guess_mime_type.py --cov=daft.file.hdf5 --cov=daft.functions.hdf5 --cov-report=term-missing --cov-fail-under=90` - Result: 43 passed; total coverage 100% over `daft.file.hdf5` and `daft.functions.hdf5`.

main

5 hours ago

feat(ai): add transformers provider for prompt() (#7152)

main

21 hours ago

docs(hdf5): explain mime extension override

everettVT/hdf5-file

22 hours ago

Merge branch 'main' into slade/lerobot

slade/lerobot

22 hours ago

chore(hdf5): loosen h5py extra pin

everettVT/hdf5-file

1 day ago

fix(io): default https scheme for scheme-less S3 endpoint_url (#7111) ## Changes Made Defaults the scheme of a user/catalog-provided S3 `endpoint_url` to `https` when none is present, in the S3 endpoint normalization in `src/daft-io/src/s3_like.rs` (the same block that adds trailing slashes, #5575). Some Iceberg REST catalogs vend `s3.endpoint` as a bare host, optionally with a trailing slash (e.g. `s3.example.com/`). A scheme-less endpoint fails `url::Url::parse`, falls through to the verbatim string, and every S3 read fails: ``` DispatchFailure(... ResolveEndpointError { message: "Custom endpoint `s3.example.com/` was not a valid URI", source: Some(InvalidUri(InvalidFormat)) }) ``` (Writes can appear to succeed -- PyArrow already treats a bare endpoint as `https` -- while reads fail, which makes this confusing to debug.) The fix lives in `build_s3_conf`'s endpoint normalization rather than in the Iceberg property conversion, so it covers every `S3Config` consumer (direct users and any catalog), not just Iceberg-REST-vended endpoints. The trailing-slash handling from #5575 is now reached for bare hosts too. Extracted the normalization into a pure `normalize_endpoint_url` helper and added unit tests covering the scheme-default and the (previously untested) #5575 trailing-slash behavior. Notes: - Defaulting to `https` matches PyArrow's behavior. Users who need `http` keep passing a schemed endpoint -- those are untouched. - This cannot break working setups: a scheme-less endpoint always failed before. ## Related Issues Extends the endpoint normalization from #5575. Follow-up of #6993 (the bare-host endpoint was first observed via Iceberg-REST auto-config).

main

1 day ago

feat(session): resolve catalog-qualified identifiers in namespace methods (#7171) ## Changes Made ### Problem `create_namespace`, `drop_namespace`, and `has_namespace` bypassed `_resolve_catalog`, so catalog-qualified identifiers like `"my_cat.my_ns"` were not routed to the target catalog. `create_table`/`drop_table` already resolved correctly. ### What changed **`daft/session.py`** - Added `_resolve_catalog` to `create_namespace`, `create_namespace_if_not_exists`, `drop_namespace`, `has_namespace` - Added `str` → `Identifier` conversion to `create_namespace`, `drop_namespace`, `has_namespace` (was missing) - Fixed `drop_table` to prepend `current_namespace` for unqualified single-part identifiers (replaced a TODO) **`tests/catalog/test_catalog.py`** - Added 10 tests covering catalog-qualified CRUD, unqualified fallback, multi-catalog isolation, error paths, and `Identifier`-object input - Implemented `_drop_namespace`, `_has_namespace`, `_list_namespaces` in `MockCatalog` to support tests

main

1 day ago

Latest Branches

0%

feat: streamline HDF5 file access#7160

3 days ago

430f2cb

everettVT/droid-hdf5-stack

0%

feat: add HDF5 file support#7159

23 hours ago

017d963

everettVT/hdf5-file

0%

feat(lerobot): Add `daft.datasets.lerobot` for working with LeRobot v3 datasets#7090

23 hours ago

5012d9c

slade/lerobot

© 2026 CodSpeed Technology

Home Terms Privacy Docs