Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

Performance History

Latest Results

feat: add DROID trajectory helpers
everettVT/droid-hdf5-stack
4 hours ago
docs(hdf5): explain mime extension override
everettVT/hdf5-file
22 hours ago
chore(hdf5): loosen h5py extra pin
everettVT/hdf5-file
1 day ago
fix(io): default https scheme for scheme-less S3 endpoint_url (#7111) ## Changes Made Defaults the scheme of a user/catalog-provided S3 `endpoint_url` to `https` when none is present, in the S3 endpoint normalization in `src/daft-io/src/s3_like.rs` (the same block that adds trailing slashes, #5575). Some Iceberg REST catalogs vend `s3.endpoint` as a bare host, optionally with a trailing slash (e.g. `s3.example.com/`). A scheme-less endpoint fails `url::Url::parse`, falls through to the verbatim string, and every S3 read fails: ``` DispatchFailure(... ResolveEndpointError { message: "Custom endpoint `s3.example.com/` was not a valid URI", source: Some(InvalidUri(InvalidFormat)) }) ``` (Writes can appear to succeed -- PyArrow already treats a bare endpoint as `https` -- while reads fail, which makes this confusing to debug.) The fix lives in `build_s3_conf`'s endpoint normalization rather than in the Iceberg property conversion, so it covers every `S3Config` consumer (direct users and any catalog), not just Iceberg-REST-vended endpoints. The trailing-slash handling from #5575 is now reached for bare hosts too. Extracted the normalization into a pure `normalize_endpoint_url` helper and added unit tests covering the scheme-default and the (previously untested) #5575 trailing-slash behavior. Notes: - Defaulting to `https` matches PyArrow's behavior. Users who need `http` keep passing a schemed endpoint -- those are untouched. - This cannot break working setups: a scheme-less endpoint always failed before. ## Related Issues Extends the endpoint normalization from #5575. Follow-up of #6993 (the bare-host endpoint was first observed via Iceberg-REST auto-config).
main
1 day ago

Latest Branches

CodSpeed Performance Gauge
0%
feat: streamline HDF5 file access#7160
3 days ago
430f2cb
everettVT/droid-hdf5-stack
CodSpeed Performance Gauge
0%
feat: add HDF5 file support#7159
23 hours ago
017d963
everettVT/hdf5-file
CodSpeed Performance Gauge
0%
© 2026 CodSpeed Technology
Home Terms Privacy Docs