Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

Performance History

Latest Results

fix: sort imports
Lucas61000:issue-6496
5 hours ago
Merge branch 'main' into issue-6496
Lucas61000:issue-6496
6 hours ago
fix: normalize HF bucket tree paths (#7218) ## Summary Normalize `hf://buckets` paths copied from Hugging Face `/tree/` pages before globbing, and harden bucket listing/globbing/errors based on live-API behavior. Fixes #7217. - Strip the reserved `tree` segment from copied browser URLs (`hf://buckets/org/repo/tree/{path}`, including the bucket-root `.../tree`), and canonicalize bucket glob paths before globbing. - Fix bucket listings: the buckets tree API returns entries without the git `oid` field, so every non-empty bucket `ls` failed to deserialize — breaking all wildcard globs on buckets. `Item.oid` is now optional. - Follow `Link: rel="next"` pagination on tree listings (1000 entries/page); previously large-bucket globs silently truncated. Also benefits dataset listings. - Actionable error for bucket 401s: Hugging Face returns 401 both for private buckets and buckets that don't exist — including when a user swaps `datasets`→`buckets` in a URI (datasets are **not** automatically exposed as buckets). Previously this surfaced as a bare "check your credentials" error; it now explains buckets vs datasets and points at `hf://datasets/...`. - Skip the datasets-only parquet-conversion API for buckets (previously produced the same misleading 401 on bucket-root reads). ## Tests - `cargo test -p daft-io huggingface` — parse-level tests for naive copied-URL patterns (file/dir/root tree URLs, globs under `tree/`, tree-like object keys left untouched, canonicalization idempotence) plus live-API tests for bucket `ls`, tree-URL wildcard glob, and the dataset-as-bucket error hint. - End-to-end against a local build: - original `/tree/` bucket parquet MRE from #7217 (350 rows) - wildcard glob through a copied tree URL (previously broken) - recursive `**/*.parquet` glob from bucket root - `hf://buckets/wikimedia/wikipedia/...` (dataset-as-bucket) surfaces the buckets-vs-datasets hint
main
13 hours ago
docs: de-vibe comments
AnayGarodia:fix/5539-oss-storage-options
13 hours ago
docs: de-vibe comments
AnayGarodia:fix/5172-video-frames-mkv-webm
13 hours ago

Latest Branches

CodSpeed Performance Gauge
+12%
feat: add df.lineage() introspection API with OpenLineage SDK integration#7231
5 hours ago
b1a1b64
Lucas61000:issue-6496
CodSpeed Performance Gauge
0%
1 day ago
cbb0640
cmirandavega:feat/rint-bround
CodSpeed Performance Gauge
0%
20 hours ago
f17c14c
everettVT/mcap-extra-check
© 2026 CodSpeed Technology
Home Terms Privacy Docs