Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

Performance History

Latest Results

Merge branch 'main' into hll/auto
huleilei:hll/auto
2 hours ago
ci(issues): handle comma multi-select and 404 label races
BABTUNA:feat/issue-components-labels
4 hours ago
fix(io): emit canonical file:// URIs for Windows drive paths (#6817) ## Summary Follow-up to #6791 / #6796. Both earlier PRs fixed Windows-path bugs in specific call sites (the test helper, `S3CheckpointStore::put_bytes`). This PR closes the loop on the matching emission side: `iter_dir` and a few other helpers in `daft-io` were producing **non-canonical** `file://` URIs on Windows drive-letter paths, which silently broke any caller that string-compared the result against a canonically-built prefix. ## Concrete failure On Windows, an `S3CheckpointStore` is constructed against a canonical prefix (`file:///C:/Users/.../tmp_XYZ`). Writes succeed via `put_bytes`, which goes through `strip_file_uri_to_path` (handles both two- and three-slash forms). Reads call `glob_paths` → `daft_io::glob` → `iter_dir`. `iter_dir` builds its emitted URI as: ```rust filepath: format!("{LOCAL_PROTOCOL}{uri}") // "file://" + "C:/Users/..." ``` The result, `file://C:/Users/...` (two slashes), does not match the canonical `file:///C:/Users/...` prefix the store was built with. In `S3CheckpointStore::parse_id_from_manifest_path`: ```rust let after_prefix = path.strip_prefix(&self.prefix)?.strip_prefix('/')?; ``` `strip_prefix` returns `None` for every entry → empty Vec → every `get_checkpointed_keys` / `get_checkpointed_files` assertion on Windows fails with `left: []`. Net effect: 11 of 14 tests in `daft-checkpoint::tests::s3_store` red on the Windows coverage job since #6791 + #6796 landed. POSIX is unaffected because POSIX absolute paths start with `/`, so the same `format!` already produces canonical `file:///tmp/...`. ## Fix Add a `local_path_to_file_uri` helper alongside the existing `strip_file_uri_to_path` (symmetric inverse). POSIX paths get two slashes, Windows drive-letter paths get three. Apply at every `daft-io` site that emits `file://` URIs: - `iter_dir` file branch (the root cause) - `iter_dir` dir-iteration branch (same bug for the directory variant) - `parse_url` tilde-expansion fallback (`~/...`) - `parse_url` `RelativeUrlWithoutBase` fallback - `parse_url` Windows drive-letter scheme handler (`c:foo`) Also switches `local::delete` from a hand-rolled `strip_prefix("file://")` to `strip_file_uri_to_path` — same Windows-drive-letter pitfall as the `put_bytes` issue fixed in #6796, would silently break `delete` on Windows-canonical URIs. ## Test plan - [x] `cargo test -p daft-io` — 61/61 pass locally (macOS). - [x] `cargo test -p daft-checkpoint --test s3_store` — 14/14 pass locally (macOS). - [ ] Windows rust-tests on `main` should go from 3/14 to 14/14 after merge. ## Lesson The audit caught one defensive case: `local::delete` had the same hand-rolled `strip_prefix("file://")` shape as the original `put_bytes` bug. Per #6796's lesson, every URL-parsing call site should use the canonical helpers — folded into this PR rather than left as a follow-up. 🤖 Generated with [Claude Code](https://claude.com/claude-code) --------- Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
main
4 hours ago
fix: lance scalar index formatting and bug fix
XuQianJin-Stars:support-pylance-4.0.1
5 hours ago
style: replace Chinese comments with English in cos.rs
XuQianJin-Stars:docs/add-cos-connector-docs
5 hours ago
fix(file): make write context/flush semantics safe and typed
BABTUNA:feat/file-write-support
5 hours ago
feat(dashboard): render Repartition spec in human-readable form (#6798) ## Summary This PR renders `REPARTITION_SPEC` in dashboard plan cards as human-readable text by formatting it in Rust logical-plan display/JSON output, instead of frontend-specific parsing. ## Why The prior frontend-only formatter added UI-specific parsing logic for repartition internals. Moving formatting to Rust keeps a single source of truth for plan representation and simplifies the dashboard. ## Changes Made - Add compact Display formatting for RepartitionSpec in src/daft-logical-plan/ src/partitioning.rs. - Update logical-plan JSON display to emit repartition_spec via to_string() in src/ daft-logical-plan/src/display/json.rs. - Add regression test test_repr_json_repartition_spec_human_read able in src/daft-logical-plan/src/display/ json.rs. ## Behavior - Dashboard plan cards now show human-readable repartition specs from backend JSON (e.g. `Hash (num_partitions=auto, by=[col(id)])`). - No query planning or execution behavior changes. ## Test Plan - Targeted Rust test intended: `cargo test -p daft-logical-plan test_repr_json_repartition_spec_human_readable -- --nocapture` - Full matrix runs in CI. ## Related Issues - Closes #6781 ## Before <img width="1912" height="632" alt="image" src="https://github.com/user-attachments/assets/26c3312f-429b-404b-bb14-20e64d708cc3" /> ## After <img width="1905" height="648" alt="image" src="https://github.com/user-attachments/assets/be8e4f66-14b4-4a06-afa9-d16e3b7371ef" />
main
6 hours ago

Latest Branches

CodSpeed Performance Gauge
+1%
feat(ray): Implement dynamic scale-in for RaySwordfishActor#5903
3 hours ago
50a23ce
huleilei:hll/auto
CodSpeed Performance Gauge
0%
4 hours ago
799c74b
BABTUNA:feat/issue-components-labels
CodSpeed Performance Gauge
0%
5 hours ago
66bb7d0
XuQianJin-Stars:support-pylance-4.0.1
© 2026 CodSpeed Technology
Home Terms Privacy Docs