Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

address comments

oh/generic_shuffle_interface

2 hours ago

fix: respect scheme aliases in Iceberg writes

rchowell/write-iceberg-with-custom-schemes

4 hours ago

feat: add daft-checkpoint crate with CheckpointStore trait and in-memory impl Introduces a source-oriented checkpoint store for tracking which input rows have been processed and what output files were produced. This enables skipping already-processed rows on re-run (progress tracking) and knowing which files to commit after a crash (recovery for 2PC sinks like Iceberg). Core abstractions: - CheckpointStore async trait with stage/checkpoint/commit lifecycle - CheckpointId (UUID), Checkpoint (metadata with timestamps), FileMetadata (opaque blob) - Lifecycle: staged (invisible) → checkpointed (visible) → committed - checkpoint() and mark_committed() are idempotent for crash recovery In-memory implementation gated behind `test-utils` feature flag. 10 tests covering lifecycle, idempotency, error paths, orphan behavior, edge cases, and trait object safety. Ref: #5741 Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

rohit/feature/checkpoint-store

4 hours ago

Merge remote-tracking branch 'origin/main' into rchowell/gravitino-iceberg-parquet

rchowell/gravitino-iceberg-parquet

4 hours ago

rchowell/gravitino-iceberg-parquet

5 hours ago

chore(ci): migrate BuildJet runners to Blacksmith (#6416) ## Summary - Migrates all CI workflows off BuildJet runners (shutting down March 31st, 2026) to Blacksmith - Replaces `buildjet-16vcpu-ubuntu-2204` with `blacksmith-16vcpu-ubuntu-2204` for wheel builds - Replaces `buildjet-8vcpu-ubuntu-2204` with `blacksmith-8vcpu-ubuntu-2204` for benchmarks - Switches `cache-provider: buildjet` to `cache-provider: github` for Rust cache ## Why Blacksmith over GitHub runners? Blacksmith provides the same high-vCPU runner configs as BuildJet at comparable pricing, avoiding the CPU downgrade (16→2, 8→2 vCPUs) that would come from moving to `ubuntu-latest`. This keeps Rust compilation and benchmark times consistent. ## Test plan - [ ] Verify `benchmark-codspeed` job runs successfully on Blacksmith - [ ] Verify `build-wheel` job runs successfully for Ubuntu builds on Blacksmith - [ ] Verify Rust cache works with GitHub provider 🤖 Generated with [Claude Code](https://claude.com/claude-code) --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

main

6 hours ago

feat(build): add experimental cross-wheel build target (#6360) ## Changes Made * Adds `build-whl-cross` Makefile target for experimental cross-platform wheel builds via maturin (https://www.maturin.rs/distribution.html#cross-compiling) * Supports configurable knobs: `BUILD_WHL_TARGET`, `BUILD_WHL_USE_ZIG`, `BUILD_WHL_COMPATIBILITY`, and `BUILD_WHL_FD_LIMIT` * Automatically raises the open-files soft limit when needed for cross-compilation * Pre-flight checks for zig binary with actionable error messages This is for dev purposes only and should not be used for production release builds. Example of building for linux aarch64 from a osx. ``` make build-whl-cross BUILD_WHL_TARGET=aarch64-unknown-linux-gnu BUILD_WHL_COMPATIBILITY=manylinux_2_39 ```

main

6 hours ago

feat(subscribers): add Event enum and on_event dispatch for subscriber framework

chris/subscriber-on-event

6 hours ago

Latest Branches

-1%

refactor: implement generic shuffle interface for flight shuffle#6456

3 hours ago

1fa1ca7

oh/generic_shuffle_interface

0%

fix: respect scheme aliases in Iceberg writes#6512

4 hours ago

cfdfb7a

rchowell/write-iceberg-with-custom-schemes

0%

feat: add daft-checkpoint crate with CheckpointStore trait and in-mem…#6511

4 hours ago

805f674

rohit/feature/checkpoint-store

© 2026 CodSpeed Technology

Home Terms Privacy Docs