Eventual-Inc
Daft
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
Performance History
Latest Results
address comments
oh/generic_shuffle_interface
2 hours ago
fix: respect scheme aliases in Iceberg writes
rchowell/write-iceberg-with-custom-schemes
4 hours ago
feat: add daft-checkpoint crate with CheckpointStore trait and in-memory impl Introduces a source-oriented checkpoint store for tracking which input rows have been processed and what output files were produced. This enables skipping already-processed rows on re-run (progress tracking) and knowing which files to commit after a crash (recovery for 2PC sinks like Iceberg). Core abstractions: - CheckpointStore async trait with stage/checkpoint/commit lifecycle - CheckpointId (UUID), Checkpoint (metadata with timestamps), FileMetadata (opaque blob) - Lifecycle: staged (invisible) → checkpointed (visible) → committed - checkpoint() and mark_committed() are idempotent for crash recovery In-memory implementation gated behind `test-utils` feature flag. 10 tests covering lifecycle, idempotency, error paths, orphan behavior, edge cases, and trait object safety. Ref: #5741 Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
rohit/feature/checkpoint-store
4 hours ago
Merge remote-tracking branch 'origin/main' into rchowell/gravitino-iceberg-parquet
rchowell/gravitino-iceberg-parquet
4 hours ago
feedback
rchowell/gravitino-iceberg-parquet
5 hours ago
chore(ci): migrate BuildJet runners to Blacksmith (#6416) ## Summary - Migrates all CI workflows off BuildJet runners (shutting down March 31st, 2026) to Blacksmith - Replaces `buildjet-16vcpu-ubuntu-2204` with `blacksmith-16vcpu-ubuntu-2204` for wheel builds - Replaces `buildjet-8vcpu-ubuntu-2204` with `blacksmith-8vcpu-ubuntu-2204` for benchmarks - Switches `cache-provider: buildjet` to `cache-provider: github` for Rust cache ## Why Blacksmith over GitHub runners? Blacksmith provides the same high-vCPU runner configs as BuildJet at comparable pricing, avoiding the CPU downgrade (16→2, 8→2 vCPUs) that would come from moving to `ubuntu-latest`. This keeps Rust compilation and benchmark times consistent. ## Test plan - [ ] Verify `benchmark-codspeed` job runs successfully on Blacksmith - [ ] Verify `build-wheel` job runs successfully for Ubuntu builds on Blacksmith - [ ] Verify Rust cache works with GitHub provider 🤖 Generated with [Claude Code](https://claude.com/claude-code) --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
main
6 hours ago
feat(build): add experimental cross-wheel build target (#6360) ## Changes Made * Adds `build-whl-cross` Makefile target for experimental cross-platform wheel builds via maturin (https://www.maturin.rs/distribution.html#cross-compiling) * Supports configurable knobs: `BUILD_WHL_TARGET`, `BUILD_WHL_USE_ZIG`, `BUILD_WHL_COMPATIBILITY`, and `BUILD_WHL_FD_LIMIT` * Automatically raises the open-files soft limit when needed for cross-compilation * Pre-flight checks for zig binary with actionable error messages This is for dev purposes only and should not be used for production release builds. Example of building for linux aarch64 from a osx. ``` make build-whl-cross BUILD_WHL_TARGET=aarch64-unknown-linux-gnu BUILD_WHL_COMPATIBILITY=manylinux_2_39 ```
main
6 hours ago
feat(subscribers): add Event enum and on_event dispatch for subscriber framework
chris/subscriber-on-event
6 hours ago
Latest Branches
CodSpeed Performance Gauge
-1%
refactor: implement generic shuffle interface for flight shuffle
#6456
3 hours ago
1fa1ca7
oh/generic_shuffle_interface
CodSpeed Performance Gauge
0%
fix: respect scheme aliases in Iceberg writes
#6512
4 hours ago
cfdfb7a
rchowell/write-iceberg-with-custom-schemes
CodSpeed Performance Gauge
0%
feat: add daft-checkpoint crate with CheckpointStore trait and in-mem…
#6511
4 hours ago
805f674
rohit/feature/checkpoint-store
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs