Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

fix: spawn finalize as background task in blocking sink The blocking sink's event loop awaited finalize_and_send synchronously. While one input was finalizing (running final aggregation on compute pool), the entire event loop blocked — no morsels could be received or task completions processed for ANY input. With 14 concurrent inputs, this caused ~7s of cumulative stall time per plan execution. Now finalize runs in a background JoinSet, keeping the event loop free to continue processing other inputs. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

colin/plan-caching

21 minutes ago

fix: disable ordering in blocking sink + add debug prints to all operators BlockingSink used OrderingAwareJoinSet with maintain_order=true, causing head-of-line blocking: fast tasks from one input waited for slow tasks from other inputs to complete first. Blocking sinks don't need ordering since they collect everything before producing output. Also adds per-event-loop debug prints to all operators showing active tasks and per-input-id state. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

colin/plan-caching

1 hour ago

fix: apply backpressure in blocking sink, streaming sink, and join nodes Replace usize::MAX with proper max_concurrency limits in next_event calls. Without backpressure, child pipelines flood sinks with morsels that pile up in pending queues, causing oversized concatenated batches and 2-3x slower aggregate tasks. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

colin/plan-caching

2 hours ago

colin/plan-caching

6 hours ago

run prints and refactor blocking sink

colin/plan-caching

1 day ago

colin/plan-caching

1 day ago

print plan reuse

colin/plan-caching

1 day ago

isolate runtime stats

colin/pipeline-message

1 day ago

Latest Branches

-1%

feat(swordfish): plan caching with ActivePlansRegistry#6278

41 minutes ago

4cc5785

colin/plan-caching

0%

feat(swordfish): introduce PipelineMessage with input_id tracking#6277

1 day ago

ac669fc

colin/pipeline-message

0%

chore: Provider Flight Server in Rust#6519

1 day ago

a95f0fd

slade/reuse-flight-connection

© 2026 CodSpeed Technology

Home Terms Privacy Docs