Eventual-Inc
Daft
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
Performance History
Latest Results
fix(flotilla): keep min_cpu_per_task default at 1.0 (no-regression) Before this PR, the flotilla scheduler fell back to a hardcoded 1.0 CPU when ResourceRequest had no num_cpus; the configured min_cpu_per_task default of 0.5 was inert. Wiring the field through (1d05985e8) without changing the default would silently halve the per-task CPU floor for every existing user, which Greptile's review flagged as a behaviour change risk on capacity-tuned clusters (e.g. KubeRay packs 2x more tasks before scale-out, increasing OOM risk). Move the default to 1.0 so the no-explicit-num_cpus path matches the pre-wiring behaviour exactly. Users who want a smaller floor set it explicitly via daft.set_execution_config(min_cpu_per_task=...) or DAFT_MIN_CPU_PER_TASK, which is the original purpose of the knob.
XiaoHongbo-Hope:fix/min-cpu-per-task-wiring
7 hours ago
Merge remote-tracking branch 'origin/main' into perf/inline-agg-any-value # Conflicts: # src/daft-recordbatch/src/ops/inline_agg.rs
BABTUNA:perf/inline-agg-any-value
10 hours ago
ci: retrigger flaky HF ConnectError
BABTUNA:perf/inline-agg-bool
11 hours ago
test: cover min_cpu_per_task wiring; clarify field doc - Comment said 'Floor' but the implementation is 'Default-when-None' (explicit num_cpus is honored as-is). Reword to match. - Add two unit tests: * num_cpus falls back to min_cpu_per_task when ResourceRequest is empty * explicit num_cpus passes through unchanged
XiaoHongbo-Hope:fix/min-cpu-per-task-wiring
16 hours ago
fix(flotilla): wire min_cpu_per_task into TaskResourceRequest The min_cpu_per_task execution config field had no readers in the distributed scheduler: TaskResourceRequest::num_cpus() returned a hardcoded 1.0 when the plan's ResourceRequest had no num_cpus. This was wired up in #4506 for the legacy ray runner only; #5375 removed that runner along with its lone reader, and the flotilla scheduler was never wired in. Result: setting min_cpu_per_task via daft.set_execution_config or DAFT_MIN_CPU_PER_TASK had zero effect on autoscaler bundle requests. Plumb the value from DaftExecutionConfig (already in scope at SwordfishTaskBuilder::build) into TaskResourceRequest, and use it as the fallback in num_cpus() instead of the literal 1.0. Closes #7123
XiaoHongbo-Hope:fix/min-cpu-per-task-wiring
19 hours ago
Merge branch 'main' into fix-actor-udf-blocking-sink-deadlock
XiaoHongbo-Hope:fix-actor-udf-blocking-sink-deadlock
20 hours ago
Merge branch 'main' into fix-actor-udf-blocking-sink-deadlock
XiaoHongbo-Hope:fix-actor-udf-blocking-sink-deadlock
22 hours ago
Merge branch 'main' into fix-actor-udf-blocking-sink-deadlock
XiaoHongbo-Hope:fix-actor-udf-blocking-sink-deadlock
23 hours ago
Latest Branches
CodSpeed Performance Gauge
0%
fix(flotilla): wire min_cpu_per_task into TaskResourceRequest
#7125
8 hours ago
a0f07e5
XiaoHongbo-Hope:fix/min-cpu-per-task-wiring
CodSpeed Performance Gauge
0%
feat(inline-agg): add AnyValue accumulator
#7036
11 hours ago
f18a9b4
BABTUNA:perf/inline-agg-any-value
CodSpeed Performance Gauge
+1%
perf(inline-agg): add BoolAnd and BoolOr accumulator types
#6984
11 hours ago
0aff175
BABTUNA:perf/inline-agg-bool
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs