Eventual-Inc
Daft
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
Performance History
Latest Results
ci: retrigger to clear flaky HuggingFace 429 and Ray actor timeout
BABTUNA:perf/sharded-grouped-agg
3 minutes ago
Merge branch 'main' into feat/temporal-tz-conversions
BABTUNA:feat/temporal-tz-conversions
48 minutes ago
fix(flight-shuffle): make coordinator memory O(map_tasks + partitions) instead of O(map_tasks x partitions) Instead of materializing the full (map_tasks x partitions) matrix of FlightPartitionRefs on the coordinator, fold the map-output stream into the set of map input ids per server — recoverable because partition_ref_id is structured as (input_id << 32) | partition_idx. All reduce tasks share the per-server map via Arc and reconstruct their exact refs at fetch time, issuing byte-identical requests to before, so fault tolerance (exact ref addressing, idempotent re-registration, stale attempts never read) is unchanged and the flight server needs no changes. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
colin/flight-shuffle-coordinator-memory
2 hours ago
feat(grouped-agg): shard AggThenPartition execution per morsel
BABTUNA:perf/sharded-grouped-agg
3 hours ago
perf: update jemalloc 5.3.0 → 5.3.1 via tikv-jemallocator 0.7.0 jemalloc 5.3.0 has a bug where muzzy_decay_ms values other than -1 cause severe performance degradation (up to 7x slower). This was fixed in 5.3.1. Daft sets muzzy_decay_ms:1000 on Linux and muzzy_decay_ms:0 on macOS, both of which hit this bug. See: pola-rs/polars#27797 Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
everettVT/polars-pr-27797-review
3 hours ago
fix(flight-shuffle): make coordinator memory O(map_tasks + partitions) instead of O(map_tasks x partitions) Instead of materializing the full (map_tasks x partitions) matrix of FlightPartitionRefs on the coordinator, fold the map-output stream into the set of map input ids per server — recoverable because partition_ref_id is structured as (input_id << 32) | partition_idx. All reduce tasks share the per-server map via Arc and reconstruct their exact refs at fetch time, issuing byte-identical requests to before, so fault tolerance (exact ref addressing, idempotent re-registration, stale attempts never read) is unchanged and the flight server needs no changes. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
colin/flight-shuffle-coordinator-memory
3 hours ago
perf(daft-core): enum-dispatch multi-column equality comparator Replace the per-column `Box<dyn Fn>` dispatch inside build_multi_array_is_equal_from_arrays with an enum-dispatched comparator. Float columns now hold zero-copy ScalarBuffer handles (an Arc clone of the backing buffer) instead of reading values back through `dyn Array`, and the per-row hot path matches on a small enum rather than dereferencing a vtable per column. Public functions are unchanged and NaN/null semantics are preserved exactly: the float path reuses cmp_float, so NaN equality still honours the per-column nan_equal flag, -0.0 == 0.0, and null/null equality honours nulls_equal. Adds unit tests covering these cases.
wuleiwuleiwulei:wl_0603_enum
8 hours ago
Merge branch 'main' into feat-7030
Abyss-lord:feat-7030
8 hours ago
Latest Branches
CodSpeed Performance Gauge
0%
feat(grouped-agg): shard AggThenPartition execution per morsel
#7060
28 minutes ago
59a03b2
BABTUNA:perf/sharded-grouped-agg
CodSpeed Performance Gauge
0%
feat(temporal): add Spark-style timezone conversions
#6919
1 hour ago
84d8237
BABTUNA:feat/temporal-tz-conversions
CodSpeed Performance Gauge
0%
fix(flight-shuffle): reduce coordinator memory to O(map_tasks + partitions)
#7056
10 hours ago
6464dc0
colin/flight-shuffle-coordinator-memory
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs