Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

ci: retrigger to clear flaky HuggingFace 429 and Ray actor timeout

BABTUNA:perf/sharded-grouped-agg

3 minutes ago

Merge branch 'main' into feat/temporal-tz-conversions

BABTUNA:feat/temporal-tz-conversions

48 minutes ago

fix(flight-shuffle): make coordinator memory O(map_tasks + partitions) instead of O(map_tasks x partitions) Instead of materializing the full (map_tasks x partitions) matrix of FlightPartitionRefs on the coordinator, fold the map-output stream into the set of map input ids per server — recoverable because partition_ref_id is structured as (input_id << 32) | partition_idx. All reduce tasks share the per-server map via Arc and reconstruct their exact refs at fetch time, issuing byte-identical requests to before, so fault tolerance (exact ref addressing, idempotent re-registration, stale attempts never read) is unchanged and the flight server needs no changes. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

colin/flight-shuffle-coordinator-memory

2 hours ago

feat(grouped-agg): shard AggThenPartition execution per morsel

BABTUNA:perf/sharded-grouped-agg

3 hours ago

perf: update jemalloc 5.3.0 → 5.3.1 via tikv-jemallocator 0.7.0 jemalloc 5.3.0 has a bug where muzzy_decay_ms values other than -1 cause severe performance degradation (up to 7x slower). This was fixed in 5.3.1. Daft sets muzzy_decay_ms:1000 on Linux and muzzy_decay_ms:0 on macOS, both of which hit this bug. See: pola-rs/polars#27797 Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

everettVT/polars-pr-27797-review

3 hours ago

fix(flight-shuffle): make coordinator memory O(map_tasks + partitions) instead of O(map_tasks x partitions) Instead of materializing the full (map_tasks x partitions) matrix of FlightPartitionRefs on the coordinator, fold the map-output stream into the set of map input ids per server — recoverable because partition_ref_id is structured as (input_id << 32) | partition_idx. All reduce tasks share the per-server map via Arc and reconstruct their exact refs at fetch time, issuing byte-identical requests to before, so fault tolerance (exact ref addressing, idempotent re-registration, stale attempts never read) is unchanged and the flight server needs no changes. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

colin/flight-shuffle-coordinator-memory

3 hours ago

perf(daft-core): enum-dispatch multi-column equality comparator Replace the per-column `Box<dyn Fn>` dispatch inside build_multi_array_is_equal_from_arrays with an enum-dispatched comparator. Float columns now hold zero-copy ScalarBuffer handles (an Arc clone of the backing buffer) instead of reading values back through `dyn Array`, and the per-row hot path matches on a small enum rather than dereferencing a vtable per column. Public functions are unchanged and NaN/null semantics are preserved exactly: the float path reuses cmp_float, so NaN equality still honours the per-column nan_equal flag, -0.0 == 0.0, and null/null equality honours nulls_equal. Adds unit tests covering these cases.

wuleiwuleiwulei:wl_0603_enum

8 hours ago

Merge branch 'main' into feat-7030

Abyss-lord:feat-7030

8 hours ago

Latest Branches

0%

feat(grouped-agg): shard AggThenPartition execution per morsel#7060

28 minutes ago

59a03b2

BABTUNA:perf/sharded-grouped-agg

0%

feat(temporal): add Spark-style timezone conversions#6919

1 hour ago

84d8237

BABTUNA:feat/temporal-tz-conversions

0%

fix(flight-shuffle): reduce coordinator memory to O(map_tasks + partitions)#7056

10 hours ago

6464dc0

colin/flight-shuffle-coordinator-memory

© 2026 CodSpeed Technology

Home Terms Privacy Docs