Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

perf(join): refine fanout take heuristics

RitwijParmar:codex/daft-fanout-aware-join-probe

2 hours ago

Merge remote-tracking branch 'origin/main' into codex/daft-otel-env-config

RitwijParmar:codex/daft-otel-env-config

2 hours ago

feat: add top-level daft.concat() for concatenating multiple DataFrames (#7105) ## Changes Made Adds a top-level `daft.concat()` that concatenates a list/iterable of DataFrames by folding over the existing `DataFrame.concat()`. Raises `ValueError` on empty input. All input DataFrames must share a schema (same constraint as `df.concat`). - `daft/convert.py`: implement `concat()` - `daft/__init__.py`: export `concat` and add it to `__all__` - `tests/dataframe/test_concat.py`: add tests (multiple, single, iterable, empty, schema mismatch) ## Related Issues Fixes #6892 ## AI Usage Disclosure Used AI assistance for the implementation and tests; verified locally by running the concat test suite, the doctest, and make format/lint.

main

3 hours ago

feat(file): Add a `file_exists` expression (#7140) ## Changes Made Add an expression to check if a file exists or not. Useful for unclean datasets.

main

3 hours ago

fix: Fix flaky dataloader test (#7142) ## Changes Made The dataloader test is flaky since the order of outputs is non-deterministic. Update the check to handle the flakiness

main

3 hours ago

fix(mcap): handle degenerate read windows

RitwijParmar:codex/daft-mcap-telemetry-planner

4 hours ago

chore: upgrade arrow-rs from 57.1.0 to 59.0.0 Upgrade all arrow-rs workspace dependencies (arrow, arrow-array, arrow-buffer, arrow-csv, arrow-data, arrow-flight, arrow-ipc, arrow-json, arrow-row, arrow-schema, arrow-select, parquet) from 57.1.0 to 59.0.0. API changes addressed: - PrimitiveArrayReader::new, NullArrayReader::new, and byte array reader constructors now require a batch_size parameter - LogicalType::Timestamp and LogicalType::Decimal changed from struct variants to tuple variants wrapping TimestampType and DecimalType This upgrade brings native s390x-aware size assertions for the parquet-variant Variant enum, eliminating the need for architecture- specific patches. Also updates daft-ext to support arrow-59 feature alongside existing arrow-56/57/58, and updates serde_arrow feature from arrow-57 to arrow-59 in daft-sketch. Signed-off-by: Mike DePaulo <mdepaulo@redhat.com> Signed-off-by: Mike DePaulo <mikedep333@redhat.com>

mikedep333:arrow-59-upgrade

4 hours ago

fix: detect unschedulable actor UDFs and warn on over-requested concurrency (#7113) Related to #7112 ## Summary - Raise `RuntimeError` when a single actor's resource requirement exceeds the largest node's capacity (via `ray.nodes()`), since such an actor can never be scheduled - Emit a warning when `concurrency` exceeds schedulable actor count, so users know the pipeline will proceed with a partial actor pool after `actor_udf_ready_timeout` - Preserves existing partial actor pool behavior ## Test plan - `num_cpus=1024` on 2-CPU cluster → RuntimeError - `concurrency=100, num_cpus=1` on 2-CPU cluster → warning + partial actors, succeeds - Updated `test_udf_fails_with_no_actors_schedulable` for new error message

main

4 hours ago

Latest Branches

-1%

perf(join): vectorize high-fanout inner join build takes#7143

3 hours ago

86cf3b3

RitwijParmar:codex/daft-fanout-aware-join-probe

0%

fix(tracing): honor OTEL resource env config#7061

3 hours ago

60e65ad

RitwijParmar:codex/daft-otel-env-config

0%

feat(mcap): add robotics telemetry read planning#7074

15 days ago

23f5fb6

RitwijParmar:codex/daft-mcap-telemetry-planner

© 2026 CodSpeed Technology

Home Terms Privacy Docs