Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

fix(io): prevent integer overflow in range size calculation Use i128 for range size calculation to avoid overflow when start and end values are at opposite extremes of i64 range (e.g., i64::MIN to i64::MAX).

singularityDLW:feature/issue-2708-numeric-range-glob

16 minutes ago

feat: Add Python Function data source info in explain Signed-off-by: plotor <zhenchao.wang@hotmail.com>

plotor:zhenchao-jungle

57 minutes ago

feat(io): support numeric range expansion in glob patterns Add support for bash-style numeric range syntax `{start..end}` in glob patterns. This allows users to easily select files by numeric sequences: df = daft.read_parquet("s3://bucket/{0..99}.parquet") The implementation expands numeric ranges to alternation patterns that are compatible with the globset crate, e.g. `{0..3}` becomes `{0,1,2,3}`. Features: - Basic ranges: {0..10} - Leading zeros preserved: {00..05} -> 00,01,02,03,04,05 - Reverse ranges: {10..0} - Negative numbers: {-5..5} - Multiple ranges in path: {0..1}/{0..2}.csv - Mixed with wildcards: {0..9}_*.parquet Safety: - Maximum range size of 10,000 elements to prevent memory issues - Clear error message when limit exceeded

singularityDLW:feature/issue-2708-numeric-range-glob

1 hour ago

feat: Add Python Function data source info in explain Signed-off-by: plotor <zhenchao.wang@hotmail.com>

plotor:zhenchao-jungle

2 hours ago

Tests are passing

slade/flight-shuffle-squashed

7 hours ago

Figured out how to do the conversion

slade/flight-shuffle-squashed

8 hours ago

fix: make df.into_partitions() work when input num == num_partitions (#6061) ## Changes Made Coalesce multiple per-task outputs into a single MicroPartition in into_partition() execution, when input number is equal to num_partitions and set **enable_scan_tasks_split_and_merge** as True. For example: ``` daft.set_execution_config( enable_scan_task_split_and_merge=True, ) df = daft.read_parquet(...) df.into_partitions(df.num_partitions()) assert( len(list(df.iter_partitions())) == df.num_partitions() ) ``` Before this pr, when we set enable_scan_task_split_and_merge=True, the assertion above will wrong, because the micropartitions are not coalesced.  Co-authored-by: wangzheyan <wangzheyan@bytedance.com>

main

9 hours ago

refactor(arrow-rs): Remove arrow2 from the search_sorted kernel (#6034) Remove arrow2 from the search_sorted kernel, which also affects some comparison kernels.

main

11 hours ago

Active Branches

feat(io): support numeric range expansion in glob patterns

last run

16 minutes ago

0%

feat: Add Python Function data source info in explain

last run

57 minutes ago

0%

[wip] feat: flight shuffle rebase

last run

7 hours ago

0%

© 2026 CodSpeed Technology

Home Terms Privacy Docs