Eventual-Inc
Daft
BlogDocsChangelog

Performance History

Latest Results

refactor(arrow-rs): migrate is_in and get_lit ops to Arrow-rs arrays (#6085) Migrate two core array operations from `arrow2` to `arrow-rs`: - `is_in`: switch to `AsArrow::as_arrow()` and build membership sets via Arrow-rs iterators (`HashSet` for integers, `BTreeSet<FloatWrapper<_>>` for floats). - `get_lit` (Tensor/SparseTensor): read `shape` via Arrow-rs `UInt64Array.values().to_vec()`. Part of Daft’s staged Arrow2 → Arrow-rs migration (#5741). This change removes Arrow2 usage in these operators while preserving semantics and keeping null handling intact. <!-- Describe what changes were made and why. Include implementation details if necessary. --> ## Changes - `src/daft-core/src/array/ops/is_in.rs`: Arrow-rs iterators + set membership; float handled via `FloatWrapper`. - `src/daft-core/src/array/ops/get_lit.rs`: shape extraction using Arrow-rs `UInt64Array` with clearer error messages. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" -->
main
7 minutes ago
Remove redundant schema.py change
fix-embedding-type-read
1 day ago

Active Branches

fix: Register extension type before reading from Lance
last run
1 day ago
#6058
CodSpeed Performance Gauge
-1%
#5993
CodSpeed Performance Gauge
0%
#6084
CodSpeed Performance Gauge
0%
© 2026 CodSpeed Technology
Home Terms Privacy Docs