Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

Merge branch 'feat/file-write-native' into feat/file-write-multipart

BABTUNA:feat/file-write-multipart

3 hours ago

Merge remote-tracking branch 'origin/main' into feat/file-write-native # Conflicts: # daft/file/file.py

BABTUNA:feat/file-write-native

3 hours ago

test(functions): move try_divide test imports to top of file

BABTUNA:feat/functions-try-divide

23 hours ago

feat: streamline HDF5 file access (#7160) ## Summary - Streamline HDF5 DataFrame APIs by keeping lightweight `hdf5_keys`, `hdf5_attrs`, and `hdf5_metadata` helpers while removing generic dataset read/visit expression wrappers. - Update DROID trajectory reads to use a typed, schema-aware UDF that localizes HDF5 files before raw `h5py` reads. - Add bounded tempfile copying and media/HDF5 benchmark scripts for comparing buffer strategies. - Tune image/audio/video file buffering defaults and fix `VideoFile.metadata(buffer_size=...)` so the argument is respected. - Update HDF5 file docs around the DROID usage pattern and typed UDFs. - Add an integration-marked DROID `camera_frames()` test under `tests/io/av` that decodes a real MP4 frame end to end. ## Why Remote HDF5 reads through `h5py` issue many small seeks/reads, which made generic read/visit expression helpers slow and hard to reason about. Known layouts such as DROID should avoid runtime schema traversal and use explicit return dtypes. ## Validation - `DAFT_RUNNER=native make test EXTRA_ARGS="-v tests/file/test_hdf5.py tests/file/test_file_basics.py::test_to_tempfile_larger_data tests/file/test_file_basics.py::test_to_tempfile_larger_data_uses_bounded_copy_buffer tests/datasets/test_droid.py::test_trajectory_reads_selected_fields tests/datasets/test_droid.py::test_trajectory_unnests_hdf5_fields tests/datasets/test_droid.py::test_trajectory_schema_uses_known_hdf5_dtypes tests/datasets/test_droid.py::test_trajectory_reads_full_hdf5_paths tests/file/test_image_file.py::test_imagefile_decode tests/file/test_image_file.py::test_imagefile_decode_with_mode tests/file/test_image_file.py::test_imagefile_decode_with_default_buffer tests/file/test_image_file.py::test_imagefile_decode_uses_copy_buffer_by_default tests/file/test_audio.py::test_audio_file_standalone tests/file/test_audio.py::test_get_metadata tests/file/test_video.py::test_get_metadata tests/file/test_video.py::test_video_metadata_uses_configured_buffer tests/file/test_video.py::test_keyframes tests/file/test_video.py::test_frames_standalone tests/file/test_video.py::test_frames_can_filter_keyframes tests/file/test_video.py::test_video_frames_expression"` - `DAFT_RUNNER=native make test EXTRA_ARGS="-v tests/file/test_video.py tests/datasets/test_droid.py::test_camera_frames_defaults_to_all_cameras tests/datasets/test_droid.py::test_camera_frames_accepts_single_camera_string tests/datasets/test_droid.py::test_camera_frames_accepts_camera_list tests/datasets/test_droid.py::test_camera_frames_rejects_empty_camera_list tests/datasets/test_droid.py::test_camera_frames_rejects_unknown_camera tests/datasets/test_droid.py::test_camera_frames_requires_requested_camera_columns"` - `DAFT_RUNNER=native make test EXTRA_ARGS="-m integration -v tests/io/av/test_droid_camera_frames.py"` - `ruff check --no-fix tests/datasets/test_droid.py tests/io/av/test_droid_camera_frames.py` - Focused `ruff check --no-fix` / `py_compile` passes on touched HDF5/DROID/media files.

main

1 day ago

refactor(functions): use hex crate for hex encoding

BABTUNA:feat/functions-hex-unhex

1 day ago

Merge branch 'main' into issue-5690-ray-sample-by-size

johnquevedo:issue-5690-ray-sample-by-size

2 days ago

test(functions): assert output values in try_to_binary case-insensitivity test

BABTUNA:feat/functions-try-to-binary

2 days ago

fix: add HdfsConfig to test_morsels explain output

Lucas61000:issue-2786

2 days ago

Latest Branches

0%

feat(file): stream multipart uploads for File writes with abort on rollback#7216

4 hours ago

2fefc6d

BABTUNA:feat/file-write-multipart

0%

feat(file): add native write support to daft.File.open#7206

4 hours ago

7dffd58

BABTUNA:feat/file-write-native

0%

feat(functions): add try_divide for PySpark parity#7210

1 day ago

437b152

BABTUNA:feat/functions-try-divide

© 2026 CodSpeed Technology

Home Terms Privacy Docs