Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

test(functions): move try_divide test imports to top of file

BABTUNA:feat/functions-try-divide

10 hours ago

feat: streamline HDF5 file access (#7160) ## Summary - Streamline HDF5 DataFrame APIs by keeping lightweight `hdf5_keys`, `hdf5_attrs`, and `hdf5_metadata` helpers while removing generic dataset read/visit expression wrappers. - Update DROID trajectory reads to use a typed, schema-aware UDF that localizes HDF5 files before raw `h5py` reads. - Add bounded tempfile copying and media/HDF5 benchmark scripts for comparing buffer strategies. - Tune image/audio/video file buffering defaults and fix `VideoFile.metadata(buffer_size=...)` so the argument is respected. - Update HDF5 file docs around the DROID usage pattern and typed UDFs. - Add an integration-marked DROID `camera_frames()` test under `tests/io/av` that decodes a real MP4 frame end to end. ## Why Remote HDF5 reads through `h5py` issue many small seeks/reads, which made generic read/visit expression helpers slow and hard to reason about. Known layouts such as DROID should avoid runtime schema traversal and use explicit return dtypes. ## Validation - `DAFT_RUNNER=native make test EXTRA_ARGS="-v tests/file/test_hdf5.py tests/file/test_file_basics.py::test_to_tempfile_larger_data tests/file/test_file_basics.py::test_to_tempfile_larger_data_uses_bounded_copy_buffer tests/datasets/test_droid.py::test_trajectory_reads_selected_fields tests/datasets/test_droid.py::test_trajectory_unnests_hdf5_fields tests/datasets/test_droid.py::test_trajectory_schema_uses_known_hdf5_dtypes tests/datasets/test_droid.py::test_trajectory_reads_full_hdf5_paths tests/file/test_image_file.py::test_imagefile_decode tests/file/test_image_file.py::test_imagefile_decode_with_mode tests/file/test_image_file.py::test_imagefile_decode_with_default_buffer tests/file/test_image_file.py::test_imagefile_decode_uses_copy_buffer_by_default tests/file/test_audio.py::test_audio_file_standalone tests/file/test_audio.py::test_get_metadata tests/file/test_video.py::test_get_metadata tests/file/test_video.py::test_video_metadata_uses_configured_buffer tests/file/test_video.py::test_keyframes tests/file/test_video.py::test_frames_standalone tests/file/test_video.py::test_frames_can_filter_keyframes tests/file/test_video.py::test_video_frames_expression"` - `DAFT_RUNNER=native make test EXTRA_ARGS="-v tests/file/test_video.py tests/datasets/test_droid.py::test_camera_frames_defaults_to_all_cameras tests/datasets/test_droid.py::test_camera_frames_accepts_single_camera_string tests/datasets/test_droid.py::test_camera_frames_accepts_camera_list tests/datasets/test_droid.py::test_camera_frames_rejects_empty_camera_list tests/datasets/test_droid.py::test_camera_frames_rejects_unknown_camera tests/datasets/test_droid.py::test_camera_frames_requires_requested_camera_columns"` - `DAFT_RUNNER=native make test EXTRA_ARGS="-m integration -v tests/io/av/test_droid_camera_frames.py"` - `ruff check --no-fix tests/datasets/test_droid.py tests/io/av/test_droid_camera_frames.py` - Focused `ruff check --no-fix` / `py_compile` passes on touched HDF5/DROID/media files.

main

14 hours ago

refactor(functions): use hex crate for hex encoding

BABTUNA:feat/functions-hex-unhex

16 hours ago

Merge branch 'main' into issue-5690-ray-sample-by-size

johnquevedo:issue-5690-ray-sample-by-size

1 day ago

test(functions): assert output values in try_to_binary case-insensitivity test

BABTUNA:feat/functions-try-to-binary

1 day ago

fix: add HdfsConfig to test_morsels explain output

Lucas61000:issue-2786

2 days ago

Merge branch 'main' into issue-6901

Lucas61000:issue-6901

2 days ago

Merge branch 'main' into issue-3957

Lucas61000:issue-3957

2 days ago

Latest Branches

0%

feat(functions): add try_divide for PySpark parity#7210

11 hours ago

437b152

BABTUNA:feat/functions-try-divide

0%

feat(functions): add hex and unhex for PySpark parity#7208

17 hours ago

1357f20

BABTUNA:feat/functions-hex-unhex

+1%

feat: add Ray support for sample by size#7188

1 day ago

f9a2aa9

johnquevedo:issue-5690-ray-sample-by-size

© 2026 CodSpeed Technology

Home Terms Privacy Docs