Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

fix(telemetry): prevent interpreter-shutdown segfault from Scarf telemetry The Scarf telemetry worker runs in a daemon thread that makes HTTPS requests via urllib. At interpreter shutdown that thread can still be inside the SSL/OpenSSL stack (creating an SSLContext and loading CA certificates) while the main thread finalizes, and the two race on OpenSSL global state, crashing the process with SIGSEGV *after* all user work has already completed successfully. It reproduces with plain repeated daft usage (e.g. a few `DataFrame.write_lance` / `read_*` calls in one process) and is easy to hit on interpreters that statically link OpenSSL, such as the python-build-standalone builds used by uv/pyenv. It surfaces as exit code 139, which CI and batch schedulers treat as a failure even though the data was written correctly. Fix: build the SSLContext once on the main thread and reuse it for the telemetry requests, so the daemon worker never initializes OpenSSL global state itself and cannot race teardown. Also pass an explicit request timeout so a slow or unreachable endpoint can't keep the worker alive inside the SSL stack. Telemetry stays non-blocking (still a daemon thread), so process shutdown is not slowed. Opting out via DAFT_ANALYTICS_ENABLED=0 / DO_NOT_TRACK=1 also avoids it. Signed-off-by: fanng <“fanng@apache.org”>

FANNG1:fix/telemetry-exit-segfault

1 hour ago

Update the tests

lhoestq:document-s3-alternative-for-cc

12 hours ago

perf(video): tracking doc for read_video_frames streaming gaps

yk/video-read-frames-perf

17 hours ago

Add end to end tests

arpatilmh:abhijeet/deltalake-s3-conditional-put

17 hours ago

Merge branch 'main' into abhijeet/deltalake-s3-conditional-put

arpatilmh:abhijeet/deltalake-s3-conditional-put

1 day ago

YuangGao:feat/transformers-vision-prompter

1 day ago

feat(io): export GooseFSConfig from daft.io Register GooseFSConfig alongside the other connector configs so users can write `from daft.io import IOConfig, GooseFSConfig` (matching the pattern used by S3Config, CosConfig, etc.), and add the missing pyi stubs so mypy and IDEs can see the type. Follow-up to #7192 (rename GoosefsConfig -> GooseFSConfig).

XuQianJin-Stars:feat/export-goosefs-config

1 day ago

docs(lerobot benchmark): measured full-dataset original run + scaling chart Original reader on all 632 frames: 1750.7s (29 min) vs batched 115.8s. Full-dataset outputs hash-identical, replacing the earlier spot-check.

yk/lerobot-batch-decode

1 day ago

Latest Branches

0%

fix(telemetry): prevent interpreter-shutdown segfault from Scarf telemetry#7203

2 hours ago

fb65dc4

FANNG1:fix/telemetry-exit-segfault

0%

feat: Use HF Bucket as as alternative for Common Crawl#7103

13 hours ago

589b0b5

lhoestq:document-s3-alternative-for-cc

0%

perf(video): close the read_video_frames streaming gaps (tracking)#7201

18 hours ago

f445b4b

yk/video-read-frames-perf

© 2026 CodSpeed Technology

Home Terms Privacy Docs