Avatar for the Eventual-Inc user
Eventual-Inc
Daft
BlogDocsChangelog

Performance History

Latest Results

fix(telemetry): prevent interpreter-shutdown segfault from Scarf telemetry The Scarf telemetry worker runs in a daemon thread that makes HTTPS requests via urllib. At interpreter shutdown that thread can still be inside the SSL/OpenSSL stack (creating an SSLContext and loading CA certificates) while the main thread finalizes, and the two race on OpenSSL global state, crashing the process with SIGSEGV *after* all user work has already completed successfully. It reproduces with plain repeated daft usage (e.g. a few `DataFrame.write_lance` / `read_*` calls in one process) and is easy to hit on interpreters that statically link OpenSSL, such as the python-build-standalone builds used by uv/pyenv. It surfaces as exit code 139, which CI and batch schedulers treat as a failure even though the data was written correctly. Fix: build the SSLContext once on the main thread and reuse it for the telemetry requests, so the daemon worker never initializes OpenSSL global state itself and cannot race teardown. Also pass an explicit request timeout so a slow or unreachable endpoint can't keep the worker alive inside the SSL stack. Telemetry stays non-blocking (still a daemon thread), so process shutdown is not slowed. Opting out via DAFT_ANALYTICS_ENABLED=0 / DO_NOT_TRACK=1 also avoids it. Signed-off-by: fanng <“fanng@apache.org”>
FANNG1:fix/telemetry-exit-segfault
1 hour ago
Update the tests
lhoestq:document-s3-alternative-for-cc
12 hours ago
Add end to end tests
arpatilmh:abhijeet/deltalake-s3-conditional-put
17 hours ago
Merge branch 'main' into abhijeet/deltalake-s3-conditional-put
arpatilmh:abhijeet/deltalake-s3-conditional-put
1 day ago
local hf cache
YuangGao:feat/transformers-vision-prompter
1 day ago

Latest Branches

CodSpeed Performance Gauge
0%
fix(telemetry): prevent interpreter-shutdown segfault from Scarf telemetry#7203
2 hours ago
fb65dc4
FANNG1:fix/telemetry-exit-segfault
CodSpeed Performance Gauge
0%
feat: Use HF Bucket as as alternative for Common Crawl#7103
13 hours ago
589b0b5
lhoestq:document-s3-alternative-for-cc
CodSpeed Performance Gauge
0%
perf(video): close the read_video_frames streaming gaps (tracking)#7201
18 hours ago
f445b4b
yk/video-read-frames-perf
© 2026 CodSpeed Technology
Home Terms Privacy Docs