argilla-io
distilabel
BlogDocsChangelog

Add `Checkpointer` step

#1114Merged
Comparing
stream-push-to-hub
(
61f3387
) with
develop
(
84ea198
)
CodSpeed Performance Gauge
-36%
Regressions
1

Benchmarks

Failed

test_cache_time
tests/integration/test_cache.py
Regression
CodSpeed Performance Gauge
-36%
557.5 ms869.2 ms

Commits

Click on a commit to change the comparison range
Base
develop
84ea198
+0.44%
Add argument to allow modifying the dump batch size from the pipeline
29959f8
9 months ago
by plaguss
-0.45%
Update Checkpointer to just push the current batch to a dataset using the HfAPI
7528815
9 months ago
by plaguss
+0.42%
Push different config files depending on the number of leaf steps (elements in the inputs
3b64892
9 months ago
by plaguss
+0.28%
Add docs for the Checkpointer step
34cb984
9 months ago
by plaguss
+0.16%
Add emoji to locate the checkpoint
8f1683e
9 months ago
by plaguss
-0.1%
Rename checkpointer and let the context manager remove the file
58b6f89
9 months ago
by plaguss
-36.61%
Merge branch 'develop' into stream-push-to-hub
61f3387
9 months ago
by plaguss
© 2025 CodSpeed Technology
Home Terms Privacy Docs