Avatar for the argilla-io user
argilla-io
distilabel
BlogDocsChangelog

Add cache at `Step` level

#766Merged
Comparing
cache-per-step
(
3ea2b85
) with
develop
(
e027f99
)
CodSpeed Performance Gauge
-25%
Improvements
0
Regressions
1
Untouched
0
New
0
Dropped
0
Ignored
0

Benchmarks

Passed

test_cache_timeRegression
tests/integration/test_cache.py::test_cache_time
CodSpeed Performance Gauge
-25%
398.9 ms
532.6 ms

Commits

Click on a commit to change the comparison range
Base
develop
e027f99
+2%
Add signature method for Serializable objects
47d0bca
10 months ago
by plaguss
-6%
Make use of use_cache at the step level
54b783e
9 months ago
by plaguss
+1%
Add docstrings for internal batch manager arguments
09ee7e2
9 months ago
by plaguss
0%
Move step caching to get_batch method in batch manager step
04507f9
9 months ago
by plaguss
0%
Read batches from cached dir
0a0c7ca
9 months ago
by plaguss
+1%
Set every step cache to False if the pipeline has the cache as False
40647db
9 months ago
by plaguss
0%
Comment for the batch manager
0bf7a02
9 months ago
by plaguss
+1%
Merge and fix conflict
6270025
9 months ago
by plaguss
-3%
Checkpoint current status
9e5674a
9 months ago
by plaguss
-1%
Add integration tests for the new caching mechanism
b96a353
9 months ago
by plaguss
0%
Fix tests
08e35a2
9 months ago
by plaguss
0%
Remove undefined object input
a720d54
9 months ago
by plaguss
+1%
Merge branch 'develop' into cache-per-step
423d90d
9 months ago
by gabrielmbmb
+1%
Initial work for loading batches from `batch_manager_data` directory
48f2123
9 months ago
by gabrielmbmb
+2%
Merge and solve conflicts
9efbfdc
8 months ago
by plaguss
+5%
Merge and fix conflict
c1ce37b
7 months ago
by plaguss
-20%
Moved pipeline cache to executions folder with different data per pipeline
3a0e4c3
7 months ago
by plaguss
0%
Checkpoint with loading working while adding new steps
37a3e24
7 months ago
by plaguss
+94%
Point of control
bb28b0b
7 months ago
by plaguss
-102%
Merge branch 'develop' into cache-per-step
333e346
6 months ago
by gabrielmbmb
+1%
Remove write buffer data if `use_cache=False`
0b35f96
6 months ago
by gabrielmbmb
0%
Fix offline batch generation attributes were being not ignored by signature
f65d614
6 months ago
by gabrielmbmb
0%
Fix print test
6a79f0f
6 months ago
by gabrielmbmb
0%
Fix routing batch function
3ea2b85
6 months ago
by gabrielmbmb
© 2025 CodSpeed Technology
Home Terms PrivacyDocs