taskcluster/taskgraph - CodSpeed

taskgraph

Blog Docs Changelog

Performance History

Latest Results

feat(fetch-content): merge concurrently extracted fetches in a fixed order Firefox is moving its test package downloads from mozharness to fetches (bug 2073846). A test task will then fetch several archives into one destination with overlapping contents, such as the test harness binaries that both `common` and `trainhop` ship under `bin`. fetch-content extracts every fetch in parallel, directly into its destination, so two threads write the same tree at once and the outcome depends on thread timing. A path present in two archives ends up as whichever copy was extracted last, and on Windows the race can fail outright when `tarfile` finds a parent directory another thread just created. Each fetch now downloads and extracts into its own staging directory, and the staging directories are moved into the destination one at a time in list order. Downloads and extraction remain parallel and the merge consists of renames. When two fetches provide the same path, the later one wins, directory modes included. The Windows failure alone could be patched around in the `tarfile` subclass, but the ordering would remain undefined. The overlapping files are identical today, so that would go unnoticed until they differ and could produce an intermittent failure instead of a reproducible one.

ahochheiden:fetch-content-staged-extract

22 minutes ago

feat(fetch-content): merge concurrently extracted fetches in a fixed order Firefox is moving its test package downloads from mozharness to fetches (bug 2073846). A test task will then fetch several archives into one destination with overlapping contents, such as the test harness binaries that both `common` and `trainhop` ship under `bin`. fetch-content extracts every fetch in parallel, directly into its destination, so two threads write the same tree at once and the outcome depends on thread timing. A path present in two archives ends up as whichever copy was extracted last, and on Windows the race can fail outright when `tarfile` finds a parent directory another thread just created. Each fetch now downloads and extracts into its own staging directory, and the staging directories are moved into the destination one at a time in list order. Downloads and extraction remain parallel and the merge consists of renames. When two fetches provide the same path, the later one wins, directory modes included. The Windows failure alone could be patched around in the `tarfile` subclass, but the ordering would remain undefined. The overlapping files are identical today, so that would go unnoticed until they differ and could produce an intermittent failure instead of a reproducible one.

ahochheiden:fetch-content-staged-extract

10 hours ago

feat(run-task): implement hook point before task payload Sometimes consumers might want to do some additional shared setup before executing the task payload. This implements an environment variable which points to a Python script which will be executed in-process. Bug: 2066119

ahal:ahal/xlowmzzzqzyy

3 days ago

feat(fetch): expose fetch-mode on git fetch tasks Lets a kind opt into fetch-content's init_and_fetch mode for repos whose git server cannot serve a full clone. The flag and its digest entry are only added when the mode is not the default, so existing fetch tasks keep their command and their cached artifacts.

JohanLorenzo:bug-2047876

3 days ago

feat(fetch): expose fetch-mode on git fetch tasks Lets a kind opt into fetch-content's init_and_fetch mode for repos whose git server cannot serve a full clone. The flag and its digest entry are only added when the mode is not the default, so existing fetch tasks keep their command and their cached artifacts.

JohanLorenzo:bug-2047876

3 days ago

feat(fetch): expose fetch-mode on git fetch tasks Lets a kind opt into fetch-content's init_and_fetch mode for repos whose git server cannot serve a full clone. The flag and its digest entry are only added when the mode is not the default, so existing fetch tasks keep their command and their cached artifacts.

JohanLorenzo:bug-2047876

3 days ago

feat(fetch): expose fetch-mode on git fetch tasks Lets a kind opt into fetch-content's init_and_fetch mode for repos whose git server cannot serve a full clone. The flag and its digest entry are only added when the mode is not the default, so existing fetch tasks keep their command and their cached artifacts. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

JohanLorenzo:bug-2047876

3 days ago

feat(fetch): expose fetch-mode on git fetch tasks Lets a kind opt into fetch-content's init_and_fetch mode for repos whose git server cannot serve a full clone. The flag and its digest entry are only added when the mode is not the default, so existing fetch tasks keep their command and their cached artifacts. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

JohanLorenzo:bug-2047876

3 days ago

Latest Branches

0%

feat(fetch-content): merge concurrently extracted fetches in a fixed order#1047

1 day ago

b41c515

ahochheiden:fetch-content-staged-extract

0%

feat(run-task): implement hook point before task payload#1045

4 days ago

cbfc464

ahal:ahal/xlowmzzzqzyy

0%

feat(fetch): add fetch-mode to work around HuggingFace clone failures (bug 2047876)#1046

3 days ago

3f3d42b

JohanLorenzo:bug-2047876

© 2026 CodSpeed Technology

Home Terms Privacy Docs