Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add cron task that runs the minimal training pipeline nightly #966

Merged
merged 1 commit into from
Jan 6, 2025

feat: add cron task that runs the minimal training pipeline nightly

853ef48
Select commit
Loading
Failed to load commit list.
Merged

feat: add cron task that runs the minimal training pipeline nightly #966

feat: add cron task that runs the minimal training pipeline nightly
853ef48
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / tests-lint-black succeeded Jan 6, 2025 in 2m 56s

FirefoxCI (pull_request)

Run tests

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-01-06T17:36:36.856Z
Resolved: 2025-01-06T17:37:44.686Z
Task Execution Time: 1 minute, 7 seconds, 830 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2025-01-06T17:36:36.878Z] Worker Type (translations-1/b-linux-large-gcp-d2g) settings:
[taskcluster 2025-01-06T17:36:36.878Z]   {
[taskcluster 2025-01-06T17:36:36.878Z]     "config": {
[taskcluster 2025-01-06T17:36:36.878Z]       "deploymentId": ""
[taskcluster 2025-01-06T17:36:36.878Z]     },
[taskcluster 2025-01-06T17:36:36.878Z]     "generic-worker": {
[taskcluster 2025-01-06T17:36:36.878Z]       "config": {
[taskcluster 2025-01-06T17:36:36.878Z]         "headlessTasks": true,
[taskcluster 2025-01-06T17:36:36.878Z]         "runTasksAsCurrentUser": false
[taskcluster 2025-01-06T17:36:36.878Z]       },
[taskcluster 2025-01-06T17:36:36.878Z]       "engine": "multiuser",
[taskcluster 2025-01-06T17:36:36.878Z]       "go-arch": "amd64",
[taskcluster 2025-01-06T17:36:36.878Z]       "go-os": "linux",
[taskcluster 2025-01-06T17:36:36.878Z]       "go-version": "go1.23.3",
[taskcluster 2025-01-06T17:36:36.878Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v75.0.0",
[taskcluster 2025-01-06T17:36:36.878Z]       "revision": "1f02e08d3ac9520fd636409dd44f97b9945bf882",
[taskcluster 2025-01-06T17:36:36.878Z]       "source": "https://github.com/taskcluster/taskcluster/commits/1f02e08d3ac9520fd636409dd44f97b9945bf882",
[taskcluster 2025-01-06T17:36:36.878Z]       "version": "75.0.0"
[taskcluster 2025-01-06T17:36:36.878Z]     },
[taskcluster 2025-01-06T17:36:36.878Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2024-12-10",

...(4 lines hidden)...

[taskcluster 2025-01-06T17:36:36.878Z]     "public-hostname": "translations-1-b-linux-large-gcp-d2g-ysgnwuomtzegzl6wrl30zw.c.fxci-production-level1-workers.internal",
[taskcluster 2025-01-06T17:36:36.878Z]     "public-ipv4": "34.169.27.2",
[taskcluster 2025-01-06T17:36:36.878Z]     "region": "us-west1",
[taskcluster 2025-01-06T17:36:36.878Z]     "zone": "us-west1-b"
[taskcluster 2025-01-06T17:36:36.878Z]   }
[taskcluster 2025-01-06T17:36:36.878Z] Task ID: TkS1J94pRTOEqvYex_sK8A
[taskcluster 2025-01-06T17:36:36.878Z] === Task Starting ===
[taskcluster:warn 2025-01-06T17:36:36.881Z] This task was designed to run under Docker Worker. Docker Worker is no longer maintained.
[taskcluster:warn 2025-01-06T17:36:36.881Z] In order to execute this task, it is being converted to a Generic Worker task, using the D2G
[taskcluster:warn 2025-01-06T17:36:36.881Z] utility (Docker Worker 2 Generic Worker):
[taskcluster:warn 2025-01-06T17:36:36.881Z]     https://github.com/taskcluster/taskcluster/tree/main/clients/client-shell#translating-docker-worker-task-definitionpayload-to-generic-worker-task-definitionpayload
[taskcluster:warn 2025-01-06T17:36:36.881Z] 
[taskcluster:warn 2025-01-06T17:36:36.881Z] We recommend that you convert all your Docker Worker tasks to Generic Worker tasks, to ensure
[taskcluster:warn 2025-01-06T17:36:36.881Z] continued support. For this task, see the converted payload below. If you have many tasks that
[taskcluster:warn 2025-01-06T17:36:36.881Z] require conversion, consider using the d2g tool (above) directly. It simply takes a Docker
[taskcluster:warn 2025-01-06T17:36:36.881Z] Worker task payload as input, and outputs a Generic Worker task payload. It can also convert
[taskcluster:warn 2025-01-06T17:36:36.881Z] Docker Worker scopes to equivalent Generic Worker scopes.
[taskcluster:warn 2025-01-06T17:36:36.881Z] 
[taskcluster:warn 2025-01-06T17:36:36.881Z] Converted task definition (conversion performed by d2g):
[taskcluster:warn 2025-01-06T17:36:36.881Z] ---
[taskcluster:warn 2025-01-06T17:36:36.881Z]   created: "2025-01-06T17:34:47.989Z"
[taskcluster:warn 2025-01-06T17:36:36.881Z]   deadline: "2025-01-26T17:34:47.989Z"
[taskcluster:warn 2025-01-06T17:36:36.881Z]   dependencies:
[taskcluster:warn 2025-01-06T17:36:36.881Z]   - BdKH0ifwRYGGWMSK6ToLvQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]   - QWERZQMSQjOGwm7bIzGvFQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]   expires: "2026-01-01T17:34:47.989Z"
[taskcluster:warn 2025-01-06T17:36:36.881Z]   extra:
[taskcluster:warn 2025-01-06T17:36:36.881Z]     index:
[taskcluster:warn 2025-01-06T17:36:36.881Z]       rank: 0
[taskcluster:warn 2025-01-06T17:36:36.881Z]     parent: QWERZQMSQjOGwm7bIzGvFQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]   metadata:
[taskcluster:warn 2025-01-06T17:36:36.881Z]     description: Run tests
[taskcluster:warn 2025-01-06T17:36:36.881Z]     name: tests-lint-black
[taskcluster:warn 2025-01-06T17:36:36.881Z]     owner: [email protected]
[taskcluster:warn 2025-01-06T17:36:36.881Z]     source: https://github.com/bhearsum/firefox-translations-training/blob/853ef4882f95a1f9985acf33e8b2bb16cbb752c7/taskcluster/kinds/tests
[taskcluster:warn 2025-01-06T17:36:36.881Z]   payload:
[taskcluster:warn 2025-01-06T17:36:36.881Z]     command:
[taskcluster:warn 2025-01-06T17:36:36.881Z]     - - bash
[taskcluster:warn 2025-01-06T17:36:36.881Z]       - -cx
[taskcluster:warn 2025-01-06T17:36:36.881Z]       - |-
[taskcluster:warn 2025-01-06T17:36:36.881Z]         IMAGE_ID=$(docker load --input dockerimage | sed -n '0,/^Loaded image: /s/^Loaded image: //p')
[taskcluster:warn 2025-01-06T17:36:36.881Z]         docker run -t --rm --memory-swap -1 --pids-limit -1 -v "$(pwd)/cache0:/builds/worker/checkouts" --add-host=taskcluster:127.0.0.1 --net=host -e FIREFOX_TRANSLATIONS_TRAINING_BASE_REPOSITORY -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REF -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REPOSITORY -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REV -e FIREFOX_TRANSLATIONS_TRAINING_REPOSITORY_TYPE -e HG_STORE_PATH -e MOZ_AUTOMATION -e MOZ_SCM_LEVEL -e REPOSITORIES -e RUN_ID -e SCCACHE_DISABLE -e TASKCLUSTER_CACHES -e TASKCLUSTER_INSTANCE_TYPE -e TASKCLUSTER_PROXY_URL -e TASKCLUSTER_ROOT_URL -e TASKCLUSTER_UNTRUSTED_CACHES -e TASKCLUSTER_VOLUMES -e TASKCLUSTER_WORKER_LOCATION -e TASK_GROUP_ID -e TASK_ID -e VCS_PATH "${IMAGE_ID}" /usr/local/bin/run-task --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c 'task lint-black'
[taskcluster:warn 2025-01-06T17:36:36.881Z]     env:
[taskcluster:warn 2025-01-06T17:36:36.881Z]       FIREFOX_TRANSLATIONS_TRAINING_BASE_REPOSITORY: https://github.com/mozilla/translations
[taskcluster:warn 2025-01-06T17:36:36.881Z]       FIREFOX_TRANSLATIONS_TRAINING_HEAD_REF: cron-pipeline
[taskcluster:warn 2025-01-06T17:36:36.881Z]       FIREFOX_TRANSLATIONS_TRAINING_HEAD_REPOSITORY: https://github.com/bhearsum/firefox-translations-training
[taskcluster:warn 2025-01-06T17:36:36.881Z]       FIREFOX_TRANSLATIONS_TRAINING_HEAD_REV: 853ef4882f95a1f9985acf33e8b2bb16cbb752c7
[taskcluster:warn 2025-01-06T17:36:36.881Z]       FIREFOX_TRANSLATIONS_TRAINING_REPOSITORY_TYPE: git
[taskcluster:warn 2025-01-06T17:36:36.881Z]       HG_STORE_PATH: /builds/worker/checkouts/hg-store
[taskcluster:warn 2025-01-06T17:36:36.881Z]       MOZ_AUTOMATION: "1"
[taskcluster:warn 2025-01-06T17:36:36.881Z]       MOZ_SCM_LEVEL: "1"
[taskcluster:warn 2025-01-06T17:36:36.881Z]       REPOSITORIES: '{"firefox_translations_training": "firefox-translations-training"}'
[taskcluster:warn 2025-01-06T17:36:36.881Z]       SCCACHE_DISABLE: "1"
[taskcluster:warn 2025-01-06T17:36:36.881Z]       TASKCLUSTER_CACHES: /builds/worker/checkouts
[taskcluster:warn 2025-01-06T17:36:36.881Z]       TASKCLUSTER_UNTRUSTED_CACHES: "1"
[taskcluster:warn 2025-01-06T17:36:36.881Z]       TASKCLUSTER_VOLUMES: /builds/worker/.cache;/builds/worker/checkouts
[taskcluster:warn 2025-01-06T17:36:36.881Z]       VCS_PATH: /builds/worker/checkouts/vcs
[taskcluster:warn 2025-01-06T17:36:36.881Z]     features:
[taskcluster:warn 2025-01-06T17:36:36.881Z]       backingLog: true
[taskcluster:warn 2025-01-06T17:36:36.881Z]       liveLog: true
[taskcluster:warn 2025-01-06T17:36:36.881Z]       taskclusterProxy: true
[taskcluster:warn 2025-01-06T17:36:36.881Z]     logs:
[taskcluster:warn 2025-01-06T17:36:36.881Z]       backing: public/logs/live_backing.log
[taskcluster:warn 2025-01-06T17:36:36.881Z]       live: public/logs/live.log
[taskcluster:warn 2025-01-06T17:36:36.881Z]     maxRunTime: 3600
[taskcluster:warn 2025-01-06T17:36:36.881Z]     mounts:
[taskcluster:warn 2025-01-06T17:36:36.881Z]     - cacheName: translations-level-1-checkouts-v3-7afeb851dd97df8f3607-BdKH0ifwRYGGWMSK6ToLvQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]       directory: cache0
[taskcluster:warn 2025-01-06T17:36:36.881Z]     - content:
[taskcluster:warn 2025-01-06T17:36:36.881Z]         artifact: public/image.tar.zst
[taskcluster:warn 2025-01-06T17:36:36.881Z]         taskId: BdKH0ifwRYGGWMSK6ToLvQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]       file: dockerimage
[taskcluster:warn 2025-01-06T17:36:36.881Z]     onExitStatus:
[taskcluster:warn 2025-01-06T17:36:36.881Z]       purgeCaches:
[taskcluster:warn 2025-01-06T17:36:36.881Z]       - 72
[taskcluster:warn 2025-01-06T17:36:36.881Z]       retry:
[taskcluster:warn 2025-01-06T17:36:36.881Z]       - 128
[taskcluster:warn 2025-01-06T17:36:36.881Z]       - 72
[taskcluster:warn 2025-01-06T17:36:36.881Z]       - 125
[taskcluster:warn 2025-01-06T17:36:36.881Z]     osGroups:
[taskcluster:warn 2025-01-06T17:36:36.881Z]     - docker
[taskcluster:warn 2025-01-06T17:36:36.881Z]   priority: low
[taskcluster:warn 2025-01-06T17:36:36.881Z]   projectId: none
[taskcluster:warn 2025-01-06T17:36:36.881Z]   provisionerId: translations-1
[taskcluster:warn 2025-01-06T17:36:36.881Z]   requires: all-completed
[taskcluster:warn 2025-01-06T17:36:36.881Z]   retries: 5
[taskcluster:warn 2025-01-06T17:36:36.881Z]   routes:
[taskcluster:warn 2025-01-06T17:36:36.881Z]   - checks
[taskcluster:warn 2025-01-06T17:36:36.881Z]   schedulerId: translations-level-1
[taskcluster:warn 2025-01-06T17:36:36.881Z]   scopes:
[taskcluster:warn 2025-01-06T17:36:36.881Z]   - docker-worker:cache:translations-level-1-checkouts-v3-7afeb851dd97df8f3607-BdKH0ifwRYGGWMSK6ToLvQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]   - generic-worker:cache:translations-level-1-checkouts-v3-7afeb851dd97df8f3607-BdKH0ifwRYGGWMSK6ToLvQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]   - generic-worker:os-group:translations-1/b-linux-large-gcp-d2g/docker
[taskcluster:warn 2025-01-06T17:36:36.881Z]   tags:
[taskcluster:warn 2025-01-06T17:36:36.881Z]     createdForUser: [email protected]
[taskcluster:warn 2025-01-06T17:36:36.881Z]     kind: tests
[taskcluster:warn 2025-01-06T17:36:36.881Z]     label: tests-lint-black
[taskcluster:warn 2025-01-06T17:36:36.881Z]     os: linux
[taskcluster:warn 2025-01-06T17:36:36.881Z]     worker-implementation: docker-worker
[taskcluster:warn 2025-01-06T17:36:36.881Z]   taskGroupId: QWERZQMSQjOGwm7bIzGvFQ
[taskcluster:warn 2025-01-06T17:36:36.881Z]   taskQueueId: translations-1/b-linux-large-gcp-d2g
[taskcluster:warn 2025-01-06T17:36:36.881Z]   workerType: b-linux-large-gcp-d2g
[taskcluster:warn 2025-01-06T17:36:36.881Z] 
[taskcluster 2025-01-06T17:36:38.676Z] Uploading redirect artifact public/logs/live.log to URL https://firefoxci-websocktunnel.services.mozilla.com/us-west1-b.4248329507675679395.60099/log/UInH-APITM-re1pL4JsW_Q with mime type "text/plain; charset=utf-8" and expiry 2025-01-06T18:51:38.656Z
[taskcluster 2025-01-06T17:36:40.671Z] [mounts] No existing writable directory cache 'translations-level-1-checkouts-v3-7afeb851dd97df8f3607-BdKH0ifwRYGGWMSK6ToLvQ' - creating caches/XbaE8fSTRX-G48kdBi7DKA
[taskcluster 2025-01-06T17:36:40.671Z] [mounts] Creating directory /home/task_173618499452161/cache0
[taskcluster 2025-01-06T17:36:40.680Z] [mounts] Updating ownership of files inside directory '/home/task_173618499452161/cache0' from root to task_173618499452161
[taskcluster 2025-01-06T17:36:40.777Z] [mounts] Successfully mounted writable directory cache '/home/task_173618499452161/cache0'
[taskcluster 2025-01-06T17:36:40.777Z] [mounts] Downloading task BdKH0ifwRYGGWMSK6ToLvQ artifact public/image.tar.zst to downloads/SQBdVP7BTric2gB5M2P9tw
[taskcluster 2025-01-06T17:36:44.487Z] [mounts] Downloaded 326634467 bytes with SHA256 fc634c15412195511e364c305973cd00928f537ac077a3ee2a278dc571e5b356 from task BdKH0ifwRYGGWMSK6ToLvQ artifact public/image.tar.zst to downloads/SQBdVP7BTric2gB5M2P9tw
[taskcluster:warn 2025-01-06T17:36:44.487Z] [mounts] Download downloads/SQBdVP7BTric2gB5M2P9tw of task BdKH0ifwRYGGWMSK6ToLvQ artifact public/image.tar.zst has SHA256 fc634c15412195511e364c305973cd00928f537ac077a3ee2a278dc571e5b356 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2025-01-06T17:36:44.487Z] [mounts] Creating directory /home/task_173618499452161
[taskcluster 2025-01-06T17:36:44.504Z] [mounts] Copying downloads/SQBdVP7BTric2gB5M2P9tw to /home/task_173618499452161/dockerimage
[taskcluster 2025-01-06T17:36:49.619Z] [mounts] Granting task_173618499452161 full control of file '/home/task_173618499452161/dockerimage'
[taskcluster 2025-01-06T17:36:49.621Z] Executing command 0: bash -cx 'IMAGE_ID=$(docker load --input dockerimage | sed -n '\''0,/^Loaded image: /s/^Loaded image: //p'\'')
[taskcluster 2025-01-06T17:36:49.621Z] docker run -t --rm --memory-swap -1 --pids-limit -1 -v "$(pwd)/cache0:/builds/worker/checkouts" --add-host=taskcluster:127.0.0.1 --net=host -e FIREFOX_TRANSLATIONS_TRAINING_BASE_REPOSITORY -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REF -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REPOSITORY -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REV -e FIREFOX_TRANSLATIONS_TRAINING_REPOSITORY_TYPE -e HG_STORE_PATH -e MOZ_AUTOMATION -e MOZ_SCM_LEVEL -e REPOSITORIES -e RUN_ID -e SCCACHE_DISABLE -e TASKCLUSTER_CACHES -e TASKCLUSTER_INSTANCE_TYPE -e TASKCLUSTER_PROXY_URL -e TASKCLUSTER_ROOT_URL -e TASKCLUSTER_UNTRUSTED_CACHES -e TASKCLUSTER_VOLUMES -e TASKCLUSTER_WORKER_LOCATION -e TASK_GROUP_ID -e TASK_ID -e VCS_PATH "${IMAGE_ID}" /usr/local/bin/run-task --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c '\''task lint-black'\'
++ docker load --input dockerimage
++ sed -n '0,/^Loaded image: /s/^Loaded image: //p'
+ IMAGE_ID=test:latest
++ pwd
+ docker run -t --rm --memory-swap -1 --pids-limit -1 -v /home/task_173618499452161/cache0:/builds/worker/checkouts --add-host=taskcluster:127.0.0.1 --net=host -e FIREFOX_TRANSLATIONS_TRAINING_BASE_REPOSITORY -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REF -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REPOSITORY -e FIREFOX_TRANSLATIONS_TRAINING_HEAD_REV -e FIREFOX_TRANSLATIONS_TRAINING_REPOSITORY_TYPE -e HG_STORE_PATH -e MOZ_AUTOMATION -e MOZ_SCM_LEVEL -e REPOSITORIES -e RUN_ID -e SCCACHE_DISABLE -e TASKCLUSTER_CACHES -e TASKCLUSTER_INSTANCE_TYPE -e TASKCLUSTER_PROXY_URL -e TASKCLUSTER_ROOT_URL -e TASKCLUSTER_UNTRUSTED_CACHES -e TASKCLUSTER_VOLUMES -e TASKCLUSTER_WORKER_LOCATION -e TASK_GROUP_ID -e TASK_ID -e VCS_PATH test:latest /usr/local/bin/run-task --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c 'task lint-black'
[setup 2025-01-06T17:37:25.494Z] run-task started in /builds/worker
[setup 2025-01-06T17:37:25.494Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c task lint-black
[setup 2025-01-06T17:37:25.494Z] Python version: 3.10.12
[cache 2025-01-06T17:37:25.495Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2025-01-06T17:37:25.495Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2025-01-06T17:37:25.495Z] volume /builds/worker/checkouts is a cache
[setup 2025-01-06T17:37:25.496Z] running as worker:worker
[vcs 2025-01-06T17:37:25.496Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2025-01-06T17:37:25.498Z] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/vcs']
[vcs 2025-01-06T17:37:25.499Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2025-01-06T17:37:29.618Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'cron-pipeline']
[vcs 2025-01-06T17:37:30.022Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2025-01-06T17:37:30.022Z]  * branch            cron-pipeline -> FETCH_HEAD
[vcs 2025-01-06T17:37:30.024Z] executing ['git', 'checkout', '-f', '-B', 'cron-pipeline', '853ef4882f95a1f9985acf33e8b2bb16cbb752c7']
[vcs 2025-01-06T17:37:30.093Z] Switched to a new branch 'cron-pipeline'
[vcs 2025-01-06T17:37:30.111Z] executing ['git', 'submodule', 'init']
[vcs 2025-01-06T17:37:30.130Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2025-01-06T17:37:30.131Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2025-01-06T17:37:30.132Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2025-01-06T17:37:30.132Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2025-01-06T17:37:30.132Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2025-01-06T17:37:30.133Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2025-01-06T17:37:30.133Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2025-01-06T17:37:30.134Z] Submodule 'inference/3rd_party/emsdk' (https://github.com/emscripten-core/emsdk.git) registered for path 'inference/3rd_party/emsdk'
[vcs 2025-01-06T17:37:30.134Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2025-01-06T17:37:30.135Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2025-01-06T17:37:30.156Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2025-01-06T17:37:31.675Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2025-01-06T17:37:32.159Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2025-01-06T17:37:32.622Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2025-01-06T17:37:33.561Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2025-01-06T17:37:35.419Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2025-01-06T17:37:36.188Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/browsermt-marian-dev'...
[vcs 2025-01-06T17:37:37.724Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/emsdk'...
[vcs 2025-01-06T17:37:38.486Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/ssplit-cpp'...
[vcs 2025-01-06T17:37:39.231Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2025-01-06T17:37:39.246Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2025-01-06T17:37:39.258Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2025-01-06T17:37:39.285Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2025-01-06T17:37:39.388Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2025-01-06T17:37:39.409Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2025-01-06T17:37:39.477Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2025-01-06T17:37:39.497Z] Submodule path 'inference/3rd_party/emsdk': checked out '2346baa7bb44a4a0571cc75f1986ab9aaa35aa03'
[vcs 2025-01-06T17:37:39.515Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2025-01-06T17:37:39.515Z] cleaning git checkout...
[vcs 2025-01-06T17:37:39.515Z] executing ['git', 'clean', '-nxdff']
[vcs 2025-01-06T17:37:39.518Z] removing []
[vcs 2025-01-06T17:37:39.518Z] successfully cleaned git checkout!
[vcs 2025-01-06T17:37:39.520Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/853ef4882f95a1f9985acf33e8b2bb16cbb752c7' title='Built from firefox-translations-training commit 853ef4882f95a1f9985acf33e8b2bb16cbb752c7'>853ef4882f95a1f9985acf33e8b2bb16cbb752c7</a>
[task 2025-01-06T17:37:39.520Z] executing ['bash', '-c', 'task lint-black']
[task 2025-01-06T17:37:39.526Z] task: [poetry-install-*] poetry install --only black --no-root
[task 2025-01-06T17:37:39.889Z] Creating virtualenv firefox-translations-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2025-01-06T17:37:40.250Z] Installing dependencies from lock file
[task 2025-01-06T17:37:40.534Z] 
[task 2025-01-06T17:37:40.534Z] Package operations: 8 installs, 0 updates, 0 removals
[task 2025-01-06T17:37:40.534Z] 
[task 2025-01-06T17:37:40.534Z]   - Installing click (8.1.7)
[task 2025-01-06T17:37:40.535Z]   - Installing mypy-extensions (1.0.0)
[task 2025-01-06T17:37:40.535Z]   - Installing packaging (24.2)
[task 2025-01-06T17:37:40.535Z]   - Installing pathspec (0.12.1)
[task 2025-01-06T17:37:40.536Z]   - Installing platformdirs (4.3.6)
[task 2025-01-06T17:37:40.536Z]   - Installing tomli (2.2.1)
[task 2025-01-06T17:37:40.536Z]   - Installing typing-extensions (4.12.2)
[task 2025-01-06T17:37:40.767Z]   - Installing black (23.12.1)
[task 2025-01-06T17:37:40.940Z] task: [lint-black] ./utils/tasks/black-check.sh
[task 2025-01-06T17:37:40.941Z] poetry run black . --check --diff
[task 2025-01-06T17:37:41.856Z] All done! ✨ 🍰 ✨
[task 2025-01-06T17:37:41.856Z] 114 files would be left unchanged.
[task 2025-01-06T17:37:41.876Z] The python code formatting is correct.
[taskcluster 2025-01-06T17:37:44.451Z]    Exit Code: 0
[taskcluster 2025-01-06T17:37:44.451Z]    User Time: 52.227ms
[taskcluster 2025-01-06T17:37:44.451Z]  Kernel Time: 222.24ms
[taskcluster 2025-01-06T17:37:44.451Z]    Wall Time: 54.830603986s
[taskcluster 2025-01-06T17:37:44.451Z]       Result: SUCCEEDED
[taskcluster 2025-01-06T17:37:44.452Z] === Task Finished ===
[taskcluster 2025-01-06T17:37:44.452Z] Task Duration: 54.830990809s
[taskcluster 2025-01-06T17:37:44.452Z] [mounts] Preserving cache: Moving "/home/task_173618499452161/cache0" to "caches/XbaE8fSTRX-G48kdBi7DKA"
[taskcluster 2025-01-06T17:37:44.488Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2026-01-01T17:34:47.989Z