feat: translations integration tests #210
+1,005
−69
Open
stage-taskcluster / translations-alignments-backtranslated-ru-en
succeeded
Jan 27, 2025 in 1h 15m 24s
Stage-TC (issue_comment)
alignments for teacher's back-translated parallel training corpus ru-en
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2025-01-27T13:18:46.826Z
Resolved: 2025-01-27T13:20:39.288Z
Task Execution Time: 1 minute, 52 seconds, 462 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/build/mono.aln.zst
- public/build/mono.tok-icu.en.zst
- public/build/mono.tok-icu.ru.zst
- public/build/tmp/aln.fwd
- public/build/tmp/aln.fwd.aa
- public/build/tmp/aln.rev
- public/build/tmp/aln.rev.aa
- public/logs/live_backing.log
- public/logs/live.log
[taskcluster 2025-01-27T13:18:46.905Z] Worker Type (translations-1/b-linux-large-gcp-1tb-32-256-d2g) settings:
[taskcluster 2025-01-27T13:18:46.905Z] {
[taskcluster 2025-01-27T13:18:46.905Z] "config": {
[taskcluster 2025-01-27T13:18:46.905Z] "deploymentId": ""
[taskcluster 2025-01-27T13:18:46.905Z] },
[taskcluster 2025-01-27T13:18:46.905Z] "generic-worker": {
[taskcluster 2025-01-27T13:18:46.905Z] "config": {
[taskcluster 2025-01-27T13:18:46.905Z] "headlessTasks": true,
[taskcluster 2025-01-27T13:18:46.905Z] "runTasksAsCurrentUser": false
[taskcluster 2025-01-27T13:18:46.905Z] },
[taskcluster 2025-01-27T13:18:46.905Z] "engine": "multiuser",
[taskcluster 2025-01-27T13:18:46.905Z] "go-arch": "amd64",
[taskcluster 2025-01-27T13:18:46.905Z] "go-os": "linux",
[taskcluster 2025-01-27T13:18:46.905Z] "go-version": "go1.23.4",
[taskcluster 2025-01-27T13:18:46.905Z] "release": "https://github.com/taskcluster/taskcluster/releases/tag/v77.3.1",
[taskcluster 2025-01-27T13:18:46.905Z] "revision": "959a204190add062fe1217d14f2a0115ecd43fe8",
[taskcluster 2025-01-27T13:18:46.905Z] "source": "https://github.com/taskcluster/taskcluster/commits/959a204190add062fe1217d14f2a0115ecd43fe8",
[taskcluster 2025-01-27T13:18:46.905Z] "version": "77.3.1"
[taskcluster 2025-01-27T13:18:46.905Z] },
[taskcluster 2025-01-27T13:18:46.905Z] "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2025-01-17",
...(215 lines hidden)...
attempt 1/5
Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/Zl5j-FwlRDSk6imr0VXpHQ/artifacts/public/build/corpus.priors to /builds/worker/fetches/corpus.priors
attempt 1/5
Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/Zl5j-FwlRDSk6imr0VXpHQ/artifacts/public/build/corpus.priors
attempt 1/5Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/BaMd-QXCQ7iQgqFaazfaiQ/artifacts/public/build/mono.ru.zst to /builds/worker/fetches/mono.ru.zst
attempt 1/5
Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/JclrLl1PQOqEUy1ovetFNw/artifacts/public/build/fast-align.tar.zst to /builds/worker/fetches/fast-align.tar.zst
Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/CqrTW0mwR76VzxmzaSkAsA/artifacts/public/build/mono.en.zst to /builds/worker/fetches/mono.en.zst
Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/BaMd-QXCQ7iQgqFaazfaiQ/artifacts/public/build/mono.ru.zst
Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/CqrTW0mwR76VzxmzaSkAsA/artifacts/public/build/mono.en.zst
Downloading https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/JclrLl1PQOqEUy1ovetFNw/artifacts/public/build/fast-align.tar.zst
https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/CqrTW0mwR76VzxmzaSkAsA/artifacts/public/build/mono.en.zst resolved to 16347 bytes with sha256 52ff99acd1a05e1e1a7463e6e1a4e08c05265943f20a8100c765a0b436013ed3 in 0.177s
Verified size of https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/CqrTW0mwR76VzxmzaSkAsA/artifacts/public/build/mono.en.zst
https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/JclrLl1PQOqEUy1ovetFNw/artifacts/public/build/fast-align.tar.zst resolved to 722724 bytes with sha256 001ad9c2db438d0e7c89273ce5eaae80c0bef1038904d0faf9326145bf34dcf2 in 0.298s
Verified size of https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/JclrLl1PQOqEUy1ovetFNw/artifacts/public/build/fast-align.tar.zst
Extracting /builds/worker/fetches/fast-align.tar.zst to /builds/worker/fetches
/builds/worker/fetches/fast-align.tar.zst extracted in 0.008s
Removing /builds/worker/fetches/fast-align.tar.zst
https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/BaMd-QXCQ7iQgqFaazfaiQ/artifacts/public/build/mono.ru.zst resolved to 3667 bytes with sha256 62542482afbc7a700aa52d944f3c1c39a079d61b412fbb55f2a9454b54194d5b in 0.323s
Verified size of https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/BaMd-QXCQ7iQgqFaazfaiQ/artifacts/public/build/mono.ru.zst
https://stage.taskcluster.nonprod.cloudops.mozgcp.net/api/queue/v1/task/Zl5j-FwlRDSk6imr0VXpHQ/artifacts/public/build/corpus.priors resolved to 288940 bytes with sha256 a26b0a2b69d3e57af5827e5a7b3105f60d6437dcfdbda94bda5494d9f166d8c6 in 0.349s
Extracting /builds/worker/fetches/corpus.priors to /builds/worker/fetches
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.3519654029999941, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2025-01-27T13:19:28.654Z] finished fetching artifacts
[task 2025-01-27T13:19:28.654Z] executing ['bash', '-c', 'pip3 install --upgrade pip setuptools && pip3 install -r $VCS_PATH/pipeline/alignments/requirements/alignments.txt && export BIN=$MOZ_FETCHES_DIR && export PATH=$PATH:$MOZ_FETCHES_DIR && export PYTHONPATH=$PYTHONPATH:$VCS_PATH && python3 $VCS_PATH/pipeline/alignments/align.py --corpus_src=$MOZ_FETCHES_DIR/mono.ru.zst --corpus_trg=$MOZ_FETCHES_DIR/mono.en.zst --output_path=$TASK_WORKDIR/artifacts/mono.aln.zst --output_tokenized --tokenization=icu --priors_input_path=$MOZ_FETCHES_DIR/corpus.priors']
[task 2025-01-27T13:19:28.984Z] WARNING: The directory '/builds/worker/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
[task 2025-01-27T13:19:28.984Z] Defaulting to user installation because normal site-packages is not writeable
[task 2025-01-27T13:19:29.006Z] Requirement already satisfied: pip in /usr/lib/python3/dist-packages (22.0.2)
[task 2025-01-27T13:19:29.158Z] Collecting pip
[task 2025-01-27T13:19:29.229Z] Downloading pip-25.0-py3-none-any.whl (1.8 MB)
[task 2025-01-27T13:19:29.387Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 11.8 MB/s eta 0:00:00
[task 2025-01-27T13:19:29.396Z] Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (59.6.0)
[task 2025-01-27T13:19:29.699Z] Collecting setuptools
[task 2025-01-27T13:19:29.708Z] Downloading setuptools-75.8.0-py3-none-any.whl (1.2 MB)
[task 2025-01-27T13:19:29.759Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 25.0 MB/s eta 0:00:00
[task 2025-01-27T13:19:29.881Z] Installing collected packages: setuptools, pip
[task 2025-01-27T13:19:31.248Z] Successfully installed pip-25.0 setuptools-75.8.0
[task 2025-01-27T13:19:31.605Z] WARNING: The directory '/builds/worker/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
[task 2025-01-27T13:19:31.606Z] Defaulting to user installation because normal site-packages is not writeable
[task 2025-01-27T13:19:31.736Z] Collecting certifi==2024.7.4 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 7))
[task 2025-01-27T13:19:31.768Z] Downloading certifi-2024.7.4-py3-none-any.whl.metadata (2.2 kB)
[task 2025-01-27T13:19:31.854Z] Collecting charset-normalizer==3.3.2 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 9))
[task 2025-01-27T13:19:31.864Z] Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB)
[task 2025-01-27T13:19:32.033Z] Collecting cython==3.0.9 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 11))
[task 2025-01-27T13:19:32.045Z] Downloading Cython-3.0.9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.2 kB)
[task 2025-01-27T13:19:32.115Z] Collecting eflomal==1.0.0b1 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 13))
[task 2025-01-27T13:19:32.126Z] Downloading eflomal-1.0.0b1.tar.gz (102 kB)
[task 2025-01-27T13:19:32.149Z] Installing build dependencies: started
[task 2025-01-27T13:19:36.966Z] Installing build dependencies: finished with status 'done'
[task 2025-01-27T13:19:36.967Z] Getting requirements to build wheel: started
[task 2025-01-27T13:19:38.186Z] Getting requirements to build wheel: finished with status 'done'
[task 2025-01-27T13:19:38.187Z] Preparing metadata (pyproject.toml): started
[task 2025-01-27T13:19:38.716Z] Preparing metadata (pyproject.toml): finished with status 'done'
[task 2025-01-27T13:19:38.732Z] Collecting idna==3.8 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 15))
[task 2025-01-27T13:19:38.743Z] Downloading idna-3.8-py3-none-any.whl.metadata (9.9 kB)
[task 2025-01-27T13:19:38.876Z] Collecting numpy==1.26.4 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 17))
[task 2025-01-27T13:19:38.886Z] Downloading numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
[task 2025-01-27T13:19:38.966Z] Collecting opus-fast-mosestokenizer==0.0.8.5 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 19))
[task 2025-01-27T13:19:38.977Z] Downloading opus_fast_mosestokenizer-0.0.8.5-cp310-cp310-manylinux1_x86_64.whl.metadata (3.6 kB)
[task 2025-01-27T13:19:38.990Z] Collecting pyicu==2.8.1 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 21))
[task 2025-01-27T13:19:39.001Z] Downloading PyICU-2.8.1.tar.gz (304 kB)
[task 2025-01-27T13:19:39.055Z] Installing build dependencies: started
[task 2025-01-27T13:19:40.685Z] Installing build dependencies: finished with status 'done'
[task 2025-01-27T13:19:40.686Z] Getting requirements to build wheel: started
[task 2025-01-27T13:19:40.859Z] Getting requirements to build wheel: finished with status 'done'
[task 2025-01-27T13:19:40.860Z] Preparing metadata (pyproject.toml): started
[task 2025-01-27T13:19:41.033Z] Preparing metadata (pyproject.toml): finished with status 'done'
[task 2025-01-27T13:19:41.062Z] Collecting requests==2.31.0 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 23))
[task 2025-01-27T13:19:41.072Z] Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
[task 2025-01-27T13:19:41.104Z] Collecting tqdm==4.66.4 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 25))
[task 2025-01-27T13:19:41.114Z] Downloading tqdm-4.66.4-py3-none-any.whl.metadata (57 kB)
[task 2025-01-27T13:19:41.157Z] Collecting urllib3==2.2.2 (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 27))
[task 2025-01-27T13:19:41.167Z] Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB)
[task 2025-01-27T13:19:41.169Z] Requirement already satisfied: zstandard==0.23.0 in /usr/local/lib/python3.10/dist-packages (from -r /builds/worker/checkouts/vcs/pipeline/alignments/requirements/alignments.txt (line 29)) (0.23.0)
[task 2025-01-27T13:19:41.195Z] WARNING: The candidate selected for download or install is a yanked version: 'eflomal' candidate (version 1.0.0b1 at https://files.pythonhosted.org/packages/1d/cc/2cdf9c90a6bd8fd7323b47bf5a60fe738bfe8465844a2136b0543f5094e8/eflomal-1.0.0b1.tar.gz (from https://pypi.org/simple/eflomal/))
[task 2025-01-27T13:19:41.195Z] Reason for being yanked: <none given>
[task 2025-01-27T13:19:41.205Z] Downloading certifi-2024.7.4-py3-none-any.whl (162 kB)
[task 2025-01-27T13:19:41.216Z] Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
[task 2025-01-27T13:19:41.227Z] Downloading Cython-3.0.9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB)
[task 2025-01-27T13:19:41.253Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.6/3.6 MB 144.2 MB/s eta 0:00:00
[task 2025-01-27T13:19:41.263Z] Downloading idna-3.8-py3-none-any.whl (66 kB)
[task 2025-01-27T13:19:41.273Z] Downloading numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
[task 2025-01-27T13:19:41.310Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.2/18.2 MB 516.8 MB/s eta 0:00:00
[task 2025-01-27T13:19:41.322Z] Downloading opus_fast_mosestokenizer-0.0.8.5-cp310-cp310-manylinux1_x86_64.whl (837 kB)
[task 2025-01-27T13:19:41.326Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 837.2/837.2 kB 504.0 MB/s eta 0:00:00
[task 2025-01-27T13:19:41.336Z] Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[task 2025-01-27T13:19:41.346Z] Downloading tqdm-4.66.4-py3-none-any.whl (78 kB)
[task 2025-01-27T13:19:41.356Z] Downloading urllib3-2.2.2-py3-none-any.whl (121 kB)
[task 2025-01-27T13:19:41.432Z] Building wheels for collected packages: eflomal, pyicu
[task 2025-01-27T13:19:41.433Z] Building wheel for eflomal (pyproject.toml): started
[task 2025-01-27T13:19:46.246Z] Building wheel for eflomal (pyproject.toml): finished with status 'done'
[task 2025-01-27T13:19:46.248Z] Created wheel for eflomal: filename=eflomal-1.0.0b1-cp310-cp310-linux_x86_64.whl size=319817 sha256=1719d5dcd860e65b241aae91f1eb9c0e5b4672360f536f337c4c6667956f7253
[task 2025-01-27T13:19:46.248Z] Stored in directory: /tmp/pip-ephem-wheel-cache-fz3kf0t3/wheels/b4/0c/55/4a2c6f00793a0d2fdaef4376b8cb3d9c6ae8df16366d6e31d1
[task 2025-01-27T13:19:46.251Z] Building wheel for pyicu (pyproject.toml): started
[task 2025-01-27T13:20:33.175Z] Building wheel for pyicu (pyproject.toml): finished with status 'done'
[task 2025-01-27T13:20:33.180Z] Created wheel for pyicu: filename=PyICU-2.8.1-cp310-cp310-linux_x86_64.whl size=1747818 sha256=d0379e405288eb994ffb2ad6fe842041fa8ede988d48344743852459c344b895
[task 2025-01-27T13:20:33.180Z] Stored in directory: /tmp/pip-ephem-wheel-cache-fz3kf0t3/wheels/6e/cb/d3/5d1dfd3a9e12d51f0a2bfb951374205f7eca2639a21b03ea12
[task 2025-01-27T13:20:33.183Z] Successfully built eflomal pyicu
[task 2025-01-27T13:20:33.221Z] Installing collected packages: pyicu, urllib3, tqdm, opus-fast-mosestokenizer, numpy, idna, cython, charset-normalizer, certifi, requests, eflomal
[task 2025-01-27T13:20:35.880Z] Successfully installed certifi-2024.7.4 charset-normalizer-3.3.2 cython-3.0.9 eflomal-1.0.0b1 idna-3.8 numpy-1.26.4 opus-fast-mosestokenizer-0.0.8.5 pyicu-2.8.1 requests-2.31.0 tqdm-4.66.4 urllib3-2.2.2
[task 2025-01-27T13:20:36.243Z] [alignments] Running with arguments: ['/builds/worker/checkouts/vcs/pipeline/alignments/align.py', '--corpus_src=/builds/worker/fetches/mono.ru.zst', '--corpus_trg=/builds/worker/fetches/mono.en.zst', '--output_path=/builds/worker/artifacts/mono.aln.zst', '--output_tokenized', '--tokenization=icu', '--priors_input_path=/builds/worker/fetches/corpus.priors']
[task 2025-01-27T13:20:36.245Z] [alignments] Starting generating alignments.
[task 2025-01-27T13:20:36.245Z] [alignments] [decompress] From: /builds/worker/fetches/mono.ru.zst
[task 2025-01-27T13:20:36.245Z] [alignments] [decompress] To: /builds/worker/fetches/mono.ru
[task 2025-01-27T13:20:36.247Z]
[task 2025-01-27T13:20:36.247Z] /fetches/mono.ru.zst : 0 MB...
[task 2025-01-27T13:20:36.247Z]
[task 2025-01-27T13:20:36.247Z] /builds/worker/fetches/mono.ru.zst: 162803 bytes
[task 2025-01-27T13:20:36.248Z] [alignments] [decompress] Removed: /builds/worker/fetches/mono.ru.zst
[task 2025-01-27T13:20:36.248Z] [alignments] [decompress] From: /builds/worker/fetches/mono.en.zst
[task 2025-01-27T13:20:36.248Z] [alignments] [decompress] To: /builds/worker/fetches/mono.en
[task 2025-01-27T13:20:36.249Z]
[task 2025-01-27T13:20:36.249Z] /fetches/mono.en.zst : 0 MB...
[task 2025-01-27T13:20:36.249Z]
[task 2025-01-27T13:20:36.249Z] /builds/worker/fetches/mono.en.zst: 38227 bytes
[task 2025-01-27T13:20:36.250Z] [alignments] [decompress] Removed: /builds/worker/fetches/mono.en.zst
[task 2025-01-27T13:20:36.250Z] [tokenizer] Tokenizing /builds/worker/fetches/mono.ru with Moses tokenizer
[task 2025-01-27T13:20:36.287Z]
[task 2025-01-27T13:20:36.314Z] 0it [00:00, ?it/s]
[task 2025-01-27T13:20:36.314Z] 493it [00:00, 18296.29it/s]
[task 2025-01-27T13:20:36.314Z] [tokenizer] Tokenizing /builds/worker/fetches/mono.en with Moses tokenizer
[task 2025-01-27T13:20:36.352Z]
[task 2025-01-27T13:20:36.379Z] 0it [00:00, ?it/s]
[task 2025-01-27T13:20:36.379Z] 493it [00:00, 18086.65it/s]
[task 2025-01-27T13:20:36.489Z] [alignments] Splitting corpus into parts
[task 2025-01-27T13:20:36.492Z] [alignments] Processing part aa
[task 2025-01-27T13:20:36.492Z] [alignments] Using provided priors: /builds/worker/fetches/corpus.priors
[task 2025-01-27T13:20:36.492Z] [alignments] Calculating alignments...
[task 2025-01-27T13:20:36.501Z] [eflomal] Prepared 493 sentences for alignment
[task 2025-01-27T13:20:36.501Z] [eflomal] Reading lexical priors...
[task 2025-01-27T13:20:36.520Z] [eflomal] 51 (of 5405) pairs of lexical priors used
[task 2025-01-27T13:20:36.522Z] /builds/worker/.local/lib/python3.10/site-packages/eflomal/bin/eflomal -m 3 -s /tmp/tmpicrbqs3n -t /tmp/tmpct3t3g5j -n 3 -N 0.2 -1 56 -2 56 -3 225 -f /builds/worker/artifacts/tmp/aln.fwd.aa -r /builds/worker/artifacts/tmp/aln.rev.aa -p /tmp/tmp7ovsceab
[task 2025-01-27T13:20:36.525Z] Read texts (493 sentences): 0.002 s
[task 2025-01-27T13:20:36.525Z] Vocabulary sizes are 229 (source), 2242 (target)
[task 2025-01-27T13:20:36.528Z] Created alignment structures: 0.001 s
[task 2025-01-27T13:20:36.531Z] Created alignment structures: 0.004 s
[task 2025-01-27T13:20:36.532Z] Randomized alignment: 0.004 s
[task 2025-01-27T13:20:36.532Z] Aligning with model 1 (56 iterations)
[task 2025-01-27T13:20:36.533Z] Randomized alignment: 0.003 s
[task 2025-01-27T13:20:36.533Z] Aligning with model 1 (56 iterations)
[task 2025-01-27T13:20:36.650Z] Done: 0.116 s
[task 2025-01-27T13:20:36.650Z] Aligning with model 2 (56 iterations)
[task 2025-01-27T13:20:36.655Z] Done: 0.124 s
[task 2025-01-27T13:20:36.655Z] Aligning with model 2 (56 iterations)
[task 2025-01-27T13:20:36.784Z] Done: 0.135 s
[task 2025-01-27T13:20:36.784Z] Aligning with model 3 (225 iterations)
[task 2025-01-27T13:20:36.809Z] Done: 0.154 s
[task 2025-01-27T13:20:36.809Z] Aligning with model 3 (225 iterations)
[task 2025-01-27T13:20:37.520Z] Done: 0.711 s
[task 2025-01-27T13:20:37.532Z] Final argmax iteration: 0.012 s
[task 2025-01-27T13:20:37.532Z] Writing alignments to /builds/worker/artifacts/tmp/aln.fwd.aa for 493 sentencess
[task 2025-01-27T13:20:37.696Z] Done: 0.911 s
[task 2025-01-27T13:20:37.707Z] Final argmax iteration: 0.011 s
[task 2025-01-27T13:20:37.707Z] Writing alignments to /builds/worker/artifacts/tmp/aln.rev.aa for 493 sentencess
[task 2025-01-27T13:20:37.710Z] [alignments] Merging alignments: ['/builds/worker/artifacts/tmp/aln.fwd.aa']
[task 2025-01-27T13:20:37.711Z] [alignments] Merging alignments: ['/builds/worker/artifacts/tmp/aln.rev.aa']
[task 2025-01-27T13:20:37.712Z] [alignments] Symmetrizing alignments...
[task 2025-01-27T13:20:37.723Z] [alignments] Saving tokenized corpus
[task 2025-01-27T13:20:37.725Z]
[task 2025-01-27T13:20:37.725Z]
[task 2025-01-27T13:20:37.726Z] Read : 0 / 0 MB ==> 2%
[task 2025-01-27T13:20:37.726Z]
[task 2025-01-27T13:20:37.726Z] /builds/worker/artifacts/mono.tok-icu.ru : 2.16% (185038 => 3995 bytes, /builds/worker/artifacts/mono.tok-icu.ru.zst)
[task 2025-01-27T13:20:37.728Z]
[task 2025-01-27T13:20:37.728Z]
[task 2025-01-27T13:20:37.728Z] Read : 0 / 0 MB ==> 31%
[task 2025-01-27T13:20:37.728Z]
[task 2025-01-27T13:20:37.728Z] /builds/worker/artifacts/mono.tok-icu.en : 30.71% ( 61801 => 18980 bytes, /builds/worker/artifacts/mono.tok-icu.en.zst)
[task 2025-01-27T13:20:37.728Z] [alignments] Compressing final alignments
[task 2025-01-27T13:20:37.730Z]
[task 2025-01-27T13:20:37.730Z]
[task 2025-01-27T13:20:37.730Z] Read : 0 / 0 MB ==> 33%
[task 2025-01-27T13:20:37.730Z]
[task 2025-01-27T13:20:37.730Z] /builds/worker/artifacts/tmp/aln : 33.04% ( 17111 => 5653 bytes, /builds/worker/artifacts/tmp/aln.zst)
[task 2025-01-27T13:20:37.731Z] [alignments] Finished generating alignments.
[fetches 2025-01-27T13:20:37.752Z] removing /builds/worker/fetches
[fetches 2025-01-27T13:20:37.753Z] finished
+ exit_code=0
+ docker cp taskcontainer_eUx-fD-vQFWjv6MEuWafcw:/builds/worker/artifacts artifact0
+ docker rm taskcontainer_eUx-fD-vQFWjv6MEuWafcw
taskcontainer_eUx-fD-vQFWjv6MEuWafcw
+ exit 0
[taskcluster 2025-01-27T13:20:38.656Z] Exit Code: 0
[taskcluster 2025-01-27T13:20:38.656Z] User Time: 105.165ms
[taskcluster 2025-01-27T13:20:38.656Z] Kernel Time: 342.133ms
[taskcluster 2025-01-27T13:20:38.656Z] Wall Time: 1m46.932972166s
[taskcluster 2025-01-27T13:20:38.656Z] Result: SUCCEEDED
[taskcluster 2025-01-27T13:20:38.656Z] === Task Finished ===
[taskcluster 2025-01-27T13:20:38.656Z] Task Duration: 1m46.933615354s
[taskcluster 2025-01-27T13:20:38.947Z] Uploading artifact public/build/tmp/aln.rev.aa from file /home/task_173798392348840/artifact0/tmp/aln.rev.aa with content encoding "gzip", mime type "audio/x-pn-audibleaudio" and expiry 2025-02-26T12:05:14.382Z
[taskcluster 2025-01-27T13:20:38.968Z] Uploading artifact public/build/tmp/aln.rev from file /home/task_173798392348840/artifact0/tmp/aln.rev with content encoding "gzip", mime type "application/octet-stream" and expiry 2025-02-26T12:05:14.382Z
[taskcluster 2025-01-27T13:20:38.977Z] Uploading artifact public/build/tmp/aln.fwd.aa from file /home/task_173798392348840/artifact0/tmp/aln.fwd.aa with content encoding "gzip", mime type "audio/x-pn-audibleaudio" and expiry 2025-02-26T12:05:14.382Z
[taskcluster 2025-01-27T13:20:38.995Z] Uploading artifact public/build/mono.aln.zst from file /home/task_173798392348840/artifact0/mono.aln.zst with content encoding "identity", mime type "application/zstd" and expiry 2025-02-26T12:05:14.382Z
[taskcluster 2025-01-27T13:20:39.004Z] Uploading artifact public/build/tmp/aln.fwd from file /home/task_173798392348840/artifact0/tmp/aln.fwd with content encoding "gzip", mime type "application/octet-stream" and expiry 2025-02-26T12:05:14.382Z
[taskcluster 2025-01-27T13:20:39.017Z] Uploading artifact public/build/mono.tok-icu.en.zst from file /home/task_173798392348840/artifact0/mono.tok-icu.en.zst with content encoding "identity", mime type "application/zstd" and expiry 2025-02-26T12:05:14.382Z
[taskcluster 2025-01-27T13:20:39.029Z] Uploading artifact public/build/mono.tok-icu.ru.zst from file /home/task_173798392348840/artifact0/mono.tok-icu.ru.zst with content encoding "identity", mime type "application/zstd" and expiry 2025-02-26T12:05:14.382Z
[taskcluster 2025-01-27T13:20:39.095Z] [mounts] Preserving cache: Moving "/home/task_173798392348840/cache0" to "caches/dBwOZ1vDQGmVBxywd2RfDQ"
[taskcluster 2025-01-27T13:20:39.190Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-02-26T12:05:14.382Z
Loading