feat: translations integration tests #210
Stage-TC (issue_comment)
train teacher for ru-en 1
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2025-01-29T17:18:55.752Z
Resolved: 2025-01-29T17:32:32.620Z
Task Execution Time: 13 minutes, 36 seconds, 868 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/build/config.opustrainer.yml
- public/build/config.opustrainer.yml.state
- public/build/devset.out
- public/build/final.model.npz.best-chrf.npz
- public/build/final.model.npz.best-chrf.npz.decoder.yml
- public/build/model.npz
- public/build/model.npz.best-bleu-detok.npz
- public/build/model.npz.best-bleu-detok.npz.decoder.yml
- public/build/model.npz.best-ce-mean-words.npz
- public/build/model.npz.best-ce-mean-words.npz.decoder.yml
- public/build/model.npz.best-chrf.npz
- public/build/model.npz.best-chrf.npz.decoder.yml
- public/build/model.npz.decoder.yml
- public/build/model.npz.optimizer.npz
- public/build/model.npz.progress.yml
- public/build/model.npz.yml
- public/build/opustrainer.log
- public/build/train.log
- public/build/valid.log
- public/build/vocab.spm
- public/logs/live_backing.log
- public/logs/live.log
[taskcluster 2025-01-29T17:18:55.843Z] Worker Type (translations-1/b-linux-v100-gpu-4) settings:
[taskcluster 2025-01-29T17:18:55.843Z] {
[taskcluster 2025-01-29T17:18:55.843Z] "config": {
[taskcluster 2025-01-29T17:18:55.843Z] "deploymentId": ""
[taskcluster 2025-01-29T17:18:55.843Z] },
[taskcluster 2025-01-29T17:18:55.843Z] "generic-worker": {
[taskcluster 2025-01-29T17:18:55.843Z] "engine": "insecure",
[taskcluster 2025-01-29T17:18:55.843Z] "go-arch": "amd64",
[taskcluster 2025-01-29T17:18:55.843Z] "go-os": "linux",
[taskcluster 2025-01-29T17:18:55.843Z] "go-version": "go1.22.2",
[taskcluster 2025-01-29T17:18:55.843Z] "release": "https://github.com/taskcluster/taskcluster/releases/tag/v64.2.6",
[taskcluster 2025-01-29T17:18:55.843Z] "revision": "edab196d7d030a5d625b77335109cd9060ab7e1f",
[taskcluster 2025-01-29T17:18:55.843Z] "source": "https://github.com/taskcluster/taskcluster/commits/edab196d7d030a5d625b77335109cd9060ab7e1f",
[taskcluster 2025-01-29T17:18:55.843Z] "version": "64.2.6"
[taskcluster 2025-01-29T17:18:55.843Z] },
[taskcluster 2025-01-29T17:18:55.843Z] "image": "projects/taskcluster-imaging/global/images/gw-translations-gcp-googlecompute-2024-04-22t18-22-42z",
[taskcluster 2025-01-29T17:18:55.843Z] "instance-id": "672897206591151215",
[taskcluster 2025-01-29T17:18:55.843Z] "instance-type": "projects/474530013412/machineTypes/n1-highmem-8",
[taskcluster 2025-01-29T17:18:55.843Z] "local-ipv4": "10.138.0.25",
[taskcluster 2025-01-29T17:18:55.843Z] "project-id": "fxci-staging-level1-workers",
...(2849 lines hidden)...
[task 2025-01-29T17:31:26.921Z] [2025-01-29 17:31:26] [Trainer] [INFO] Reading original for epoch 1837
[task 2025-01-29T17:31:27.202Z] [2025-01-29 17:31:27] [Trainer] [INFO] Reading original for epoch 1838
[task 2025-01-29T17:31:27.490Z] [2025-01-29 17:31:27] [Trainer] [INFO] Reading original for epoch 1839
[task 2025-01-29T17:31:27.761Z] [2025-01-29 17:31:27] [Trainer] [INFO] Reading original for epoch 1840
[task 2025-01-29T17:31:28.037Z] [2025-01-29 17:31:28] [Trainer] [INFO] Reading original for epoch 1841
[task 2025-01-29T17:31:28.314Z] [2025-01-29 17:31:28] [Trainer] [INFO] Reading original for epoch 1842
[task 2025-01-29T17:31:28.592Z] [2025-01-29 17:31:28] [Trainer] [INFO] Reading original for epoch 1843
[task 2025-01-29T17:31:28.857Z] [2025-01-29 17:31:28] [Trainer] [INFO] Reading original for epoch 1844
[task 2025-01-29T17:31:29.129Z] [2025-01-29 17:31:29] [Trainer] [INFO] Reading original for epoch 1845
[task 2025-01-29T17:31:29.401Z] [2025-01-29 17:31:29] [Trainer] [INFO] Reading original for epoch 1846
[task 2025-01-29T17:31:29.670Z] [2025-01-29 17:31:29] [Trainer] [INFO] Reading original for epoch 1847
[task 2025-01-29T17:31:29.940Z] [2025-01-29 17:31:29] [Trainer] [INFO] Reading original for epoch 1848
[task 2025-01-29T17:31:30.238Z] [2025-01-29 17:31:30] [Trainer] [INFO] Reading original for epoch 1849
[task 2025-01-29T17:31:30.516Z] [2025-01-29 17:31:30] [Trainer] [INFO] Reading original for epoch 1850
[task 2025-01-29T17:31:30.796Z] [2025-01-29 17:31:30] [Trainer] [INFO] Reading original for epoch 1851
[task 2025-01-29T17:31:31.093Z] [2025-01-29 17:31:31] [Trainer] [INFO] Reading original for epoch 1852
[task 2025-01-29T17:31:31.386Z] [2025-01-29 17:31:31] [Trainer] [INFO] Reading original for epoch 1853
[task 2025-01-29T17:31:31.665Z] [2025-01-29 17:31:31] [Trainer] [INFO] Reading original for epoch 1854
[task 2025-01-29T17:31:31.943Z] [2025-01-29 17:31:31] [Trainer] [INFO] Reading original for epoch 1855
[task 2025-01-29T17:31:32.222Z] [2025-01-29 17:31:32] [Trainer] [INFO] Reading original for epoch 1856
[task 2025-01-29T17:31:32.504Z] [2025-01-29 17:31:32] [Trainer] [INFO] Reading original for epoch 1857
[task 2025-01-29T17:31:32.780Z] [2025-01-29 17:31:32] [Trainer] [INFO] Reading original for epoch 1858
[task 2025-01-29T17:31:33.086Z] [2025-01-29 17:31:33] [Trainer] [INFO] Reading original for epoch 1859
[task 2025-01-29T17:31:33.379Z] [2025-01-29 17:31:33] [Trainer] [INFO] Reading original for epoch 1860
[task 2025-01-29T17:31:33.650Z] [2025-01-29 17:31:33] [Trainer] [INFO] Reading original for epoch 1861
[task 2025-01-29T17:31:33.922Z] [2025-01-29 17:31:33] [Trainer] [INFO] Reading original for epoch 1862
[task 2025-01-29T17:31:34.193Z] [2025-01-29 17:31:34] [Trainer] [INFO] Reading original for epoch 1863
[task 2025-01-29T17:31:34.462Z] [2025-01-29 17:31:34] [Trainer] [INFO] Reading original for epoch 1864
[task 2025-01-29T17:31:34.737Z] [2025-01-29 17:31:34] [Trainer] [INFO] Reading original for epoch 1865
[task 2025-01-29T17:31:35.019Z] [2025-01-29 17:31:35] [Trainer] [INFO] Reading original for epoch 1866
[task 2025-01-29T17:31:35.293Z] [2025-01-29 17:31:35] [Trainer] [INFO] Reading original for epoch 1867
[task 2025-01-29T17:31:35.564Z] [2025-01-29 17:31:35] [Trainer] [INFO] Reading original for epoch 1868
[task 2025-01-29T17:31:35.842Z] [2025-01-29 17:31:35] [Trainer] [INFO] Reading original for epoch 1869
[task 2025-01-29T17:31:36.123Z] [2025-01-29 17:31:36] [Trainer] [INFO] Reading original for epoch 1870
[task 2025-01-29T17:31:36.392Z] [2025-01-29 17:31:36] [Trainer] [INFO] Reading original for epoch 1871
[task 2025-01-29T17:31:36.664Z] [2025-01-29 17:31:36] [Trainer] [INFO] Reading original for epoch 1872
[task 2025-01-29T17:31:36.948Z] [2025-01-29 17:31:36] [Trainer] [INFO] Reading original for epoch 1873
[task 2025-01-29T17:31:37.210Z] [2025-01-29 17:31:37] [Trainer] [INFO] Reading original for epoch 1874
[task 2025-01-29T17:31:37.492Z] [2025-01-29 17:31:37] [Trainer] [INFO] Reading original for epoch 1875
[task 2025-01-29T17:31:37.763Z] [2025-01-29 17:31:37] [Trainer] [INFO] Reading original for epoch 1876
[task 2025-01-29T17:31:38.038Z] [2025-01-29 17:31:38] [Trainer] [INFO] Reading original for epoch 1877
[task 2025-01-29T17:31:38.312Z] [2025-01-29 17:31:38] [Trainer] [INFO] Reading original for epoch 1878
[task 2025-01-29T17:31:38.606Z] [2025-01-29 17:31:38] [Trainer] [INFO] Reading original for epoch 1879
[task 2025-01-29T17:31:38.874Z] [2025-01-29 17:31:38] [Trainer] [INFO] Reading original for epoch 1880
[task 2025-01-29T17:31:39.139Z] [2025-01-29 17:31:39] [Trainer] [INFO] Reading original for epoch 1881
[task 2025-01-29T17:31:39.428Z] [2025-01-29 17:31:39] [Trainer] [INFO] Reading original for epoch 1882
[task 2025-01-29T17:31:39.703Z] [2025-01-29 17:31:39] [Trainer] [INFO] Reading original for epoch 1883
[task 2025-01-29T17:31:39.988Z] [2025-01-29 17:31:39] [Trainer] [INFO] Reading original for epoch 1884
[task 2025-01-29T17:31:40.274Z] [2025-01-29 17:31:40] [Trainer] [INFO] Reading original for epoch 1885
[task 2025-01-29T17:31:40.559Z] [2025-01-29 17:31:40] [Trainer] [INFO] Reading original for epoch 1886
[task 2025-01-29T17:31:40.854Z] [2025-01-29 17:31:40] [Trainer] [INFO] Reading original for epoch 1887
[task 2025-01-29T17:31:41.132Z] [2025-01-29 17:31:41] [Trainer] [INFO] Reading original for epoch 1888
[task 2025-01-29T17:31:41.419Z] [2025-01-29 17:31:41] [Trainer] [INFO] Reading original for epoch 1889
[task 2025-01-29T17:31:41.695Z] [2025-01-29 17:31:41] [Trainer] [INFO] Reading original for epoch 1890
[task 2025-01-29T17:31:41.979Z] [2025-01-29 17:31:41] [Trainer] [INFO] Reading original for epoch 1891
[task 2025-01-29T17:31:42.268Z] [2025-01-29 17:31:42] [Trainer] [INFO] Reading original for epoch 1892
[task 2025-01-29T17:31:42.318Z] [2025-01-29 17:31:42] [Trainer] [WARNING] Skipping line because of exception: ValueError('Out-of-bound alignment pairs')
[task 2025-01-29T17:31:42.322Z] [2025-01-29 17:31:42] [Trainer] [WARNING] Skipping line because of exception: ValueError('Out-of-bound alignment pairs')
[task 2025-01-29T17:31:42.546Z] [2025-01-29 17:31:42] [Trainer] [INFO] Reading original for epoch 1893
[task 2025-01-29T17:31:42.816Z] [2025-01-29 17:31:42] [Trainer] [INFO] Reading original for epoch 1894
[task 2025-01-29T17:31:43.110Z] [2025-01-29 17:31:43] [Trainer] [INFO] Reading original for epoch 1895
[task 2025-01-29T17:31:43.371Z] [2025-01-29 17:31:43] [Trainer] [INFO] Reading original for epoch 1896
[task 2025-01-29T17:31:43.661Z] [2025-01-29 17:31:43] [Trainer] [INFO] Reading original for epoch 1897
[task 2025-01-29T17:31:43.920Z] [2025-01-29 17:31:43] [Trainer] [INFO] Reading original for epoch 1898
[task 2025-01-29T17:31:44.200Z] [2025-01-29 17:31:44] [Trainer] [INFO] Reading original for epoch 1899
[task 2025-01-29T17:31:44.488Z] [2025-01-29 17:31:44] [Trainer] [INFO] Reading original for epoch 1900
[task 2025-01-29T17:31:44.756Z] [2025-01-29 17:31:44] [Trainer] [INFO] Reading original for epoch 1901
[task 2025-01-29T17:31:45.038Z] [2025-01-29 17:31:45] [Trainer] [INFO] Reading original for epoch 1902
[task 2025-01-29T17:31:45.307Z] [2025-01-29 17:31:45] [Trainer] [INFO] Reading original for epoch 1903
[task 2025-01-29T17:31:45.593Z] [2025-01-29 17:31:45] [Trainer] [INFO] Reading original for epoch 1904
[task 2025-01-29T17:31:45.865Z] [2025-01-29 17:31:45] [Trainer] [INFO] Reading original for epoch 1905
[task 2025-01-29T17:31:46.125Z] [2025-01-29 17:31:46] [Trainer] [INFO] Reading original for epoch 1906
[task 2025-01-29T17:31:46.388Z] [2025-01-29 17:31:46] [Trainer] [INFO] Reading original for epoch 1907
[task 2025-01-29T17:31:46.682Z] [2025-01-29 17:31:46] [Trainer] [INFO] Reading original for epoch 1908
[task 2025-01-29T17:31:46.985Z] [2025-01-29 17:31:46] [Trainer] [INFO] Reading original for epoch 1909
[task 2025-01-29T17:31:47.258Z] [2025-01-29 17:31:47] [Trainer] [INFO] Reading original for epoch 1910
[task 2025-01-29T17:31:47.540Z] [2025-01-29 17:31:47] [Trainer] [INFO] Reading original for epoch 1911
[task 2025-01-29T17:31:47.816Z] [2025-01-29 17:31:47] [Trainer] [INFO] Reading original for epoch 1912
[task 2025-01-29T17:31:48.118Z] [2025-01-29 17:31:48] [Trainer] [INFO] Reading original for epoch 1913
[task 2025-01-29T17:31:48.388Z] [2025-01-29 17:31:48] [Trainer] [INFO] Reading original for epoch 1914
[task 2025-01-29T17:31:48.672Z] [2025-01-29 17:31:48] [Trainer] [INFO] Reading original for epoch 1915
[task 2025-01-29T17:31:48.940Z] [2025-01-29 17:31:48] [Trainer] [INFO] Reading original for epoch 1916
[task 2025-01-29T17:31:49.222Z] [2025-01-29 17:31:49] [Trainer] [INFO] Reading original for epoch 1917
[task 2025-01-29T17:31:49.498Z] [2025-01-29 17:31:49] [Trainer] [INFO] Reading original for epoch 1918
[task 2025-01-29T17:31:49.765Z] [2025-01-29 17:31:49] [Trainer] [INFO] Reading original for epoch 1919
[task 2025-01-29T17:31:50.043Z] [2025-01-29 17:31:50] [Trainer] [INFO] Reading original for epoch 1920
[task 2025-01-29T17:31:50.312Z] [2025-01-29 17:31:50] [Trainer] [INFO] Reading original for epoch 1921
[task 2025-01-29T17:31:50.596Z] [2025-01-29 17:31:50] [Trainer] [INFO] Reading original for epoch 1922
[task 2025-01-29T17:31:50.884Z] [2025-01-29 17:31:50] [Trainer] [INFO] Reading original for epoch 1923
[task 2025-01-29T17:31:51.178Z] [2025-01-29 17:31:51] [Trainer] [INFO] Reading original for epoch 1924
[task 2025-01-29T17:31:51.463Z] [2025-01-29 17:31:51] [Trainer] [INFO] Reading original for epoch 1925
[task 2025-01-29T17:31:51.745Z] [2025-01-29 17:31:51] [Trainer] [INFO] Reading original for epoch 1926
[task 2025-01-29T17:31:52.016Z] [2025-01-29 17:31:52] [Trainer] [INFO] Reading original for epoch 1927
[task 2025-01-29T17:31:52.288Z] [2025-01-29 17:31:52] [Trainer] [INFO] Reading original for epoch 1928
[task 2025-01-29T17:31:52.568Z] [2025-01-29 17:31:52] [Trainer] [INFO] Reading original for epoch 1929
[task 2025-01-29T17:31:52.854Z] [2025-01-29 17:31:52] [Trainer] [INFO] Reading original for epoch 1930
[task 2025-01-29T17:31:53.144Z] [2025-01-29 17:31:53] [Trainer] [INFO] Reading original for epoch 1931
[task 2025-01-29T17:31:53.437Z] [2025-01-29 17:31:53] [Trainer] [INFO] Reading original for epoch 1932
[task 2025-01-29T17:31:53.751Z] [2025-01-29 17:31:53] [Trainer] [INFO] Reading original for epoch 1933
[task 2025-01-29T17:31:54.041Z] [2025-01-29 17:31:54] [Trainer] [INFO] Reading original for epoch 1934
[task 2025-01-29T17:31:54.335Z] [2025-01-29 17:31:54] [Trainer] [INFO] Reading original for epoch 1935
[task 2025-01-29T17:31:54.627Z] [2025-01-29 17:31:54] [Trainer] [INFO] Reading original for epoch 1936
[task 2025-01-29T17:31:54.901Z] [2025-01-29 17:31:54] [Trainer] [INFO] Reading original for epoch 1937
[task 2025-01-29T17:31:55.195Z] [2025-01-29 17:31:55] [Trainer] [INFO] Reading original for epoch 1938
[task 2025-01-29T17:31:55.482Z] [2025-01-29 17:31:55] [Trainer] [INFO] Reading original for epoch 1939
[task 2025-01-29T17:31:55.760Z] [2025-01-29 17:31:55] [Trainer] [INFO] Reading original for epoch 1940
[task 2025-01-29T17:31:56.037Z] [2025-01-29 17:31:56] [Trainer] [INFO] Reading original for epoch 1941
[task 2025-01-29T17:31:56.299Z] [2025-01-29 17:31:56] [Trainer] [INFO] Reading original for epoch 1942
[task 2025-01-29T17:31:56.578Z] [2025-01-29 17:31:56] [Trainer] [INFO] Reading original for epoch 1943
[task 2025-01-29T17:31:56.853Z] [2025-01-29 17:31:56] [Trainer] [INFO] Reading original for epoch 1944
[task 2025-01-29T17:31:57.150Z] [2025-01-29 17:31:57] [Trainer] [INFO] Reading original for epoch 1945
[task 2025-01-29T17:31:57.436Z] [2025-01-29 17:31:57] [Trainer] [INFO] Reading original for epoch 1946
[task 2025-01-29T17:31:57.715Z] [2025-01-29 17:31:57] [Trainer] [INFO] Reading original for epoch 1947
[task 2025-01-29T17:31:57.985Z] [2025-01-29 17:31:57] [Trainer] [INFO] Reading original for epoch 1948
[task 2025-01-29T17:31:58.275Z] [2025-01-29 17:31:58] [Trainer] [INFO] Reading original for epoch 1949
[task 2025-01-29T17:31:58.553Z] [2025-01-29 17:31:58] [Trainer] [INFO] Reading original for epoch 1950
[task 2025-01-29T17:31:58.863Z] [2025-01-29 17:31:58] [Trainer] [INFO] Reading original for epoch 1951
[task 2025-01-29T17:31:59.146Z] [2025-01-29 17:31:59] [Trainer] [INFO] Reading original for epoch 1952
[task 2025-01-29T17:31:59.430Z] [2025-01-29 17:31:59] [Trainer] [INFO] Reading original for epoch 1953
[task 2025-01-29T17:31:59.712Z] [2025-01-29 17:31:59] [Trainer] [INFO] Reading original for epoch 1954
[task 2025-01-29T17:31:59.981Z] [2025-01-29 17:31:59] [Trainer] [INFO] Reading original for epoch 1955
[task 2025-01-29T17:32:00.289Z] [2025-01-29 17:32:00] [Trainer] [INFO] Reading original for epoch 1956
[task 2025-01-29T17:32:00.576Z] [2025-01-29 17:32:00] [Trainer] [INFO] Reading original for epoch 1957
[task 2025-01-29T17:32:00.865Z] [2025-01-29 17:32:00] [Trainer] [INFO] Reading original for epoch 1958
[task 2025-01-29T17:32:01.156Z] [2025-01-29 17:32:01] [Trainer] [INFO] Reading original for epoch 1959
[task 2025-01-29T17:32:01.444Z] [2025-01-29 17:32:01] [Trainer] [INFO] Reading original for epoch 1960
[task 2025-01-29T17:32:01.717Z] [2025-01-29 17:32:01] [Trainer] [INFO] Reading original for epoch 1961
[task 2025-01-29T17:32:02.009Z] [2025-01-29 17:32:02] [Trainer] [INFO] Reading original for epoch 1962
[task 2025-01-29T17:32:02.291Z] [2025-01-29 17:32:02] [Trainer] [INFO] Reading original for epoch 1963
[task 2025-01-29T17:32:02.583Z] [2025-01-29 17:32:02] [Trainer] [INFO] Reading original for epoch 1964
[task 2025-01-29T17:32:02.867Z] [2025-01-29 17:32:02] [Trainer] [INFO] Reading original for epoch 1965
[task 2025-01-29T17:32:03.154Z] [2025-01-29 17:32:03] [Trainer] [INFO] Reading original for epoch 1966
[task 2025-01-29T17:32:03.434Z] [2025-01-29 17:32:03] [Trainer] [INFO] Reading original for epoch 1967
[task 2025-01-29T17:32:03.710Z] [2025-01-29 17:32:03] [Trainer] [INFO] Reading original for epoch 1968
[task 2025-01-29T17:32:03.998Z] [2025-01-29 17:32:03] [Trainer] [INFO] Reading original for epoch 1969
[task 2025-01-29T17:32:04.272Z] [2025-01-29 17:32:04] [Trainer] [INFO] Reading original for epoch 1970
[task 2025-01-29T17:32:04.565Z] [2025-01-29 17:32:04] [Trainer] [INFO] Reading original for epoch 1971
[task 2025-01-29T17:32:04.842Z] [2025-01-29 17:32:04] [Trainer] [INFO] Reading original for epoch 1972
[task 2025-01-29T17:32:05.125Z] [2025-01-29 17:32:05] [Trainer] [INFO] Reading original for epoch 1973
[task 2025-01-29T17:32:05.411Z] [2025-01-29 17:32:05] [Trainer] [INFO] Reading original for epoch 1974
[task 2025-01-29T17:32:05.691Z] [2025-01-29 17:32:05] [Trainer] [INFO] Reading original for epoch 1975
[task 2025-01-29T17:32:05.965Z] [2025-01-29 17:32:05] [Trainer] [INFO] Reading original for epoch 1976
[task 2025-01-29T17:32:06.246Z] [2025-01-29 17:32:06] [Trainer] [INFO] Reading original for epoch 1977
[task 2025-01-29T17:32:06.537Z] [2025-01-29 17:32:06] [Trainer] [INFO] Reading original for epoch 1978
[task 2025-01-29T17:32:06.811Z] [2025-01-29 17:32:06] [Trainer] [INFO] Reading original for epoch 1979
[task 2025-01-29T17:32:07.097Z] [2025-01-29 17:32:07] [Trainer] [INFO] Reading original for epoch 1980
[task 2025-01-29T17:32:07.391Z] [2025-01-29 17:32:07] [Trainer] [INFO] Reading original for epoch 1981
[task 2025-01-29T17:32:07.681Z] [2025-01-29 17:32:07] [Trainer] [INFO] Reading original for epoch 1982
[task 2025-01-29T17:32:07.971Z] [2025-01-29 17:32:07] [Trainer] [INFO] Reading original for epoch 1983
[task 2025-01-29T17:32:08.269Z] [2025-01-29 17:32:08] [Trainer] [INFO] Reading original for epoch 1984
[task 2025-01-29T17:32:08.569Z] [2025-01-29 17:32:08] [Trainer] [INFO] Reading original for epoch 1985
[task 2025-01-29T17:32:08.851Z] [2025-01-29 17:32:08] [Trainer] [INFO] Reading original for epoch 1986
[task 2025-01-29T17:32:09.157Z] [2025-01-29 17:32:09] [Trainer] [INFO] Reading original for epoch 1987
[task 2025-01-29T17:32:09.460Z] [2025-01-29 17:32:09] [Trainer] [INFO] Reading original for epoch 1988
[task 2025-01-29T17:32:09.761Z] [2025-01-29 17:32:09] [Trainer] [INFO] Reading original for epoch 1989
[task 2025-01-29T17:32:10.038Z] [2025-01-29 17:32:10] [Trainer] [INFO] Reading original for epoch 1990
[task 2025-01-29T17:32:10.308Z] [2025-01-29 17:32:10] [Trainer] [INFO] Reading original for epoch 1991
[task 2025-01-29T17:32:10.597Z] [2025-01-29 17:32:10] [Trainer] [INFO] Reading original for epoch 1992
[task 2025-01-29T17:32:10.901Z] [2025-01-29 17:32:10] [Trainer] [INFO] Reading original for epoch 1993
[task 2025-01-29T17:32:11.190Z] [2025-01-29 17:32:11] [Trainer] [INFO] Reading original for epoch 1994
[task 2025-01-29T17:32:11.475Z] [2025-01-29 17:32:11] [Trainer] [INFO] Reading original for epoch 1995
[task 2025-01-29T17:32:11.768Z] [2025-01-29 17:32:11] [Trainer] [INFO] Reading original for epoch 1996
[task 2025-01-29T17:32:12.063Z] [2025-01-29 17:32:12] [Trainer] [INFO] Reading original for epoch 1997
[task 2025-01-29T17:32:12.357Z] [2025-01-29 17:32:12] [Trainer] [INFO] Reading original for epoch 1998
[task 2025-01-29T17:32:21.003Z] [2025-01-29 17:32:21] [Trainer] [INFO] trainer stopped reading input
[task 2025-01-29T17:32:21.106Z] [tracking INFO] Successfully parsed 2466 lines
[task 2025-01-29T17:32:21.106Z] [tracking INFO] Found 50 training entries
[task 2025-01-29T17:32:21.106Z] [tracking INFO] Found 1 validation entries
[fetches 2025-01-29T17:32:21.416Z] removing /home/ubuntu/tasks/task_173817110647444/fetches
[fetches 2025-01-29T17:32:21.769Z] finished
[taskcluster 2025-01-29T17:32:21.779Z] Exit Code: 0
[taskcluster 2025-01-29T17:32:21.779Z] User Time: 1h4m49.300859s
[taskcluster 2025-01-29T17:32:21.779Z] Kernel Time: 1m29.875705s
[taskcluster 2025-01-29T17:32:21.779Z] Wall Time: 13m25.041653128s
[taskcluster 2025-01-29T17:32:21.779Z] Result: SUCCEEDED
[taskcluster 2025-01-29T17:32:21.780Z] === Task Finished ===
[taskcluster 2025-01-29T17:32:21.780Z] Task Duration: 13m25.043776502s
[taskcluster 2025-01-29T17:32:22.020Z] Uploading artifact public/build/model.npz.decoder.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.decoder.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.070Z] Uploading artifact public/build/model.npz.best-bleu-detok.npz from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.best-bleu-detok.npz with content encoding "identity", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.097Z] Uploading artifact public/build/model.npz.progress.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.progress.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.114Z] Uploading artifact public/build/opustrainer.log from file /home/ubuntu/tasks/task_173817110647444/artifacts/opustrainer.log with content encoding "gzip", mime type "text/plain" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.120Z] Uploading artifact public/build/model.npz.best-chrf.npz from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.best-chrf.npz with content encoding "identity", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.144Z] Uploading artifact public/build/train.log from file /home/ubuntu/tasks/task_173817110647444/artifacts/train.log with content encoding "gzip", mime type "text/plain" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.144Z] Uploading artifact public/build/valid.log from file /home/ubuntu/tasks/task_173817110647444/artifacts/valid.log with content encoding "gzip", mime type "text/plain" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.152Z] Uploading artifact public/build/vocab.spm from file /home/ubuntu/tasks/task_173817110647444/artifacts/vocab.spm with content encoding "gzip", mime type "application/x-source-rpm" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.204Z] Uploading artifact public/build/model.npz from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz with content encoding "identity", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.204Z] Uploading artifact public/build/config.opustrainer.yml.state from file /home/ubuntu/tasks/task_173817110647444/artifacts/config.opustrainer.yml.state with content encoding "gzip", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.204Z] Uploading artifact public/build/model.npz.optimizer.npz from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.optimizer.npz with content encoding "identity", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.205Z] Uploading artifact public/build/config.opustrainer.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/config.opustrainer.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.204Z] Uploading artifact public/build/model.npz.best-ce-mean-words.npz from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.best-ce-mean-words.npz with content encoding "identity", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.205Z] Uploading artifact public/build/model.npz.best-ce-mean-words.npz.decoder.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.best-ce-mean-words.npz.decoder.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.205Z] Uploading artifact public/build/final.model.npz.best-chrf.npz from file /home/ubuntu/tasks/task_173817110647444/artifacts/final.model.npz.best-chrf.npz with content encoding "identity", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.212Z] Uploading artifact public/build/devset.out from file /home/ubuntu/tasks/task_173817110647444/artifacts/devset.out with content encoding "gzip", mime type "application/octet-stream" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.243Z] Uploading artifact public/build/model.npz.best-bleu-detok.npz.decoder.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.best-bleu-detok.npz.decoder.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.252Z] Uploading artifact public/build/final.model.npz.best-chrf.npz.decoder.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/final.model.npz.best-chrf.npz.decoder.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.252Z] Uploading artifact public/build/model.npz.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:22.254Z] Uploading artifact public/build/model.npz.best-chrf.npz.decoder.yml from file /home/ubuntu/tasks/task_173817110647444/artifacts/model.npz.best-chrf.npz.decoder.yml with content encoding "gzip", mime type "application/x-yaml" and expiry 2025-02-28T15:56:00.081Z
[taskcluster 2025-01-29T17:32:32.404Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_173817110647444/checkouts" to "/home/ubuntu/caches/VudaMiAGRjmTMJAwlpC6JA"
[taskcluster 2025-01-29T17:32:32.497Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-02-28T15:56:00.081Z