CI Failure (ubuntu)

[david-allison]

Error: Failed with code Some(1): ./ninja extract:protoc css:_root-vars ts:reviewer:reviewer.js ts:reviewer:reviewer.css ts:reviewer:reviewer_extras_bundle.js ts:reviewer:reviewer_extras.css qt:aqt:data:web:pages

• Last success: 2024-04-29T01:46:25+01:00 - https://github.com/ankidroid/Anki-Android-Backend/actions/runs/8871673583/job/24354979002
• First failure: 2024-04-30T01:44:57+01:00 https://github.com/ankidroid/Anki-Android-Backend/actions/runs/8887480874/job/24402827438

[david-allison]

Log diff (rough - only marking what appear to be significant changes)

# ##[group]Run cargo run -p build_rust
# �[36;1mcargo run -p build_rust�[0m
# shell: /usr/bin/bash -e {0}
# env:
#   DEBUG: 1
#   ANDROID_NDK_HOME: /usr/local/lib/android/sdk/ndk/26.3.11579264
#   ANDROID_NDK_ROOT: /usr/local/lib/android/sdk/ndk/26.3.11579264
#   JAVA_HOME: /opt/hostedtoolcache/Java_Temurin-Hotspot_jdk/21.0.2-13/x64
#   JAVA_HOME_21_X64: /opt/hostedtoolcache/Java_Temurin-Hotspot_jdk/21.0.2-13/x64
#   GRADLE_ACTION_ID: gradle/actions/setup-gradle
#   GRADLE_BUILD_ACTION_SETUP_COMPLETED: true
#   GRADLE_BUILD_ACTION_CACHE_RESTORED: true
#   DEVELOCITY_INJECTION_INIT_SCRIPT_NAME: gradle-actions.inject-develocity.init.gradle
#   DEVELOCITY_AUTO_INJECTION_CUSTOM_VALUE: gradle-actions
#   GITHUB_DEPENDENCY_GRAPH_ENABLED: false
# ##[endgroup]
#    Compiling anki_io v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/io)
#    Compiling anki_process v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/process)
#    Compiling build_rust v0.1.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/build_rust)
#     Finished dev [unoptimized + debuginfo] target(s) in 0.50s
#      Running `target/debug/build_rust`
# *** Building desktop web components
# �[1m�[32m   Compiling�[0m runner v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/build/runner)
# �[1m�[32m   Compiling�[0m anki_io v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/io)
# �[1m�[32m   Compiling�[0m anki_process v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/process)
# �[1m�[32m    Finished�[0m release [optimized] target(s) in 3.64s
# �[1m�[32m   Compiling�[0m anki_io v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/io)
# �[1m�[32m   Compiling�[0m ninja_gen v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/build/ninja_gen)
# �[1m�[32m   Compiling�[0m configure v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/build/configure)
# �[1m�[32m    Finished�[0m dev [unoptimized + debuginfo] target(s) in 0.95s
# �[1m�[32m     Running�[0m `out/rust/debug/configure`
# build:configure_bin
# �[1m�[32m    Finished�[0m dev [unoptimized + debuginfo] target(s) in 0.13s
+ build:configure
+ �[1m�[32m    Finished�[0m dev [unoptimized + debuginfo] target(s) in 0.11s
+ �[1m�[32m     Running�[0m `out/rust/debug/configure`
# build:configure
# download:protoc
# download:node
# ftl:repo:core
# extract:protoc
# extract:node
# rslib:proto
# yarn
# node_modules
# rslib:proto
# �[1m�[32m   Compiling�[0m anki_io v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/io)
# �[1m�[32m   Compiling�[0m anki_proto_gen v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/proto_gen)
# �[1m�[32m   Compiling�[0m anki_proto v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/proto)
# �[1m�[32m    Finished�[0m dev [unoptimized + debuginfo] target(s) in 2.18s
# ftl:repo:core
# Submodule 'ftl/core-repo' (https://github.com/ankitects/anki-core-i18n.git) registered for path 'ftl/core-repo'
# Cloning into '/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/ftl/core-repo'...
# From https://github.com/ankitects/anki-core-i18n
#  * branch              e3af3c983241448a239871ca573c9dd2fa5e8619 -> FETCH_HEAD
# Submodule path 'ftl/core-repo': checked out 'e3af3c983241448a239871ca573c9dd2fa5e8619'
# ftl:repo:qt
+ �[0m�[1m�[31m
+ Build failed.
+ Error: Failed with code Some(1): ./ninja extract:protoc css:_root-vars ts:reviewer:reviewer.js ts:reviewer:reviewer.css ts:reviewer:reviewer_extras_bundle.js ts:reviewer:reviewer_extras.css qt:aqt:data:web:pages
+ �[0m
+ ##[error]Process completed with exit code 1.
- node_modules
- �[2K�[1G�[1myarn install v1.22.22�[22m
- �[2K�[1G�[2m[1/4]�[22m Resolving packages...
- �[2K�[1G�[32msuccess�[39m Already up-to-date.
- �[2K�[1GDone in 0.36s.
- ts:lib:proto
- ts:lib:proto
- css:_root-vars
- ts:reviewer:reviewer_extras.css
- ts:reviewer:reviewer.css
- ftl:repo:qt
- Submodule 'ftl/qt-repo' (https://github.com/ankitects/anki-desktop-ftl.git) registered for path 'ftl/qt-repo'
- Cloning into '/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/ftl/qt-repo'...
- From https://github.com/ankitects/anki-desktop-ftl
-  * branch            45155310c3302cbbbe645dec52ca196894422463 -> FETCH_HEAD
- Submodule path 'ftl/qt-repo': checked out '45155310c3302cbbbe645dec52ca196894422463'
- rslib:i18n
- �[1m�[32m   Compiling�[0m anki_io v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/io)
- �[1m�[32m   Compiling�[0m anki_i18n v0.0.0 (/home/runner/work/Anki-Android-Backend/Anki-Android-Backend/anki/rslib/i18n)
- �[1m�[32m    Finished�[0m dev [unoptimized + debuginfo] target(s) in 1.74s
- ts:import-csv
- ts:image-occlusion
- ts:graphs
- ts:import-page
- ts:congrats
- ts:editable
- ts:reviewer:reviewer_extras_bundle.js
- ts:change-notetype
- ts:card-info
- ts:deck-options
- ts:reviewer:reviewer.js
-ts:import-anki-package
- qt:aqt:data:web:pages
- n2: ran 30 tasks, now up to date
- �[0m�[1m�[32m
- Build succeeded in 23.98s.
- �[0m*** Building Android JNI library + backend interface

[david-allison]

@dae Have there been any ecosystem changes around 2024-04-29 which could have caused this?

[dae]

Deps are supposed to be pinned, so I can't think of why this would break apart from a change to the runner env, or some deps that wasn't properly pinned. Try splitting this up into separate commands so you can see which of the build targets is failing:

Anki-Android-Backend/build_rust/src/main.rs

Line 63 in ea684c6

cmd.current_dir("anki")

[david-allison]

Thanks! No change to the runner version from the logs

[BrayanDSO]

I can reproduce it locally in my Fedora build. Although just restarting the job works

[mikehardy]

I can reproduce it locally in my Fedora build. Although just restarting the job works

interesting - I have an ubuntu rig I was going to use to reproduce this but haven't had a chance yet.
Does that indicate that there is some state shared between the two runs such that the second one works because the state from the first one is laying around? Stated differently, if the build attempts are 100% clean between runs, does it continue to fail or not?

[BrayanDSO]

if the build attempts are 100% clean between runs, does it continue to fail or not?

After a success, rebuilds don't fail. If I do some changes (experienced with updating dependencies, and with changing a rust file), sometimes I get a fail. Just running ./build.sh works

On bigger changes (i.e. updating anki to the latest commit and therefore having to download all of its dependencies), I had to do it like 5 times, each time getting farther than the last one, until I got a success

Running cd anki && ./ninja resulted in the same error message

[mikehardy]

Threw a "retry-action" workaround up in #375 - if that's good enough for you guys we can move on with life after some @dependabot rebase on related PRs...

[mikehardy]

Reopening until root cause analysis is done, #375 will unblock CI as things will pass now, but it's an ubuntu-specific retry hack without any deeper understanding of the problem