Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Frequent CI failures on archlinux (environment variable XDG_RUNTIME_DIR is not set) #1346

Open
jandubois opened this issue Jan 31, 2023 · 0 comments
Open

Frequent CI failures on archlinux (environment variable XDG_RUNTIME_DIR is not set) #1346

jandubois opened this issue Jan 31, 2023 · 0 comments
Labels
area/test Tests and CI bug Something isn't working guest/archlinux Guest: Arch Linux

Comments

@jandubois
Copy link
Member

We have frequent CI failures for "archlinux". #1320 adds logic to capture the cloud-init logs. Example failure:

cloud-init-output.log 
sudo -iu testuser $(pwd)/hack/test-example.sh $(pwd)/examples/$EXAMPLE
TEST| [INFO] Validating "/tmp/cirrus-ci-build/examples/archlinux.yaml"
time="2023-01-23T06:14:45Z" level=info msg="\"/tmp/cirrus-ci-build/examples/archlinux.yaml\": OK"
time="2023-01-23T06:14:45Z" level=warning msg="No instance found. Run `limactl start` to create an instance."
TEST| [INFO] Setup port forwarding rules for testing in "/home/testuser/lima-config-tmp/archlinux.yaml"
time="2023-01-23T06:14:45Z" level=info msg="\"/home/testuser/lima-config-tmp/archlinux.yaml\": OK"
TEST| [INFO] Starting "archlinux" from "/home/testuser/lima-config-tmp/archlinux.yaml"
+ limactl start --tty=false /home/testuser/lima-config-tmp/archlinux.yaml
time="2023-01-23T06:14:45Z" level=info msg="Terminal is not available, proceeding without opening an editor"
time="2023-01-23T06:14:45Z" level=info msg="Attempting to download the image from \"https://geo.mirror.pkgbuild.com/images/v20221215.111177/Arch-Linux-x86_64-cloudimg-20221215.111177.qcow2\"" digest="sha256:e03bca357b6962eb65832dba91bd3515ebd6fe6592748dd0e136502b39d88041"
time="2023-01-23T06:14:46Z" level=info msg="Using cache \"/home/testuser/.cache/lima/download/by-url-sha256/24b94e4bae634a1f441dacd1aaa77741a1630f70cce04516236215128bd8f130/data\""
time="2023-01-23T06:14:46Z" level=info msg="Attempting to download the nerdctl archive from \"https://github.com/containerd/nerdctl/releases/download/v1.1.0/nerdctl-full-1.1.0-linux-amd64.tar.gz\"" digest="sha256:5440c7b3af63df2ad2c98e185e06a27b4a21eea334b05408e84f8502251d9459"
time="2023-01-23T06:14:46Z" level=info msg="Using cache \"/home/testuser/.cache/lima/download/by-url-sha256/dabf40bf0b785bdfa60d957219520047fd7f68de336c973b22796a9aa1dcf1f6/data\""
time="2023-01-23T06:14:46Z" level=info msg="[hostagent] Replacing \"ftp_proxy\" value \"http://localhost:2121\" with \"http://192.168.5.2:2121\""
time="2023-01-23T06:14:49Z" level=info msg="[hostagent] Starting QEMU (hint: to watch the boot progress, see \"/home/testuser/.lima/archlinux/serial.log\")"
time="2023-01-23T06:14:49Z" level=info msg="SSH Local Port: 46423"
time="2023-01-23T06:14:49Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:14:59Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:15:53Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:16:03Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:16:13Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:16:23Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:16:33Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:16:43Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 5: \"ssh\""
time="2023-01-23T06:19:41Z" level=info msg="[hostagent] The essential requirement 1 of 5 is satisfied"
time="2023-01-23T06:19:41Z" level=info msg="[hostagent] Waiting for the essential requirement 2 of 5: \"user session is ready for ssh\""
time="2023-01-23T06:19:41Z" level=info msg="[hostagent] The essential requirement 2 of 5 is satisfied"
time="2023-01-23T06:19:41Z" level=info msg="[hostagent] Waiting for the essential requirement 3 of 5: \"sshfs binary to be installed\""
time="2023-01-23T06:19:45Z" level=info msg="[hostagent] The essential requirement 3 of 5 is satisfied"
time="2023-01-23T06:19:45Z" level=info msg="[hostagent] Waiting for the essential requirement 4 of 5: \"/etc/fuse.conf (/etc/fuse3.conf) to contain \\\"user_allow_other\\\"\""
time="2023-01-23T06:19:45Z" level=info msg="[hostagent] The essential requirement 4 of 5 is satisfied"
time="2023-01-23T06:19:45Z" level=info msg="[hostagent] Waiting for the essential requirement 5 of 5: \"the guest agent to be running\""
time="2023-01-23T06:19:45Z" level=info msg="[hostagent] The essential requirement 5 of 5 is satisfied"
time="2023-01-23T06:19:45Z" level=info msg="[hostagent] Mounting \"/home/testuser\" on \"/home/testuser\""
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Mounting \"/tmp/lima\" on \"/tmp/lima\""
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Waiting for the optional requirement 1 of 2: \"systemd must be available\""
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Forwarding \"/run/lima-guestagent.sock\" (guest) to \"/home/testuser/.lima/archlinux/ga.sock\" (host)"
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Not forwarding TCP 0.0.0.0:22"
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Not forwarding TCP 127.0.0.54:53"
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Forwarding TCP from 0.0.0.0:5355 to 127.0.0.1:5355"
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] The optional requirement 1 of 2 is satisfied"
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Waiting for the optional requirement 2 of 2: \"containerd binaries to be installed\""
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Not forwarding TCP 127.0.0.53:53"
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Not forwarding TCP [::]:22"
time="2023-01-23T06:19:46Z" level=info msg="[hostagent] Forwarding TCP from [::]:5355 to 127.0.0.1:5355"
time="2023-01-23T06:19:46Z" level=warning msg="[hostagent] failed to set up forwarding tcp port 5355 (negligible if already forwarded)"
time="2023-01-23T06:20:04Z" level=info msg="[hostagent] The optional requirement 2 of 2 is satisfied"
time="2023-01-23T06:20:04Z" level=info msg="[hostagent] Waiting for the final requirement 1 of 1: \"boot scripts must have finished\""
time="2023-01-23T06:20:23Z" level=info msg="[hostagent] The final requirement 1 of 1 is satisfied"
time="2023-01-23T06:20:23Z" level=info msg="READY. Run `limactl shell archlinux` to open the shell."
+ limactl shell archlinux uname -a
Linux lima-archlinux 6.0.12-arch1-1 #1 SMP PREEMPT_DYNAMIC Thu, 08 Dec 2022 11:03:38 +0000 x86_64 GNU/Linux
+ limactl shell archlinux cat /etc/os-release
NAME="Arch Linux"
PRETTY_NAME="Arch Linux"
ID=arch
BUILD_ID=rolling
ANSI_COLOR="38;2;23;147;209"
HOME_URL="https://archlinux.org/"
DOCUMENTATION_URL="https://wiki.archlinux.org/"
SUPPORT_URL="https://bbs.archlinux.org/"
BUG_REPORT_URL="https://bugs.archlinux.org/"
PRIVACY_POLICY_URL="https://terms.archlinux.org/docs/privacy-policy/"
LOGO=archlinux-logo
+ set +x
TEST| [INFO] Testing proxy settings are imported
TEST| [INFO] FTP_PROXY: expected=FTP_PROXY=http://192.168.5.2:2121 got=FTP_PROXY=http://192.168.5.2:2121
TEST| [INFO] Testing limactl copy command
TEST| [INFO] /etc/hostname: expected=lima-archlinux, got=lima-archlinux
TEST| [INFO] Testing limactl command with escaped characters
foo
bar
TEST| [INFO] Testing limactl command with quotes
foo "bar"
+ limactl shell archlinux systemctl is-system-running --wait
running
+ set +x
TEST| [INFO] Testing home access ("/home/testuser/lima-test-tmp")
TEST| [INFO] /home/testuser/lima-test-tmp/random: expected=random-content-14678, got=random-content-14678
TEST| [INFO] Run a nginx container with port forwarding 127.0.0.1:8080
+ limactl shell archlinux nerdctl info
time="2023-01-23T06:20:24Z" level=warning msg="environment variable XDG_RUNTIME_DIR is not set, see https://rootlesscontaine.rs/getting-started/common/login/"
time="2023-01-23T06:20:24Z" level=warning msg="environment variable XDG_RUNTIME_DIR is not set, see https://rootlesscontaine.rs/getting-started/common/login/"
time="2023-01-23T06:20:24Z" level=warning msg="environment variable XDG_RUNTIME_DIR is not set, see https://rootlesscontaine.rs/getting-started/common/login/"
time="2023-01-23T06:20:24Z" level=fatal msg="rootless containerd not running? (hint: use `containerd-rootless-setuptool.sh install` to start rootless containerd): environment variable XDG_RUNTIME_DIR is not set, see https://rootlesscontaine.rs/getting-started/common/login/"
+ limactl shell archlinux sudo cat /var/log/cloud-init-output.log
Cloud-init v. 22.4.2 running 'init-local' at Mon, 23 Jan 2023 06:15:35 +0000. Up 19.87 seconds.
Cloud-init v. 22.4.2 running 'init' at Mon, 23 Jan 2023 06:15:41 +0000. Up 25.16 seconds.
ci-info: +++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++
ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
ci-info: | Device |  Up  |           Address            |      Mask     | Scope  |     Hw-Address    |
ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
ci-info: |  eth0  | True |         192.168.5.15         | 255.255.255.0 | global | 52:55:55:a0:34:04 |
ci-info: |  eth0  | True | fe80::5055:55ff:fea0:3404/64 |       .       |  link  | 52:55:55:a0:34:04 |
ci-info: |   lo   | True |          127.0.0.1           |   255.0.0.0   |  host  |         .         |
ci-info: |   lo   | True |           ::1/128            |       .       |  host  |         .         |
ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
ci-info: ++++++++++++++++++++++++++++++Route IPv4 info++++++++++++++++++++++++++++++
ci-info: +-------+-------------+-------------+-----------------+-----------+-------+
ci-info: | Route | Destination |   Gateway   |     Genmask     | Interface | Flags |
ci-info: +-------+-------------+-------------+-----------------+-----------+-------+
ci-info: |   0   |   0.0.0.0   | 192.168.5.2 |     0.0.0.0     |    eth0   |   UG  |
ci-info: |   1   | 192.168.5.0 |   0.0.0.0   |  255.255.255.0  |    eth0   |   U   |
ci-info: |   2   | 192.168.5.2 |   0.0.0.0   | 255.255.255.255 |    eth0   |   UH  |
ci-info: |   3   | 192.168.5.3 |   0.0.0.0   | 255.255.255.255 |    eth0   |   UH  |
ci-info: +-------+-------------+-------------+-----------------+-----------+-------+
ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: | Route | Destination | Gateway | Interface | Flags |
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: |   1   |  fe80::/64  |    ::   |    eth0   |   U   |
ci-info: |   3   |    local    |    ::   |    eth0   |   U   |
ci-info: |   4   |  multicast  |    ::   |    eth0   |   U   |
ci-info: +-------+-------------+---------+-----------+-------+
2023-01-23 06:15:41,569 - schema.py[WARNING]: Deprecated cloud-config provided:
ca-certs: DEPRECATED: Dropped after April 2027. Use ``ca_certs``.
2023-01-23 06:15:41,569 - schema.py[WARNING]: Invalid cloud-config provided: Please run 'sudo cloud-init schema --system' to see the schema errors.
Generating public/private rsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_rsa_key
Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub
The key fingerprint is:
SHA256:6X6zySZoURxJrEvQ9GYKWAVA6lYKBS+f66qpTNSTphs root@lima-archlinux
The key's randomart image is:
+---[RSA 3072]----+
|.o+.o=oo..       |
| + o. ..+        |
|+ o... o+.       |
|oo+...o+o.       |
| =o= ..oS        |
|o o.. o.         |
| E.    o.        |
|ooo   o...+.     |
|B+.  .  .++o     |
+----[SHA256]-----+
Generating public/private dsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_dsa_key
Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub
The key fingerprint is:
SHA256:vu0hfD2QXUFHhvMpedS/GFMzsD7ltH8gzJCKr462YCE root@lima-archlinux
The key's randomart image is:
+---[DSA 1024]----+
|             o+o=|
|           .  +O.|
|          o  .===|
|       . . *.*+o+|
|E .   . S o =oBo.|
| . .   +   o o.o.|
|  o     = o o   o|
| . ... . = . .  .|
|   .ooo ..o      |
+----[SHA256]-----+
Generating public/private ecdsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key
Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub
The key fingerprint is:
SHA256:rb2DhyTlfovQ6Df738JtY1ZKdj53gOWiN12OhVpymNE root@lima-archlinux
The key's randomart image is:
+---[ECDSA 256]---+
|                 |
|                 |
|             .   |
|        ..  . E  |
|       oS .  B . |
|      .ooo  * O =|
|      o+oo.o @ @ |
|     . .*.=.*.X.=|
|      ..o*+=.*..+|
+----[SHA256]-----+
Generating public/private ed25519 key pair.
Your identification has been saved in /etc/ssh/ssh_host_ed25519_key
Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub
The key fingerprint is:
SHA256:UrMUA4Bh1JzImVRUwy32fw5jzHQYOWxA96UmETdUgz8 root@lima-archlinux
The key's randomart image is:
+--[ED25519 256]--+
| +=@+=++=o+++o+  |
| .* + +..+*+.+ . |
|     . o+..++.   |
|       o.ooo. E  |
|      . S= .   . |
|       .  B .    |
|         . =     |
|            .    |
|                 |
+----[SHA256]-----+
Cloud-init v. 22.4.2 running 'modules:config' at Mon, 23 Jan 2023 06:15:46 +0000. Up 30.66 seconds.
Generating locales...
  en_US.UTF-8... done
Generation complete.
Cloud-init v. 22.4.2 running 'modules:final' at Mon, 23 Jan 2023 06:16:35 +0000. Up 79.68 seconds.
+ LIMA_CIDATA_MNT=/mnt/lima-cidata
+ LIMA_CIDATA_DEV=/dev/disk/by-label/cidata
+ mkdir -p -m 700 /mnt/lima-cidata
+ mount -o ro,mode=0700,dmode=0700,overriderockperm,exec,uid=0 /dev/disk/by-label/cidata /mnt/lima-cidata
+ export LIMA_CIDATA_MNT
+ exec /mnt/lima-cidata/boot.sh
LIMA| Executing /mnt/lima-cidata/boot/00-modprobe.sh
Loading kernel module "fuse"
Loading kernel module "tun"
Loading kernel module "tap"
Loading kernel module "bridge"
Loading kernel module "veth"
Loading kernel module "ip_tables"
Loading kernel module "ip6_tables"
Loading kernel module "iptable_nat"
Loading kernel module "ip6table_nat"
Loading kernel module "iptable_filter"
Loading kernel module "ip6table_filter"
Loading kernel module "nf_tables"
Loading kernel module "x_tables"
Loading kernel module "xt_MASQUERADE"
Loading kernel module "xt_addrtype"
Loading kernel module "xt_comment"
Loading kernel module "xt_conntrack"
Loading kernel module "xt_mark"
Loading kernel module "xt_multiport"
Loading kernel module "xt_nat"
Loading kernel module "xt_tcpudp"
Loading kernel module "overlay"
LIMA| Executing /mnt/lima-cidata/boot/01-alpine-ash-as-bash.sh
LIMA| Executing /mnt/lima-cidata/boot/04-persistent-data-volume.sh
+ test -f /etc/alpine-release
+ exit 0
LIMA| Executing /mnt/lima-cidata/boot/05-lima-disks.sh
+ test 0 -gt 0
+ exit 0
LIMA| Executing /mnt/lima-cidata/boot/05-rosetta-volume.sh
LIMA| Executing /mnt/lima-cidata/boot/06-etc-hosts.sh
+ sed -i /host.lima.internal/d /etc/hosts
+ echo -e '192.168.5.2\thost.lima.internal'
LIMA| Executing /mnt/lima-cidata/boot/07-etc-environment.sh
+ '[' -e /etc/environment ']'
+ sed -i /#LIMA-START/,/#LIMA-END/d /etc/environment
+ cat /mnt/lima-cidata/etc_environment
+ command -v loginctl
+ loginctl terminate-user testuser
Could not terminate user: User ID 1000 is not logged in or lingering
+ true
+ rm -f /run/lima-guest-agent.sock
+ cp /mnt/lima-cidata/meta-data /run/lima-ssh-ready
LIMA| Executing /mnt/lima-cidata/boot/08-shell-prompt.sh
+ '[' archlinux = default ']'
LIMA| Executing /mnt/lima-cidata/boot/09-host-dns-setup.sh
+ command -v iptables
+ '[' -n 41454 ']'
+ '[' 41454 -ne 0 ']'
+ grep 'udp.*192.168.5.2:41454'
+ iptables-save
+ iptables -t nat -A PREROUTING -d 192.168.5.3 -p udp --dport 53 -j DNAT --to-destination 192.168.5.2:41454
+ iptables -t nat -A OUTPUT -d 192.168.5.3 -p udp --dport 53 -j DNAT --to-destination 192.168.5.2:41454
+ '[' -n 43181 ']'
+ '[' 43181 -ne 0 ']'
+ grep 'tcp.*192.168.5.2:43181'
+ iptables-save
+ iptables -t nat -A PREROUTING -d 192.168.5.3 -p tcp --dport 53 -j DNAT --to-destination 192.168.5.2:43181
+ iptables -t nat -A OUTPUT -d 192.168.5.3 -p tcp --dport 53 -j DNAT --to-destination 192.168.5.2:43181
LIMA| Executing /mnt/lima-cidata/boot/10-alpine-prep.sh
+ test -f /etc/alpine-release
+ exit 0
LIMA| Executing /mnt/lima-cidata/boot/11-colorterm-environment.sh
+ '[' '!' -e /etc/ssh/sshd_config ']'
+ grep -q COLORTERM /etc/ssh/sshd_config
+ sed -i 's/^AcceptEnv LANG LC_\*$/AcceptEnv COLORTERM LANG LC_*/' /etc/ssh/sshd_config
+ '[' -f /sbin/openrc-run ']'
+ command -v systemctl
+ systemctl -q is-active ssh
+ systemctl -q is-active sshd
+ systemctl reload sshd
LIMA| Executing /mnt/lima-cidata/boot/20-rootless-base.sh
+ command -v systemctl
+ for f in .profile .bashrc .zshrc
+ grep -q '# Lima BEGIN' /home/testuser.linux/.profile
grep: /home/testuser.linux/.profile: No such file or directory
+ cat
++ uname -r
+ compare_version.sh 6.0.12-arch1-1 -lt 5.13
+ cat
+ chown testuser /home/testuser.linux/.profile
+ for f in .profile .bashrc .zshrc
+ grep -q '# Lima BEGIN' /home/testuser.linux/.bashrc
+ cat
++ uname -r
+ compare_version.sh 6.0.12-arch1-1 -lt 5.13
+ cat
+ chown testuser /home/testuser.linux/.bashrc
+ for f in .profile .bashrc .zshrc
+ grep -q '# Lima BEGIN' /home/testuser.linux/.zshrc
grep: /home/testuser.linux/.zshrc: No such file or directory
+ cat
++ uname -r
+ compare_version.sh 6.0.12-arch1-1 -lt 5.13
+ cat
+ chown testuser /home/testuser.linux/.zshrc
+ '[' '!' -e /etc/systemd/system/[email protected]/lima.conf ']'
+ mkdir -p /etc/systemd/system/[email protected]
+ cat
+ systemctl daemon-reload
+ sysctl_conf=/etc/sysctl.d/99-lima.conf
+ '[' '!' -e /etc/sysctl.d/99-lima.conf ']'
+ '[' -e /proc/sys/kernel/unprivileged_userns_clone ']'
+ echo kernel.unprivileged_userns_clone=1
+ echo 'net.ipv4.ping_group_range = 0 2147483647'
+ echo net.ipv4.ip_unprivileged_port_start=0
+ sysctl --system
* Applying /usr/lib/sysctl.d/10-arch.conf ...
fs.inotify.max_user_instances = 1024
fs.inotify.max_user_watches = 524288
* Applying /usr/lib/sysctl.d/50-coredump.conf ...
kernel.core_pattern = |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h
kernel.core_pipe_limit = 16
fs.suid_dumpable = 2
* Applying /usr/lib/sysctl.d/50-default.conf ...
kernel.sysrq = 16
kernel.core_uses_pid = 1
net.ipv4.conf.default.rp_filter = 2
sysctl: setting key "net.ipv4.conf.all.rp_filter": Invalid argument
net.ipv4.conf.default.accept_source_route = 0
sysctl: setting key "net.ipv4.conf.all.accept_source_route": Invalid argument
net.ipv4.conf.default.promote_secondaries = 1
sysctl: setting key "net.ipv4.conf.all.promote_secondaries": Invalid argument
net.ipv4.ping_group_range = 0 2147483647
net.core.default_qdisc = fq_codel
fs.protected_hardlinks = 1
fs.protected_symlinks = 1
fs.protected_regular = 1
fs.protected_fifos = 1
* Applying /usr/lib/sysctl.d/50-pid-max.conf ...
kernel.pid_max = 4194304
* Applying /etc/sysctl.d/99-lima.conf ...
kernel.unprivileged_userns_clone = 1
net.ipv4.ping_group_range = 0 2147483647
net.ipv4.ip_unprivileged_port_start = 0
+ for f in /etc/subuid /etc/subgid
+ grep -qw testuser /etc/subuid
+ for f in /etc/subuid /etc/subgid
+ grep -qw testuser /etc/subgid
+ systemctl start systemd-logind.service
+ loginctl enable-linger testuser
LIMA| Executing /mnt/lima-cidata/boot/25-guestagent-base.sh
+ '[' reverse-sshfs = reverse-sshfs ']'
++ seq 0 1
+ for f in $(seq 0 $((LIMA_CIDATA_MOUNTS - 1)))
+ mountpointvar=LIMA_CIDATA_MOUNTS_0_MOUNTPOINT
++ eval echo '$LIMA_CIDATA_MOUNTS_0_MOUNTPOINT'
+++ echo /home/testuser
+ mountpoint=/home/testuser
+ mkdir -p /home/testuser
++ id -g testuser
+ gid=1000
+ chown 1000:1000 /home/testuser
+ for f in $(seq 0 $((LIMA_CIDATA_MOUNTS - 1)))
+ mountpointvar=LIMA_CIDATA_MOUNTS_1_MOUNTPOINT
++ eval echo '$LIMA_CIDATA_MOUNTS_1_MOUNTPOINT'
+++ echo /tmp/lima
+ mountpoint=/tmp/lima
+ mkdir -p /tmp/lima
++ id -g testuser
+ gid=1000
+ chown 1000:1000 /tmp/lima
+ install -m 755 /mnt/lima-cidata/lima-guestagent /usr/local/bin/lima-guestagent
+ '[' -f /sbin/openrc-run ']'
+ rm -f /home/testuser.linux/.config/systemd/user/lima-guestagent.service
+ sudo /usr/local/bin/lima-guestagent install-systemd
time="2023-01-23T06:17:39Z" level=info msg="Written file \"/etc/systemd/system/lima-guestagent.service\""
time="2023-01-23T06:17:39Z" level=info msg="Executing: systemctl --system daemon-reload"
time="2023-01-23T06:18:40Z" level=info msg="Executing: systemctl --system enable --now lima-guestagent.service"
Created symlink /etc/systemd/system/multi-user.target.wants/lima-guestagent.service → /etc/systemd/system/lima-guestagent.service.
time="2023-01-23T06:19:41Z" level=info msg=Done
LIMA| Executing /mnt/lima-cidata/boot/30-install-packages.sh
+ INSTALL_IPTABLES=0
+ '[' '' = 1 ']'
+ '[' 1 = 1 ']'
+ INSTALL_IPTABLES=1
+ '[' 41454 -ne 0 ']'
+ INSTALL_IPTABLES=1
+ grep -qF ELF
++ command -v apt-get
+ hexdump -C -n 4 ''
hexdump: : No such file or directory
hexdump: all input file arguments failed
+ command -v dnf
+ command -v yum
+ command -v pacman
+ pkgs=
+ '[' reverse-sshfs = reverse-sshfs ']'
+ '[' 2 -gt 0 ']'
+ command -v sshfs
+ pkgs=' sshfs'
+ '[' -n ' sshfs' ']'
+ pacman -Sy --noconfirm sshfs
:: Synchronizing package databases...
 core downloading...
 extra downloading...
 community downloading...
resolving dependencies...
looking for conflicting packages...

Packages (3) fuse-common-3.13.0-1  fuse3-3.13.0-1  sshfs-3.7.3-1

Total Download Size:   0.16 MiB
Total Installed Size:  0.55 MiB

:: Proceed with installation? [Y/n] 
:: Retrieving packages...
 fuse3-3.13.0-1-x86_64 downloading...
 sshfs-3.7.3-1-x86_64 downloading...
 fuse-common-3.13.0-1-x86_64 downloading...
checking keyring...
checking package integrity...
loading package files...
checking for file conflicts...
checking available disk space...
:: Processing package changes...
installing fuse-common...
installing fuse3...
installing sshfs...
:: Running post-transaction hooks...
(1/2) Reloading device manager configuration...
(2/2) Arming ConditionNeedsUpdate...
+ SETUP_DNS=0
+ '[' -n 41454 ']'
+ '[' 41454 -ne 0 ']'
+ SETUP_DNS=1
+ '[' -n 43181 ']'
+ '[' 43181 -ne 0 ']'
+ SETUP_DNS=1
+ '[' 1 = 1 ']'
+ /mnt/lima-cidata/boot/09-host-dns-setup.sh
+ command -v iptables
+ '[' -n 41454 ']'
+ '[' 41454 -ne 0 ']'
+ iptables-save
+ grep 'udp.*192.168.5.2:41454'
-A PREROUTING -d 192.168.5.3/32 -p udp -m udp --dport 53 -j DNAT --to-destination 192.168.5.2:41454
-A OUTPUT -d 192.168.5.3/32 -p udp -m udp --dport 53 -j DNAT --to-destination 192.168.5.2:41454
+ '[' -n 43181 ']'
+ '[' 43181 -ne 0 ']'
+ iptables-save
+ grep 'tcp.*192.168.5.2:43181'
-A PREROUTING -d 192.168.5.3/32 -p tcp -m tcp --dport 53 -j DNAT --to-destination 192.168.5.2:43181
-A OUTPUT -d 192.168.5.3/32 -p tcp -m tcp --dport 53 -j DNAT --to-destination 192.168.5.2:43181
+ '[' reverse-sshfs = reverse-sshfs ']'
+ update_fuse_conf
+ '[' 2 -gt 0 ']'
+ fuse_conf=/etc/fuse.conf
+ '[' -e /etc/fuse3.conf ']'
+ grep -q '^user_allow_other' /etc/fuse.conf
+ echo user_allow_other
LIMA| Executing /mnt/lima-cidata/boot/40-install-containerd.sh
+ '[' '' '!=' 1 ']'
+ '[' 1 '!=' 1 ']'
+ command -v systemctl
++ mktemp -d
+ tmp_extract_nerdctl=/tmp/tmp.vHyn1r9u7l
+ tar Cxzf /tmp/tmp.vHyn1r9u7l /mnt/lima-cidata/nerdctl-full.tgz bin/nerdctl
+ '[' '!' -f /usr/local/bin/nerdctl ']'
+ '[' -f /usr/local/bin/nerdctl ']'
+ tar Cxzf /usr/local /mnt/lima-cidata/nerdctl-full.tgz
+ mkdir -p /etc/bash_completion.d
+ nerdctl completion bash
+ rm -rf /tmp/tmp.vHyn1r9u7l
+ : default
+ : overlayfs
+ '[' '' = 1 ']'
+ '[' 1 = 1 ']'
+ '[' '!' -e /home/testuser.linux/.config/containerd/config.toml ']'
+ mkdir -p /home/testuser.linux/.config/containerd
+ cat
+ chown -R testuser /home/testuser.linux/.config
+ selinux=
+ command -v selinuxenabled
+ '[' '!' -e /home/testuser.linux/.config/systemd/user/containerd.service ']'
+ '[' -e /run/user/1000/systemd/private ']'
+ '[' -n '' ']'
+ sudo -iu testuser XDG_RUNTIME_DIR=/run/user/1000 systemctl --user enable --now dbus
The unit files have no installation config (WantedBy=, RequiredBy=, Also=,
Alias= settings in the [Install] section, and DefaultInstance= for template
units). This means they are not meant to be enabled using systemctl.
 
Possible reasons for having this kind of units are:
• A unit may be statically enabled by being symlinked from another unit's
  .wants/ or .requires/ directory.
• A unit's purpose may be to act as a helper for some other unit which has
  a requirement dependency on it.
• A unit may be started when needed via activation (socket, path, timer,
  D-Bus, udev, scripted systemctl call, ...).
• In case of template units, the unit is meant to be enabled with some
  instance name specified.
+ sudo -iu testuser XDG_RUNTIME_DIR=/run/user/1000 PATH=/mnt/lima-cidata/util:/usr/local/sbin:/usr/local/bin:/usr/bin containerd-rootless-setuptool.sh install
�[104m�[97m[INFO]�[49m�[39m Checking RootlessKit functionality
�[104m�[97m[INFO]�[49m�[39m Checking cgroup v2
�[104m�[97m[INFO]�[49m�[39m Checking overlayfs
�[104m�[97m[INFO]�[49m�[39m Requirements are satisfied
�[104m�[97m[INFO]�[49m�[39m Creating "/home/testuser.linux/.config/systemd/user/containerd.service"
�[104m�[97m[INFO]�[49m�[39m Starting systemd unit "containerd.service"
+ systemctl --user start containerd.service
+ sleep 3
+ systemctl --user --no-pager --full status containerd.service
● containerd.service - containerd (Rootless)
     Loaded: loaded (/home/testuser.linux/.config/systemd/user/containerd.service; disabled; preset: enabled)
     Active: active (running) since Mon 2023-01-23 06:20:10 UTC; 3s ago
   Main PID: 1415 (rootlesskit)
      Tasks: 30
     Memory: 27.6M
        CPU: 645ms
     CGroup: /user.slice/user-1000.slice/[email protected]/app.slice/containerd.service
             ├─1415 rootlesskit --state-dir=/run/user/1000/containerd-rootless --net=slirp4netns --mtu=65520 --slirp4netns-sandbox=auto --slirp4netns-seccomp=auto --disable-host-loopback --port-driver=builtin --copy-up=/etc --copy-up=/run --copy-up=/var/lib --propagation=rslave /usr/local/bin/containerd-rootless.sh
             ├─1426 /proc/self/exe --state-dir=/run/user/1000/containerd-rootless --net=slirp4netns --mtu=65520 --slirp4netns-sandbox=auto --slirp4netns-seccomp=auto --disable-host-loopback --port-driver=builtin --copy-up=/etc --copy-up=/run --copy-up=/var/lib --propagation=rslave /usr/local/bin/containerd-rootless.sh
             ├─1448 slirp4netns --mtu 65520 -r 3 --disable-host-loopback --enable-sandbox --enable-seccomp 1426 tap0
             └─1456 containerd

Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.727066056Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config"
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.732969274Z" level=info msg="Start subscribing containerd event"
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733069522Z" level=info msg="Start recovering state"
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733226760Z" level=info msg="Start event monitor"
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733262549Z" level=info msg="Start snapshots syncer"
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733296133Z" level=info msg="Start cni network conf syncer for default"
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733329526Z" level=info msg="Start streaming server"
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733596952Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733699036Z" level=info msg=serving... address=/run/containerd/containerd.sock
Jan 23 06:20:11 lima-archlinux containerd-rootless.sh[1456]: time="2023-01-23T06:20:11.733743372Z" level=info msg="containerd successfully booted in 0.787714s"
+ systemctl --user enable containerd.service
Created symlink /home/testuser.linux/.config/systemd/user/default.target.wants/containerd.service → /home/testuser.linux/.config/systemd/user/containerd.service.
�[104m�[97m[INFO]�[49m�[39m Installed "containerd.service" successfully.
�[104m�[97m[INFO]�[49m�[39m To control "containerd.service", run: `systemctl --user (start|stop|restart) containerd.service`
�[104m�[97m[INFO]�[49m�[39m To run "containerd.service" on system startup automatically, run: `sudo loginctl enable-linger testuser`
�[104m�[97m[INFO]�[49m�[39m ------------------------------------------------------------------------------------------
�[104m�[97m[INFO]�[49m�[39m Use `nerdctl` to connect to the rootless containerd.
�[104m�[97m[INFO]�[49m�[39m You do NOT need to specify $CONTAINERD_ADDRESS explicitly.
+ sudo -iu testuser XDG_RUNTIME_DIR=/run/user/1000 PATH=/mnt/lima-cidata/util:/usr/local/sbin:/usr/local/bin:/usr/bin CONTAINERD_NAMESPACE=default CONTAINERD_SNAPSHOTTER=overlayfs containerd-rootless-setuptool.sh install-buildkit-containerd
�[104m�[97m[INFO]�[49m�[39m Creating "/home/testuser.linux/.config/systemd/user/default-buildkit.service"
�[104m�[97m[INFO]�[49m�[39m Starting systemd unit "default-buildkit.service"
+ systemctl --user start default-buildkit.service
+ sleep 3
+ systemctl --user --no-pager --full status default-buildkit.service
● default-buildkit.service - BuildKit (Rootless)
     Loaded: loaded (/home/testuser.linux/.config/systemd/user/default-buildkit.service; disabled; preset: enabled)
     Active: active (running) since Mon 2023-01-23 06:20:14 UTC; 3s ago
   Main PID: 1537 (buildkitd)
      Tasks: 9 (limit: 4647)
     Memory: 15.9M
        CPU: 329ms
     CGroup: /user.slice/user-1000.slice/[email protected]/app.slice/default-buildkit.service
             └─1537 buildkitd --addr=unix:///run/user/1000/buildkit-default/buildkitd.sock --root=/home/testuser.linux/.local/share/buildkit-default --containerd-worker-namespace=default --containerd-worker-snapshotter=overlayfs

Jan 23 06:20:14 lima-archlinux systemd[1079]: Started BuildKit (Rootless).
Jan 23 06:20:17 lima-archlinux containerd-rootless-setuptool.sh[1537]: time="2023-01-23T06:20:17Z" level=warning msg="git source cannot be enabled: failed to find git binary: exec: \"git\": executable file not found in $PATH"
Jan 23 06:20:17 lima-archlinux containerd-rootless-setuptool.sh[1537]: time="2023-01-23T06:20:17Z" level=info msg="found worker \"qtniq0z3byenkf730ngaw4g59\", labels=map[org.mobyproject.buildkit.worker.containerd.namespace:default org.mobyproject.buildkit.worker.containerd.uuid:87575408-e53e-4cc6-8dca-9d3b87b30663 org.mobyproject.buildkit.worker.executor:containerd org.mobyproject.buildkit.worker.hostname:lima-archlinux org.mobyproject.buildkit.worker.network:host org.mobyproject.buildkit.worker.selinux.enabled:false org.mobyproject.buildkit.worker.snapshotter:overlayfs], platforms=[linux/amd64 linux/amd64/v2 linux/amd64/v3 linux/386]"
Jan 23 06:20:17 lima-archlinux containerd-rootless-setuptool.sh[1537]: time="2023-01-23T06:20:17Z" level=info msg="found 1 workers, default=\"qtniq0z3byenkf730ngaw4g59\""
Jan 23 06:20:17 lima-archlinux containerd-rootless-setuptool.sh[1537]: time="2023-01-23T06:20:17Z" level=warning msg="currently, only the default worker can be used."
Jan 23 06:20:17 lima-archlinux containerd-rootless-setuptool.sh[1537]: time="2023-01-23T06:20:17Z" level=info msg="running server on /run/user/1000/buildkit-default/buildkitd.sock"
+ systemctl --user enable default-buildkit.service
Created symlink /home/testuser.linux/.config/systemd/user/default.target.wants/default-buildkit.service → /home/testuser.linux/.config/systemd/user/default-buildkit.service.
�[104m�[97m[INFO]�[49m�[39m Installed "default-buildkit.service" successfully.
�[104m�[97m[INFO]�[49m�[39m To control "default-buildkit.service", run: `systemctl --user (start|stop|restart) default-buildkit.service`
++ sudo -iu testuser sh -ec 'echo $CONTAINERD_SNAPSHOTTER'
+ '[' '' = fuse-overlayfs ']'
++ uname -r
+ compare_version.sh 6.0.12-arch1-1 -ge 5.13
+ sudo -iu testuser XDG_RUNTIME_DIR=/run/user/1000 PATH=/mnt/lima-cidata/util:/usr/local/sbin:/usr/local/bin:/usr/bin containerd-rootless-setuptool.sh install-stargz
�[104m�[97m[INFO]�[49m�[39m Creating "/home/testuser.linux/.config/systemd/user/stargz-snapshotter.service"
�[104m�[97m[INFO]�[49m�[39m Starting systemd unit "stargz-snapshotter.service"
+ systemctl --user start stargz-snapshotter.service
+ sleep 3
+ systemctl --user --no-pager --full status stargz-snapshotter.service
● stargz-snapshotter.service - stargz snapshotter (Rootless)
     Loaded: loaded (/home/testuser.linux/.config/systemd/user/stargz-snapshotter.service; disabled; preset: enabled)
     Active: active (running) since Mon 2023-01-23 06:20:19 UTC; 3s ago
   Main PID: 1624 (containerd-star)
      Tasks: 7 (limit: 4647)
     Memory: 10.7M
        CPU: 177ms
     CGroup: /user.slice/user-1000.slice/[email protected]/app.slice/stargz-snapshotter.service
             └─1624 containerd-stargz-grpc -address /run/user/1000/containerd-stargz-grpc/containerd-stargz-grpc.sock -root /home/testuser.linux/.local/share/containerd-stargz-grpc -config /home/testuser.linux/.config/containerd-stargz-grpc/config.toml

Jan 23 06:20:19 lima-archlinux systemd[1079]: Started stargz snapshotter (Rootless).
+ systemctl --user enable stargz-snapshotter.service
Created symlink /home/testuser.linux/.config/systemd/user/default.target.wants/stargz-snapshotter.service → /home/testuser.linux/.config/systemd/user/stargz-snapshotter.service.
�[104m�[97m[INFO]�[49m�[39m Installed "stargz-snapshotter.service" successfully.
�[104m�[97m[INFO]�[49m�[39m To control "stargz-snapshotter.service", run: `systemctl --user (start|stop|restart) stargz-snapshotter.service`
�[104m�[97m[INFO]�[49m�[39m Add the following lines to "/home/testuser.linux/.config/containerd/config.toml" manually, and then run `systemctl --user restart containerd.service`:
### BEGIN ###
[proxy_plugins]
  [proxy_plugins."stargz"]
    type = "snapshot"
    address = "/run/user/1000/containerd-stargz-grpc/containerd-stargz-grpc.sock"
###  END  ###
�[104m�[97m[INFO]�[49m�[39m Set `export CONTAINERD_SNAPSHOTTER="stargz"` to use the stargz snapshotter.
+ '[' -n '' ']'
LIMA| Exiting with code 0
Cloud-init v. 22.4.2 finished at Mon, 23 Jan 2023 06:20:22 +0000. Datasource DataSourceNoCloud [seed=/dev/sr0][dsmode=net].  Up 306.75 seconds
+ ERROR '"nerdctl info" failed'
+ echo 'TEST| [ERROR] "nerdctl info" failed'
TEST| [ERROR] "nerdctl info" failed
+ exit 1
+ eval rm -rf '"/home/testuser/lima-config-tmp";' limactl delete -f '"archlinux";' rm -f '"/home/testuser/lima-hostname"'
++ rm -rf /home/testuser/lima-config-tmp
++ limactl delete -f archlinux
time="2023-01-23T06:20:24Z" level=info msg="Sending SIGKILL to the qemu driver process 7059"
time="2023-01-23T06:20:24Z" level=info msg="Sending SIGKILL to the host agent process 7041"
time="2023-01-23T06:20:24Z" level=info msg="Removing *.pid *.sock under \"/home/testuser/.lima/archlinux\""
time="2023-01-23T06:20:24Z" level=info msg="Removing \"/home/testuser/.lima/archlinux/ga.sock\""
time="2023-01-23T06:20:24Z" level=info msg="Removing \"/home/testuser/.lima/archlinux/ha.pid\""
time="2023-01-23T06:20:24Z" level=info msg="Removing \"/home/testuser/.lima/archlinux/ha.sock\""
time="2023-01-23T06:20:24Z" level=info msg="Removing \"/home/testuser/.lima/archlinux/qemu.pid\""
time="2023-01-23T06:20:24Z" level=info msg="Removing \"/home/testuser/.lima/archlinux/qmp.sock\""
time="2023-01-23T06:20:24Z" level=info msg="Removing \"/home/testuser/.lima/archlinux/serial.sock\""
time="2023-01-23T06:20:24Z" level=info msg="Removing \"/home/testuser/.lima/archlinux/ssh.sock\""
time="2023-01-23T06:20:24Z" level=info msg="Deleted \"archlinux\" (\"/home/testuser/.lima/archlinux\")"
++ rm -f /home/testuser/lima-hostname
����������������������������������������������
@jandubois jandubois mentioned this issue Jan 31, 2023
Merged
@AkihiroSuda AkihiroSuda changed the title Frequent CI failures on archlinux Frequent CI failures on archlinux (environment variable XDG_RUNTIME_DIR is not set) Jan 31, 2023
@AkihiroSuda AkihiroSuda added bug Something isn't working guest/archlinux Guest: Arch Linux area/test Tests and CI labels Jan 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/test Tests and CI bug Something isn't working guest/archlinux Guest: Arch Linux
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jandubois @AkihiroSuda