Console Output

00:04:44 [2025-03-22T00:04:44.637Z] + set -xeuo pipefail
00:04:44 [2025-03-22T00:04:44.637Z] ++ umask
00:04:44 [2025-03-22T00:04:44.637Z] + '[' 0022 = 0000 ']'
00:04:44 [2025-03-22T00:04:44.637Z] + cd /home/jenkins/agent/workspace/test-override
00:04:44 [2025-03-22T00:04:44.637Z] + cosa kola run-upgrade --rerun --allow-rerun-success=tags=needs-internet --build=latest --output-dir=/home/jenkins/agent/workspace/test-override/tmp/kola-MugF7/kola-upgrade-x86_64 --on-warn-failure-exit-77 --arch=x86_64 --upgrades
00:04:44 [2025-03-22T00:04:44.637Z] kola -p qemu --build latest run-upgrade --rerun --allow-rerun-success=tags=needs-internet --on-warn-failure-exit-77 --arch=x86_64 --output-dir /home/jenkins/agent/workspace/test-override/tmp/kola-MugF7/kola-upgrade-x86_64 --qemu-image-dir tmp/kola-qemu-cache -v --find-parent-image
00:04:44 [2025-03-22T00:04:44.637Z] 2025-03-22T00:04:44Z cli: Started logging at level INFO
00:04:44 [2025-03-22T00:04:44.637Z] 2025-03-22T00:04:44Z cli: Started logging at level INFO
00:04:44 [2025-03-22T00:04:44.890Z] Downloading image from https://builds.coreos.fedoraproject.org/prod/streams/rawhide/builds/43.20250320.91.0/x86_64/fedora-coreos-43.20250320.91.0-qemu.x86_64.qcow2.xz
00:04:44 [2025-03-22T00:04:44.890Z] Downloading signature from https://builds.coreos.fedoraproject.org/prod/streams/rawhide/builds/43.20250320.91.0/x86_64/fedora-coreos-43.20250320.91.0-qemu.x86_64.qcow2.xz.sig
00:04:46 [2025-03-22T00:04:46.242Z] Read disk 116.1 MiB/740.4 MiB (15%)
00:04:47 [2025-03-22T00:04:47.162Z] Read disk 145.2 MiB/740.4 MiB (19%)
00:04:48 [2025-03-22T00:04:48.080Z] Read disk 194.2 MiB/740.4 MiB (26%)
00:04:49 [2025-03-22T00:04:49.011Z] Read disk 220.1 MiB/740.4 MiB (29%)
00:04:49 [2025-03-22T00:04:49.931Z] Read disk 266.4 MiB/740.4 MiB (35%)
00:04:51 [2025-03-22T00:04:51.285Z] Read disk 294.0 MiB/740.4 MiB (39%)
00:04:52 [2025-03-22T00:04:52.228Z] Read disk 319.1 MiB/740.4 MiB (43%)
00:04:53 [2025-03-22T00:04:53.145Z] Read disk 348.3 MiB/740.4 MiB (47%)
00:04:54 [2025-03-22T00:04:54.063Z] Read disk 375.4 MiB/740.4 MiB (50%)
00:04:54 [2025-03-22T00:04:54.981Z] Read disk 395.7 MiB/740.4 MiB (53%)
00:04:55 [2025-03-22T00:04:55.900Z] Read disk 415.5 MiB/740.4 MiB (56%)
00:04:57 [2025-03-22T00:04:57.271Z] Read disk 443.4 MiB/740.4 MiB (59%)
00:04:58 [2025-03-22T00:04:58.191Z] Read disk 478.7 MiB/740.4 MiB (64%)
00:04:59 [2025-03-22T00:04:59.110Z] Read disk 502.7 MiB/740.4 MiB (67%)
00:05:00 [2025-03-22T00:05:00.029Z] Read disk 538.5 MiB/740.4 MiB (72%)
00:05:00 [2025-03-22T00:05:00.964Z] Read disk 568.6 MiB/740.4 MiB (76%)
00:05:01 [2025-03-22T00:05:01.885Z] Read disk 592.7 MiB/740.4 MiB (80%)
00:05:03 [2025-03-22T00:05:03.241Z] Read disk 621.6 MiB/740.4 MiB (83%)
00:05:04 [2025-03-22T00:05:04.159Z] Read disk 723.7 MiB/740.4 MiB (97%)
00:05:04 [2025-03-22T00:05:04.714Z] Read disk 740.4 MiB/740.4 MiB (100%)
00:05:04 [2025-03-22T00:05:04.714Z] Read disk 740.4 MiB/740.4 MiB (100%)
00:05:04 [2025-03-22T00:05:04.714Z] Read disk 740.4 MiB/740.4 MiB (100%)
00:05:04 [2025-03-22T00:05:04.714Z] gpg: Signature made Thu Mar 20 05:03:02 2025 UTC
00:05:04 [2025-03-22T00:05:04.714Z] gpg:                using RSA key C6E7F081CF80E13146676E88829B606631645531
00:05:04 [2025-03-22T00:05:04.714Z] gpg: Good signature from "Fedora (43) <fedora-43-primary@fedoraproject.org>" [ultimate]
00:05:14 [2025-03-22T00:05:14.634Z] tmp/kola-qemu-cache/fedora-coreos-43.20250320.91.0-qemu.x86_64.qcow2
00:05:14 [2025-03-22T00:05:14.634Z] === RUN   fcos.upgrade.basic
00:05:53 [2025-03-22T00:05:53.261Z] === RUN   fcos.upgrade.basic/setup
00:05:53 [2025-03-22T00:05:53.817Z] === RUN   fcos.upgrade.basic/upgrade-from-previous
00:16:15 [2025-03-22T00:16:15.308Z] === RUN   fcos.upgrade.basic/upgrade-from-current
00:16:16 [2025-03-22T00:16:16.241Z] --- FAIL: fcos.upgrade.basic (661.34s)
00:16:16 [2025-03-22T00:16:16.241Z]     --- PASS: fcos.upgrade.basic/setup (4.82s)
00:16:16 [2025-03-22T00:16:16.241Z]     --- FAIL: fcos.upgrade.basic/upgrade-from-previous (618.75s)
00:16:16 [2025-03-22T00:16:16.241Z]             basic.go:303: failed waiting for machine reboot: machine "d4c1315e-fa3e-4f9c-aed7-e2e7561d1fa9" failed to start: ssh journalctl failed: time limit exceeded
00:16:16 [2025-03-22T00:16:16.241Z]     --- SKIP: fcos.upgrade.basic/upgrade-from-current (0.00s)
00:16:16 [2025-03-22T00:16:16.241Z]             cluster.go:54: A previous test has already failed
00:16:16 [2025-03-22T00:16:16.241Z]         harness.go:1740: Found systemd generator failure (/usr/lib/systemd/system-generators/ostree-system-generator) on machine d4c1315e-fa3e-4f9c-aed7-e2e7561d1fa9 console
00:16:16 [2025-03-22T00:16:16.241Z] FAIL, output in /home/jenkins/agent/workspace/test-override/tmp/kola-MugF7/kola-upgrade-x86_64
00:16:16 [2025-03-22T00:16:16.241Z] 
00:16:16 [2025-03-22T00:16:16.241Z] 
00:16:16 [2025-03-22T00:16:16.241Z] ======== Re-running failed tests (flake detection) ========
00:16:16 [2025-03-22T00:16:16.241Z] 
00:16:16 [2025-03-22T00:16:16.241Z] === RUN   fcos.upgrade.basic
00:16:48 [2025-03-22T00:16:48.239Z] === RUN   fcos.upgrade.basic/setup
00:16:53 [2025-03-22T00:16:53.460Z] === RUN   fcos.upgrade.basic/upgrade-from-previous
00:27:15 [2025-03-22T00:27:15.079Z] === RUN   fcos.upgrade.basic/upgrade-from-current
00:27:15 [2025-03-22T00:27:15.998Z] --- FAIL: fcos.upgrade.basic (659.50s)
00:27:15 [2025-03-22T00:27:15.998Z]     --- PASS: fcos.upgrade.basic/setup (4.86s)
00:27:15 [2025-03-22T00:27:15.998Z]     --- FAIL: fcos.upgrade.basic/upgrade-from-previous (619.22s)
00:27:15 [2025-03-22T00:27:15.998Z]             basic.go:303: failed waiting for machine reboot: machine "a34e068e-6c71-45db-9c3d-41d417d3fb5c" failed to start: ssh journalctl failed: time limit exceeded
00:27:15 [2025-03-22T00:27:15.998Z]     --- SKIP: fcos.upgrade.basic/upgrade-from-current (0.00s)
00:27:15 [2025-03-22T00:27:15.998Z]             cluster.go:54: A previous test has already failed
00:27:15 [2025-03-22T00:27:15.998Z]         harness.go:1740: Found systemd generator failure (/usr/lib/systemd/system-generators/bootc-systemd-generator) on machine a34e068e-6c71-45db-9c3d-41d417d3fb5c console
00:27:15 [2025-03-22T00:27:15.998Z] FAIL, output in /home/jenkins/agent/workspace/test-override/tmp/kola-MugF7/kola-upgrade-x86_64/rerun
00:27:15 [2025-03-22T00:27:15.998Z] Error: harness: test suite failed
00:27:15 [2025-03-22T00:27:15.998Z] 2025-03-22T00:27:15Z cli: harness: test suite failed
00:27:15 [2025-03-22T00:27:15.998Z] failed to execute cmd-kola: exit status 1