19:53:17 [2025-11-13T19:53:17.756Z] Triggered by CI message. 19:53:17 [2025-11-13T19:53:17.758Z] Checking out git https://github.com/coreos/coreos-ci into /var/lib/jenkins/jobs/bodhi-trigger/workspace@script/1e4fe20c43e6e811f5c65301638e3ca356eacc690aa103cf9763ce056ed9ad26 to read jobs/bodhi-trigger.Jenkinsfile 19:53:17 [2025-11-13T19:53:17.759Z] The recommended git tool is: NONE 19:53:17 [2025-11-13T19:53:17.759Z] No credentials specified 19:53:17 [2025-11-13T19:53:17.760Z] > git rev-parse --resolve-git-dir /var/lib/jenkins/jobs/bodhi-trigger/workspace@script/1e4fe20c43e6e811f5c65301638e3ca356eacc690aa103cf9763ce056ed9ad26/.git # timeout=10 19:53:17 [2025-11-13T19:53:17.768Z] Fetching changes from the remote Git repository 19:53:17 [2025-11-13T19:53:17.769Z] > git config remote.origin.url https://github.com/coreos/coreos-ci # timeout=10 19:53:17 [2025-11-13T19:53:17.777Z] Fetching upstream changes from https://github.com/coreos/coreos-ci 19:53:17 [2025-11-13T19:53:17.777Z] > git --version # timeout=10 19:53:17 [2025-11-13T19:53:17.783Z] > git --version # 'git version 2.47.1' 19:53:17 [2025-11-13T19:53:17.783Z] > git fetch --tags --force --progress -- https://github.com/coreos/coreos-ci +refs/heads/*:refs/remotes/origin/* # timeout=10 19:53:17 [2025-11-13T19:53:17.903Z] > git rev-parse origin/main^{commit} # timeout=10 19:53:17 [2025-11-13T19:53:17.911Z] Checking out Revision 73431a218c32c83c8d5378c364ac11b2391f7be5 (origin/main) 19:53:17 [2025-11-13T19:53:17.911Z] > git config core.sparsecheckout # timeout=10 19:53:17 [2025-11-13T19:53:17.918Z] > git checkout -f 73431a218c32c83c8d5378c364ac11b2391f7be5 # timeout=10 19:53:17 [2025-11-13T19:53:17.927Z] Commit message: "test-override: always buildfetch" 19:53:17 [2025-11-13T19:53:17.927Z] > git rev-list --no-walk 73431a218c32c83c8d5378c364ac11b2391f7be5 # timeout=10 19:53:17 [2025-11-13T19:53:17.959Z] Loading library coreos@main 19:53:17 [2025-11-13T19:53:17.959Z] Attempting to resolve main from remote references... 19:53:17 [2025-11-13T19:53:17.959Z] > git --version # timeout=10 19:53:17 [2025-11-13T19:53:17.964Z] > git --version # 'git version 2.47.1' 19:53:17 [2025-11-13T19:53:17.964Z] > git ls-remote -- https://github.com/coreos/coreos-ci-lib.git # timeout=10 19:53:18 [2025-11-13T19:53:18.076Z] Found match: refs/heads/main revision 6a64d66a9bc5979e0ef3bcdd7ad1a05813b7a671 19:53:18 [2025-11-13T19:53:18.077Z] The recommended git tool is: NONE 19:53:18 [2025-11-13T19:53:18.077Z] No credentials specified 19:53:18 [2025-11-13T19:53:18.078Z] > git rev-parse --resolve-git-dir /var/lib/jenkins/jobs/bodhi-trigger/workspace@libs/ff60277bd48d76a282f8da417470514d8522d9eac9fc125da5f550649b50d86b/.git # timeout=10 19:53:18 [2025-11-13T19:53:18.084Z] Fetching changes from the remote Git repository 19:53:18 [2025-11-13T19:53:18.085Z] > git config remote.origin.url https://github.com/coreos/coreos-ci-lib.git # timeout=10 19:53:18 [2025-11-13T19:53:18.093Z] Fetching without tags 19:53:18 [2025-11-13T19:53:18.093Z] Fetching upstream changes from https://github.com/coreos/coreos-ci-lib.git 19:53:18 [2025-11-13T19:53:18.093Z] > git --version # timeout=10 19:53:18 [2025-11-13T19:53:18.099Z] > git --version # 'git version 2.47.1' 19:53:18 [2025-11-13T19:53:18.099Z] > git fetch --no-tags --force --progress -- https://github.com/coreos/coreos-ci-lib.git +refs/heads/*:refs/remotes/origin/* # timeout=10 19:53:18 [2025-11-13T19:53:18.211Z] Checking out Revision 6a64d66a9bc5979e0ef3bcdd7ad1a05813b7a671 (main) 19:53:18 [2025-11-13T19:53:18.211Z] > git config core.sparsecheckout # timeout=10 19:53:18 [2025-11-13T19:53:18.218Z] > git checkout -f 6a64d66a9bc5979e0ef3bcdd7ad1a05813b7a671 # timeout=10 19:53:18 [2025-11-13T19:53:18.229Z] Commit message: "cosaBuild: call `cosa osbuild` separately" 19:53:18 [2025-11-13T19:53:18.229Z] > git rev-list --no-walk 6a64d66a9bc5979e0ef3bcdd7ad1a05813b7a671 # timeout=10 19:53:18 [2025-11-13T19:53:18.301Z] [Pipeline] Start of Pipeline 19:53:18 [2025-11-13T19:53:18.325Z] [Pipeline] node 19:53:18 [2025-11-13T19:53:18.334Z] Running on Jenkins in /var/lib/jenkins/jobs/bodhi-trigger/workspace 19:53:18 [2025-11-13T19:53:18.345Z] [Pipeline] { 19:53:18 [2025-11-13T19:53:18.367Z] [Pipeline] checkout 19:53:18 [2025-11-13T19:53:18.372Z] The recommended git tool is: NONE 19:53:18 [2025-11-13T19:53:18.372Z] No credentials specified 19:53:18 [2025-11-13T19:53:18.373Z] > git rev-parse --resolve-git-dir /var/lib/jenkins/jobs/bodhi-trigger/workspace/.git # timeout=10 19:53:18 [2025-11-13T19:53:18.380Z] Fetching changes from the remote Git repository 19:53:18 [2025-11-13T19:53:18.382Z] > git config remote.origin.url https://github.com/coreos/coreos-ci # timeout=10 19:53:18 [2025-11-13T19:53:18.388Z] Fetching upstream changes from https://github.com/coreos/coreos-ci 19:53:18 [2025-11-13T19:53:18.388Z] > git --version # timeout=10 19:53:18 [2025-11-13T19:53:18.395Z] > git --version # 'git version 2.47.1' 19:53:18 [2025-11-13T19:53:18.395Z] > git fetch --tags --force --progress -- https://github.com/coreos/coreos-ci +refs/heads/*:refs/remotes/origin/* # timeout=10 19:53:18 [2025-11-13T19:53:18.497Z] > git rev-parse origin/main^{commit} # timeout=10 19:53:18 [2025-11-13T19:53:18.505Z] Checking out Revision 73431a218c32c83c8d5378c364ac11b2391f7be5 (origin/main) 19:53:18 [2025-11-13T19:53:18.505Z] > git config core.sparsecheckout # timeout=10 19:53:18 [2025-11-13T19:53:18.512Z] > git checkout -f 73431a218c32c83c8d5378c364ac11b2391f7be5 # timeout=10 19:53:18 [2025-11-13T19:53:18.520Z] Commit message: "test-override: always buildfetch" 19:53:18 [2025-11-13T19:53:18.537Z] [Pipeline] readYaml 19:53:18 [2025-11-13T19:53:18.595Z] [Pipeline] withEnv 19:53:18 [2025-11-13T19:53:18.599Z] [Pipeline] { 19:53:18 [2025-11-13T19:53:18.619Z] [Pipeline] sh 19:53:18 [2025-11-13T19:53:18.882Z] + set -xeuo pipefail 19:53:18 [2025-11-13T19:53:18.882Z] ++ umask 19:53:18 [2025-11-13T19:53:18.882Z] + '[' 0022 = 0000 ']' 19:53:18 [2025-11-13T19:53:18.882Z] + rm -rf pipe 19:53:18 [2025-11-13T19:53:18.882Z] + git clone https://github.com/coreos/fedora-coreos-pipeline --depth=1 pipe 19:53:18 [2025-11-13T19:53:18.882Z] Cloning into 'pipe'... 19:53:19 [2025-11-13T19:53:19.141Z] [Pipeline] } 19:53:19 [2025-11-13T19:53:19.163Z] [Pipeline] // withEnv 19:53:19 [2025-11-13T19:53:19.180Z] [Pipeline] load 19:53:19 [2025-11-13T19:53:19.270Z] [Pipeline] { (pipe/utils.groovy) 19:53:19 [2025-11-13T19:53:19.285Z] Did you forget the `def` keyword? Script1 seems to be setting a field named PROTECTED_JENKINSES (to a value of type LinkedHashMap) which could lead to memory leaks or other issues. 19:53:19 [2025-11-13T19:53:19.289Z] [Pipeline] } 19:53:19 [2025-11-13T19:53:19.313Z] [Pipeline] // load 19:53:19 [2025-11-13T19:53:19.320Z] Did you forget the `def` keyword? WorkflowScript seems to be setting a field named pipeutils (to a value of type Script1) which could lead to memory leaks or other issues. 19:53:19 [2025-11-13T19:53:19.329Z] [Pipeline] readYaml 19:53:19 [2025-11-13T19:53:19.345Z] Did you forget the `def` keyword? WorkflowScript seems to be setting a field named pipecfg (to a value of type LinkedHashMap) which could lead to memory leaks or other issues. 19:53:19 [2025-11-13T19:53:19.348Z] Did you forget the `def` keyword? WorkflowScript seems to be setting a field named streams (to a value of type ArrayList) which could lead to memory leaks or other issues. 19:53:19 [2025-11-13T19:53:19.348Z] Did you forget the `def` keyword? WorkflowScript seems to be setting a field named stream_to_releasever (to a value of type LinkedHashMap) which could lead to memory leaks or other issues. 19:53:19 [2025-11-13T19:53:19.361Z] [Pipeline] withEnv 19:53:19 [2025-11-13T19:53:19.366Z] [Pipeline] { 19:53:19 [2025-11-13T19:53:19.390Z] [Pipeline] sh 19:53:19 [2025-11-13T19:53:19.651Z] + set -xeuo pipefail 19:53:19 [2025-11-13T19:53:19.651Z] ++ umask 19:53:19 [2025-11-13T19:53:19.651Z] + '[' 0022 = 0000 ']' 19:53:19 [2025-11-13T19:53:19.651Z] + curl -sSLO https://raw.githubusercontent.com/coreos/fedora-coreos-config/testing-devel/manifest.yaml 19:53:19 [2025-11-13T19:53:19.665Z] [Pipeline] } 19:53:19 [2025-11-13T19:53:19.689Z] [Pipeline] // withEnv 19:53:19 [2025-11-13T19:53:19.706Z] [Pipeline] readYaml 19:53:19 [2025-11-13T19:53:19.734Z] [Pipeline] withEnv 19:53:19 [2025-11-13T19:53:19.738Z] [Pipeline] { 19:53:19 [2025-11-13T19:53:19.758Z] [Pipeline] sh 19:53:20 [2025-11-13T19:53:20.021Z] + set -xeuo pipefail 19:53:20 [2025-11-13T19:53:20.021Z] ++ umask 19:53:20 [2025-11-13T19:53:20.021Z] + '[' 0022 = 0000 ']' 19:53:20 [2025-11-13T19:53:20.021Z] + curl -sSLO https://raw.githubusercontent.com/coreos/fedora-coreos-config/rawhide/manifest.yaml 19:53:20 [2025-11-13T19:53:20.034Z] [Pipeline] } 19:53:20 [2025-11-13T19:53:20.058Z] [Pipeline] // withEnv 19:53:20 [2025-11-13T19:53:20.071Z] [Pipeline] readYaml 19:53:20 [2025-11-13T19:53:20.090Z] Did you forget the `def` keyword? WorkflowScript seems to be setting a field named releasevers (to a value of type LinkedHashSet) which could lead to memory leaks or other issues. 19:53:20 [2025-11-13T19:53:20.094Z] [Pipeline] } 19:53:20 [2025-11-13T19:53:20.119Z] [Pipeline] // node 19:53:20 [2025-11-13T19:53:20.135Z] [Pipeline] properties 19:53:20 [2025-11-13T19:53:20.151Z] [Pipeline] echo 19:53:20 [2025-11-13T19:53:20.155Z] Handling message: {"artifact":{"type":"koji-build-group","builds":[{"type":"koji-build","id":2854791,"task_id":138735530,"nvr":"android-file-transfer-4.5-4.fc44"},{"type":"koji-build","id":2858131,"task_id":138828734,"nvr":"apfs-fuse-0-31.20200928gitee71aa5.fc44"},{"type":"koji-build","id":2854792,"task_id":138735528,"nvr":"apptainer-1.4.4-2.fc44"},{"type":"koji-build","id":2858133,"task_id":138828736,"nvr":"bindfs-1.18.3-2.fc44"},{"type":"koji-build","id":2854794,"task_id":138735529,"nvr":"btrfs-fuse-0-19.20230119git812c4b7.fc44"},{"type":"koji-build","id":2854793,"task_id":138739082,"nvr":"buildbox-1.3.42-2.fc44"},{"type":"koji-build","id":2854795,"task_id":138735526,"nvr":"ceph-20.1.1-5.fc44"},{"type":"koji-build","id":2854790,"task_id":138735525,"nvr":"charliecloud-0.42-1.fc44"},{"type":"koji-build","id":2854799,"task_id":138735652,"nvr":"e2fsprogs-1.47.3-3.fc44"},{"type":"koji-build","id":2854796,"task_id":138735543,"nvr":"erofs-utils-1.8.10-3.fc44"},{"type":"koji-build","id":2860001,"task_id":138886685,"nvr":"flatpak-1.16.1-13.fc44"},{"type":"koji-build","id":2854890,"task_id":138741442,"nvr":"freerdp-3.17.2-3.fc44"},{"type":"koji-build","id":2854789,"task_id":138735199,"nvr":"fuse3-3.17.4-1.fc44"},{"type":"koji-build","id":2854855,"task_id":138739129,"nvr":"fuse-btfs-3.1-3.fc44"},{"type":"koji-build","id":2854857,"task_id":138739480,"nvr":"fuse-overlayfs-1.13-5.fc44"},{"type":"koji-build","id":2854865,"task_id":138739922,"nvr":"gnome-connections-49.0-2.fc44"},{"type":"koji-build","id":2854875,"task_id":138742374,"nvr":"gnome-remote-desktop-49.1-2.fc44"},{"type":"koji-build","id":2860064,"task_id":138888435,"nvr":"grub2-2.12-47.fc44"},{"type":"koji-build","id":2858841,"task_id":138860704,"nvr":"gvfs-1.58.0-4.fc44"},{"type":"koji-build","id":2854895,"task_id":138741762,"nvr":"kio-fuse-5.1.1-2.fc44"},{"type":"koji-build","id":2854893,"task_id":138745487,"nvr":"libnbd-1.23.10-2.fc44"},{"type":"koji-build","id":2854896,"task_id":138745488,"nvr":"libvirt-11.9.0-2.fc44"},{"type":"koji-build","id":2854898,"task_id":138741847,"nvr":"open-vm-tools-13.0.0-2.fc44"},{"type":"koji-build","id":2854899,"task_id":138742007,"nvr":"ostree-2025.6-3.fc44"},{"type":"koji-build","id":2854910,"task_id":138742543,"nvr":"partclone-0.3.38-2.fc44"},{"type":"koji-build","id":2854904,"task_id":138742073,"nvr":"qemu-10.1.2-4.fc44"},{"type":"koji-build","id":2854912,"task_id":138742553,"nvr":"wimlib-1.14.4-6.fc44"},{"type":"koji-build","id":2854915,"task_id":138742573,"nvr":"xdg-desktop-portal-1.20.3-4.fc44"},{"type":"koji-build","id":2854916,"task_id":138742580,"nvr":"xmount-1.2.0-5.fc44"},{"type":"koji-build","id":2854921,"task_id":138742647,"nvr":"xrdp-0.10.4-4.fc44"},{"type":"koji-build","id":2860074,"task_id":138888999,"nvr":"fuse-sshfs-3.7.5-2.fc44"}]},"agent":"adamwill","re-trigger":false,"update":{"autokarma":true,"autotime":true,"stable_karma":3,"stable_days":0,"unstable_karma":-3,"require_bugs":true,"require_testcases":true,"display_name":"","notes":"Update to fuse3 3.17.4. Fuse 3.17.1 bumped the SOVER, so we needed a side-tag to rebuild everything. The good news is: everything rebuilt with minimal change. Except for charliecloud, which... wasn't building at all? But there weren't bugs? I dunno, I fixed it. Oh, and there was a bug in freerdp's pkgconfig files which was already fixed upstream (and was keeping other packages from building), so I brought that patch in. Any way, everything should just keep working as it did before.\n\nFeel free to shower me with love or whiskey. Or do something nice for a stranger.\n\nP.S. I'm not planning on doing this for Fedora 43. Too much churn.\n\n\n\n\n\n","type":"bugfix","status":"testing","request":null,"severity":"unspecified","suggest":"unspecified","locked":false,"pushed":true,"critpath":true,"critpath_groups":"core critical-path-anaconda critical-path-apps critical-path-base critical-path-build critical-path-cloud critical-path-compose critical-path-coreos critical-path-gnome critical-path-kde critical-path-lxde critical-path-lxqt critical-path-server critical-path-xfce","close_bugs":true,"date_submitted":"2025-11-05 00:31:11","date_modified":"2025-11-13 19:53:14","date_approved":null,"date_testing":null,"date_stable":null,"alias":"FEDORA-2025-fb66eccf2c","test_gating_status":"failed","from_tag":"f44-build-side-122092","date_pushed":null,"meets_testing_requirements":false,"url":"https://bodhi.fedoraproject.org/updates/FEDORA-2025-fb66eccf2c","title":"android-file-transfer-4.5-4.fc44 apfs-fuse-0-31.20200928gitee71aa5.fc44 apptainer-1.4.4-2.fc44 bindfs-1.18.3-2.fc44 btrfs-fuse-0-19.20230119git812c4b7.fc44 buildbox-1.3.42-2.fc44 ceph-20.1.1-5.fc44 charliecloud-0.42-1.fc44 e2fsprogs-1.47.3-3.fc44 erofs-utils-1.8.10-3.fc44 flatpak-1.16.1-13.fc44 freerdp-3.17.2-3.fc44 fuse-btfs-3.1-3.fc44 fuse-overlayfs-1.13-5.fc44 fuse-sshfs-3.7.5-2.fc44 fuse3-3.17.4-1.fc44 gnome-connections-49.0-2.fc44 gnome-remote-desktop-49.1-2.fc44 grub2-2.12-47.fc44 gvfs-1.58.0-4.fc44 kio-fuse-5.1.1-2.fc44 libnbd-1.23.10-2.fc44 libvirt-11.9.0-2.fc44 open-vm-tools-13.0.0-2.fc44 ostree-2025.6-3.fc44 partclone-0.3.38-2.fc44 qemu-10.1.2-4.fc44 wimlib-1.14.4-6.fc44 xdg-desktop-portal-1.20.3-4.fc44 xmount-1.2.0-5.fc44 xrdp-0.10.4-4.fc44","version_hash":"6c9151563fbb08dd714d04f799e6647f8a4d456d","release":{"name":"F44","long_name":"Fedora 44","version":"44","id_prefix":"FEDORA","branch":"rawhide","dist_tag":"f44","stable_tag":"f44","testing_tag":"f44-updates-testing","candidate_tag":"f44-updates-candidate","pending_signing_tag":"f44-signing-pending","pending_testing_tag":"f44-updates-testing-pending","pending_stable_tag":"f44-updates-pending","override_tag":"f44-override","mail_template":"fedora_errata_template","state":"pending","composed_by_bodhi":false,"create_automatic_updates":true,"package_manager":"unspecified","testing_repository":null,"released_on":null,"eol":null,"critpath_mandatory_days_in_testing":0,"mandatory_days_in_testing":0,"critpath_min_karma":0,"min_karma":0,"setting_status":"pre_beta"},"user":{"name":"spot","email":"spotrh@gmail.com","id":224,"avatar":null,"openid":null,"groups":[{"name":"provenpackager"},{"name":"packager"},{"name":"arm-qa"},{"name":"cvsfedora"},{"name":"mirror-ia64"},{"name":"gitfedora-logos"},{"name":"fedorabugs"},{"name":"ambassadors"},{"name":"signed_fpca"},{"name":"openhw2012"},{"name":"paste-deleter"},{"name":"3d-printing-sig"},{"name":"cla_redhat"},{"name":"fedora-contributor"},{"name":"gitgeneric-release"},{"name":"gitmoksha"},{"name":"irc-support-operators"},{"name":"ipausers"},{"name":"r-maint-sig"}]},"comments":[{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-05 00:31:11","update_id":778301,"user_id":91,"id":4414824,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-05 00:46:33","update_id":778301,"user_id":91,"id":4414828,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-05 01:49:35","update_id":778301,"user_id":91,"id":4414870,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-05 01:49:36","update_id":778301,"user_id":91,"id":4414871,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":-1,"karma_critpath":0,"text":"As the openQA failure indicates, grub2 does not create a proper Grub menu and the only one item to select is the UEFI menu, which is not what we expect in the tests.\n\nhttps://openqa.fedoraproject.org/tests/3939191#step/_console_wait_login_2/3","timestamp":"2025-11-06 13:55:06","update_id":778301,"user_id":4049,"id":4417096,"bug_feedback":[{"karma":0,"comment_id":4417096,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4417096,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lruzicka","email":"lruzicka@redhat.com","id":4049,"avatar":null,"openid":null,"groups":[{"name":"qa-tools-sig"},{"name":"qa"},{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"},{"name":"sysadmin"},{"name":"sysadmin-qa"},{"name":"qa-admin"},{"name":"common-issues-triage"}]}},{"karma":0,"karma_critpath":0,"text":"I believe you, but... i didn't touch the grub2 code, this is just a rebuild against the newer fuse3 API. Can you open a bug against grub2?","timestamp":"2025-11-06 14:53:46","update_id":778301,"user_id":224,"id":4417155,"bug_feedback":[{"karma":0,"comment_id":4417155,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4417155,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"spot","email":"spotrh@gmail.com","id":224,"avatar":null,"openid":null,"groups":[{"name":"provenpackager"},{"name":"packager"},{"name":"arm-qa"},{"name":"cvsfedora"},{"name":"mirror-ia64"},{"name":"gitfedora-logos"},{"name":"fedorabugs"},{"name":"ambassadors"},{"name":"signed_fpca"},{"name":"openhw2012"},{"name":"paste-deleter"},{"name":"3d-printing-sig"},{"name":"cla_redhat"},{"name":"fedora-contributor"},{"name":"gitgeneric-release"},{"name":"gitmoksha"},{"name":"irc-support-operators"},{"name":"ipausers"},{"name":"r-maint-sig"}]}},{"karma":0,"karma_critpath":0,"text":"Isn't grub2 one of those special packages that only select few people can build \"correctly\", otherwise it won't get signed for secure boot?","timestamp":"2025-11-06 19:41:09","update_id":778301,"user_id":388,"id":4417381,"bug_feedback":[{"karma":0,"comment_id":4417381,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4417381,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"decathorpe","email":"decathorpe@gmail.com","id":388,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"fedorabugs"},{"name":"fedora-contributor"},{"name":"packaging-committee"},{"name":"pantheon-sig"},{"name":"multimedia-sig"},{"name":"ipausers"},{"name":"libreoffice-sig"},{"name":"rust-sig"},{"name":"diversity-pride"},{"name":"signed_fpca"},{"name":"fesco"},{"name":"cosmic-sig"},{"name":"gnome-sig"},{"name":"provenpackager"}]}},{"karma":-1,"karma_critpath":0,"text":"Yes it is, but I don't think that problem would manifest this way. I can't easily tell whether @spot has the necessary permission.\n\n@spot , *you* may not have touched the grub2 code, but it was touched. A lot. The previously tagged build was [grub2-2.12-41.fc44](https://koji.fedoraproject.org/koji/buildinfo?buildID=2804120), which was built from e02b6e88c71642ecc063ae7aefbd09b9be80d50e . Since then, there have been five committed-but-not-built changes by @lsandoval , @nfrayer and @jstancek :\n\n* [55-set-boot-entry.install: move to 95](https://src.fedoraproject.org/rpms/grub2/c/f6bc25c3e72a962cb59f568ec5fcc4dd374a9be2?branch=rawhide)\n* [gen_grub_cfgstub: Removed output messages](https://src.fedoraproject.org/rpms/grub2/c/730ce277473cc673793f79437426c1403ea47621?branch=rawhide)\n* [Include function name on debug and error print functions](https://src.fedoraproject.org/rpms/grub2/c/b9b1d1e384bc49e29f4398d0e3ac176c584684a0?branch=rawhide)\n* [Include upstream blsuki related patches](https://src.fedoraproject.org/rpms/grub2/c/4614a09b9fba8c2ebd3f52f39d9a49ecb12c4c59?branch=rawhide)\n* [Fix blsuki patch enumeration](https://src.fedoraproject.org/rpms/grub2/c/f4663b0ddc6e7b05b81bff630061838b77e725bc?branch=rawhide)\n\nso the problem is likely in one of those. grub maintainers, can you please avoid unbuilt commits? It causes problems...exactly like this.","timestamp":"2025-11-10 17:34:49","update_id":778301,"user_id":302,"id":4421987,"bug_feedback":[{"karma":0,"comment_id":4421987,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4421987,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"@lsandova\n\ncan't find the right FAS name for jstancek.","timestamp":"2025-11-10 17:35:32","update_id":778301,"user_id":302,"id":4421989,"bug_feedback":[{"karma":0,"comment_id":4421989,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4421989,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"The serial console output fortunately captures this error, which doesn't appear in the pre-update boot, or in passed tests:\n```\n00BdsDxe: loading Boot0003 \"Fedora\" from HD(1,GPT,FCCD1E98-E89E-4571-A00F-02D3BB70E0D4,0x800,0x12C000)/\\EFI\\fedora\\shimx64.efi\nBdsDxe: starting Boot0003 \"Fedora\" from HD(1,GPT,FCCD1E98-E89E-4571-A00F-02D3BB70E0D4,0x800,0x12C000)/\\EFI\\fedora\\shimx64.efi\nerror: ../../grub-core/kern/misc.c:grub_strtoull:606:unrecognized number.\n\nGRUB version 2.12\n```","timestamp":"2025-11-10 17:39:29","update_id":778301,"user_id":302,"id":4421996,"bug_feedback":[{"karma":0,"comment_id":4421996,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4421996,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"BTW, rmdepcheck also found some things that you missed rebuilding, @spot :\n```\nDependencies of other packages that would be BROKEN by the tested packages:\npackage: apfs-fuse-0-30.20200928gitee71aa5.fc43.x86_64 from https://kojipkgs.fedoraproject.org/repos/f44-build/latest/x86_64\n libfuse3.so.3()(64bit)\n libfuse3.so.3(FUSE_3.0)(64bit)\npackage: bindfs-1.18.3-1.fc44.x86_64 from https://kojipkgs.fedoraproject.org/repos/f44-build/latest/x86_64\n libfuse3.so.3()(64bit)\n libfuse3.so.3(FUSE_3.0)(64bit)\n```","timestamp":"2025-11-10 18:47:04","update_id":778301,"user_id":302,"id":4422036,"bug_feedback":[{"karma":0,"comment_id":4422036,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4422036,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"spot edited this update.\n\nNew build(s):\n\n- apfs-fuse-0-31.20200928gitee71aa5.fc44\n- bindfs-1.18.3-2.fc44\n\nKarma has been reset.","timestamp":"2025-11-11 14:15:48","update_id":778301,"user_id":91,"id":4422404,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"Added the missing deps. Still not touching grub.","timestamp":"2025-11-11 14:16:40","update_id":778301,"user_id":224,"id":4422405,"bug_feedback":[{"karma":0,"comment_id":4422405,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4422405,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"spot","email":"spotrh@gmail.com","id":224,"avatar":null,"openid":null,"groups":[{"name":"provenpackager"},{"name":"packager"},{"name":"arm-qa"},{"name":"cvsfedora"},{"name":"mirror-ia64"},{"name":"gitfedora-logos"},{"name":"fedorabugs"},{"name":"ambassadors"},{"name":"signed_fpca"},{"name":"openhw2012"},{"name":"paste-deleter"},{"name":"3d-printing-sig"},{"name":"cla_redhat"},{"name":"fedora-contributor"},{"name":"gitgeneric-release"},{"name":"gitmoksha"},{"name":"irc-support-operators"},{"name":"ipausers"},{"name":"r-maint-sig"}]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-11 14:17:44","update_id":778301,"user_id":91,"id":4422406,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-11 14:31:48","update_id":778301,"user_id":91,"id":4422411,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-11 15:22:43","update_id":778301,"user_id":91,"id":4422480,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-11 15:22:56","update_id":778301,"user_id":91,"id":4422481,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"thanks. indeed grub still broken. Guess we need the maintainers to figure out what they broke. Might need to ping them internally, not sure they read bodhi mail.","timestamp":"2025-11-11 17:05:08","update_id":778301,"user_id":302,"id":4422564,"bug_feedback":[{"karma":0,"comment_id":4422564,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4422564,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"Note this update also has at least one conflict - gvfs - with the [massive ffmpeg 8 rebuild](https://bodhi.fedoraproject.org/updates/FEDORA-2025-2a86d059f0) that is currently in-flight. that one *should* land soon, so anything in that update that is also in this update will need to be re-done in this update so it's built against both ffmpeg 8 *and* fuse 3.17.4.","timestamp":"2025-11-12 19:02:42","update_id":778301,"user_id":302,"id":4424246,"bug_feedback":[{"karma":0,"comment_id":4424246,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4424246,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"@adamwill sorry for missing the notifications on this one. Let me investigate what's going on","timestamp":"2025-11-12 19:30:56","update_id":778301,"user_id":8326,"id":4424259,"bug_feedback":[{"karma":0,"comment_id":4424259,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4424259,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lsandova","email":"lsandova@redhat.com","id":8326,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"}]}},{"karma":0,"karma_critpath":0,"text":"adamwill edited this update.\n\nNew build(s):\n\n- gvfs-1.58.0-4.fc44\n\nRemoved build(s):\n\n- gvfs-1.58.0-2.fc44\n\nKarma has been reset.","timestamp":"2025-11-12 20:02:55","update_id":778301,"user_id":91,"id":4424273,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"I did a new gvfs build.","timestamp":"2025-11-12 20:03:14","update_id":778301,"user_id":302,"id":4424274,"bug_feedback":[{"karma":0,"comment_id":4424274,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4424274,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"@adamwill, as you pointed out, we missed several unbuilds commits but in case there is mundane reason[*]. BTW, scratch builds work fine [1] so this is confusing.\n\nBelow are the related commits and perhaps 2.12-42 or 2.12-46 may have introduced this issue but I am not seeing immediately how. The rest of the patches are not related at all but of course I have to prove it.\n\nBesides the debug log provided in previous comments, is there other serial/console log to look?\n\n* Tue Nov 04 2025 Tom Callaway <spot@fedoraproject.org> - 2.12-46\n- rebuild for new fuse3\n\n* Wed Oct 15 2025 Leo Sandoval <lsandova@redhat.com> - 2.12-45\n- Include upstream blsuki related patches\n\n* Mon Sep 15 2025 Leo Sandoval <lsandova@redhat.com> - 2.12-44\n- Include function name on debug print function\n\n* Fri Aug 29 2025 Nicolas Frayer <nfrayer@redhat.com> - 2.12-43\n- gen_grub_cfgstub: Removed output messages\n\n* Wed Aug 20 2025 Jan Stancek <jstancek@redhat.com> - 2.12-42\n- move 55-set-boot-entry.install to 95\n- Related: #2389020\n\n[*] my fedpkg build hangs at some point and perhaps this has to do with my IP provider not support IPv6\n\n[1] https://koji.fedoraproject.org/koji/taskinfo?taskID=138860636","timestamp":"2025-11-12 20:04:00","update_id":778301,"user_id":8326,"id":4424275,"bug_feedback":[{"karma":0,"comment_id":4424275,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4424275,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lsandova","email":"lsandova@redhat.com","id":8326,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"}]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-12 20:04:39","update_id":778301,"user_id":91,"id":4424276,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-12 20:18:53","update_id":778301,"user_id":91,"id":4424282,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"All we really know is that after we install the grub2 update and reboot, the system (a UEFI VM) boots to the grub menu but the grub menu does not contain the expected boot menu entry for booting Fedora, instead it contains only the menu entry for running the UEFI firmware setup. And there's that `strtoull` error in the serial console log.\n\nI can hack the test up to check whether the Fedora kernel entry is actually there in the grub/bls config - I suspect it *is* and the problem is that grub is choking on parsing it for some reason so it's not showing it, but I haven't checked for sure.\n\nBeyond that, you'd have to let us know how to get grub to output more verbose debugging info, then we can hack up a test to do that. We can also try to reproduce in a local VM.","timestamp":"2025-11-12 21:02:32","update_id":778301,"user_id":302,"id":4424371,"bug_feedback":[{"karma":0,"comment_id":4424371,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4424371,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"adamwill edited this update.\n\nNew build(s):\n\n- flatpak-1.16.1-10.fc44\n\nRemoved build(s):\n\n- flatpak-1.16.1-6.fc44\n\nKarma has been reset.","timestamp":"2025-11-12 21:42:26","update_id":778301,"user_id":91,"id":4424390,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-12 21:44:12","update_id":778301,"user_id":91,"id":4424396,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-12 21:44:14","update_id":778301,"user_id":91,"id":4424397,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-12 21:50:38","update_id":778301,"user_id":91,"id":4424401,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-12 21:59:32","update_id":778301,"user_id":91,"id":4424420,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"OK, so I can reproduce this in a local UEFI (non-SB) VM. Just do a minimal Rawhide install, download the update packages, update, and reboot.\n\nThe grub config file has the `blscfg` line which should generate entries from the BLS snippets, but obviously...isn't, somehow. The BLS snippets are there.\n\nI can get to the grub console, but no idea what to do there to diagnose the problem. If I run `blscfg` nothing appears to happen - there's no output, either good or bad.\n\nPlease let me know what I can do to help diagnose the problem.","timestamp":"2025-11-12 22:31:04","update_id":778301,"user_id":302,"id":4424457,"bug_feedback":[{"karma":0,"comment_id":4424457,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4424457,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"@adamwill\n\nlet me start debugging. \n\nBTW, in case you want to debug it further, on a running system, at the prompt, type\n\n$ grub2-editenv - set debug=all,-lexer,-scripting\n\nthen reboot. That indicates high verbosity except the parsing stuff. Expect lots of log.","timestamp":"2025-11-13 15:46:03","update_id":778301,"user_id":8326,"id":4426138,"bug_feedback":[{"karma":0,"comment_id":4426138,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4426138,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lsandova","email":"lsandova@redhat.com","id":8326,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"}]}},{"karma":0,"karma_critpath":0,"text":"spot edited this update.\n\nNew build(s):\n\n- flatpak-1.16.1-13.fc44\n\nRemoved build(s):\n\n- flatpak-1.16.1-10.fc44\n\nKarma has been reset.","timestamp":"2025-11-13 17:11:49","update_id":778301,"user_id":91,"id":4426180,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-13 17:13:37","update_id":778301,"user_id":91,"id":4426182,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-13 17:29:07","update_id":778301,"user_id":91,"id":4426186,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"I got some logs for @lsandova and it seems the problem is identified now, so hopefully a fix will come soon.","timestamp":"2025-11-13 17:32:08","update_id":778301,"user_id":302,"id":4426189,"bug_feedback":[{"karma":0,"comment_id":4426189,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4426189,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-13 18:02:17","update_id":778301,"user_id":91,"id":4426240,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-13 18:02:20","update_id":778301,"user_id":91,"id":4426241,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"adamwill edited this update.\n\nNew build(s):\n\n- grub2-2.12-47.fc44\n\nRemoved build(s):\n\n- grub2-2.12-46.fc44\n\nKarma has been reset.","timestamp":"2025-11-13 19:23:48","update_id":778301,"user_id":91,"id":4426555,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"regenerated with a fixed (we hope) grub2.","timestamp":"2025-11-13 19:24:05","update_id":778301,"user_id":302,"id":4426556,"bug_feedback":[{"karma":0,"comment_id":4426556,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4426556,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'waiting'.","timestamp":"2025-11-13 19:25:30","update_id":778301,"user_id":91,"id":4426557,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"This update's test gating status has been changed to 'failed'.","timestamp":"2025-11-13 19:37:23","update_id":778301,"user_id":91,"id":4426573,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}},{"karma":0,"karma_critpath":0,"text":"ugh, now fuse-sshfs needs rebuilding again. doing it.","timestamp":"2025-11-13 19:40:49","update_id":778301,"user_id":302,"id":4426574,"bug_feedback":[{"karma":0,"comment_id":4426574,"bug_id":2346446,"bug":{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false}}],"testcase_feedback":[{"karma":0,"comment_id":4426574,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}},{"karma":0,"karma_critpath":0,"text":"adamwill edited this update.\n\nNew build(s):\n\n- fuse-sshfs-3.7.5-2.fc44\n\nRemoved build(s):\n\n- fuse-sshfs-3.7.3-13.fc44\n\nKarma has been reset.","timestamp":"2025-11-13 19:53:13","update_id":778301,"user_id":91,"id":4426585,"bug_feedback":[],"testcase_feedback":[],"user":{"name":"bodhi","email":null,"id":91,"avatar":null,"openid":null,"groups":[]}}],"builds":[{"nvr":"android-file-transfer-4.5-4.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"apfs-fuse-0-31.20200928gitee71aa5.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"apptainer-1.4.4-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"bindfs-1.18.3-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"btrfs-fuse-0-19.20230119git812c4b7.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"buildbox-1.3.42-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"ceph-20.1.1-5.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"charliecloud-0.42-1.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"e2fsprogs-1.47.3-3.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"erofs-utils-1.8.10-3.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"flatpak-1.16.1-13.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"freerdp-3.17.2-3.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"fuse3-3.17.4-1.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"fuse-btfs-3.1-3.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"fuse-overlayfs-1.13-5.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"gnome-connections-49.0-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"gnome-remote-desktop-49.1-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"grub2-2.12-47.fc44","signed":false,"release_id":93,"type":"rpm","epoch":0},{"nvr":"gvfs-1.58.0-4.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"kio-fuse-5.1.1-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"libnbd-1.23.10-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"libvirt-11.9.0-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"open-vm-tools-13.0.0-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"ostree-2025.6-3.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"partclone-0.3.38-2.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"qemu-10.1.2-4.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"wimlib-1.14.4-6.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"xdg-desktop-portal-1.20.3-4.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"xmount-1.2.0-5.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"xrdp-0.10.4-4.fc44","signed":true,"release_id":93,"type":"rpm","epoch":0},{"nvr":"fuse-sshfs-3.7.5-2.fc44","signed":false,"release_id":93,"type":"rpm","epoch":0}],"bugs":[{"bug_id":2346446,"title":"fuse3-3.17.4 is available","security":false,"parent":false,"feedback":[{"karma":0,"comment_id":4417096,"bug_id":2346446,"comment":{"karma":-1,"karma_critpath":0,"text":"As the openQA failure indicates, grub2 does not create a proper Grub menu and the only one item to select is the UEFI menu, which is not what we expect in the tests.\n\nhttps://openqa.fedoraproject.org/tests/3939191#step/_console_wait_login_2/3","timestamp":"2025-11-06 13:55:06","update_id":778301,"user_id":4049,"id":4417096,"testcase_feedback":[{"karma":0,"comment_id":4417096,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lruzicka","email":"lruzicka@redhat.com","id":4049,"avatar":null,"openid":null,"groups":[{"name":"qa-tools-sig"},{"name":"qa"},{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"},{"name":"sysadmin"},{"name":"sysadmin-qa"},{"name":"qa-admin"},{"name":"common-issues-triage"}]}}},{"karma":0,"comment_id":4417155,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"I believe you, but... i didn't touch the grub2 code, this is just a rebuild against the newer fuse3 API. Can you open a bug against grub2?","timestamp":"2025-11-06 14:53:46","update_id":778301,"user_id":224,"id":4417155,"testcase_feedback":[{"karma":0,"comment_id":4417155,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"spot","email":"spotrh@gmail.com","id":224,"avatar":null,"openid":null,"groups":[{"name":"provenpackager"},{"name":"packager"},{"name":"arm-qa"},{"name":"cvsfedora"},{"name":"mirror-ia64"},{"name":"gitfedora-logos"},{"name":"fedorabugs"},{"name":"ambassadors"},{"name":"signed_fpca"},{"name":"openhw2012"},{"name":"paste-deleter"},{"name":"3d-printing-sig"},{"name":"cla_redhat"},{"name":"fedora-contributor"},{"name":"gitgeneric-release"},{"name":"gitmoksha"},{"name":"irc-support-operators"},{"name":"ipausers"},{"name":"r-maint-sig"}]}}},{"karma":0,"comment_id":4417381,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"Isn't grub2 one of those special packages that only select few people can build \"correctly\", otherwise it won't get signed for secure boot?","timestamp":"2025-11-06 19:41:09","update_id":778301,"user_id":388,"id":4417381,"testcase_feedback":[{"karma":0,"comment_id":4417381,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"decathorpe","email":"decathorpe@gmail.com","id":388,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"fedorabugs"},{"name":"fedora-contributor"},{"name":"packaging-committee"},{"name":"pantheon-sig"},{"name":"multimedia-sig"},{"name":"ipausers"},{"name":"libreoffice-sig"},{"name":"rust-sig"},{"name":"diversity-pride"},{"name":"signed_fpca"},{"name":"fesco"},{"name":"cosmic-sig"},{"name":"gnome-sig"},{"name":"provenpackager"}]}}},{"karma":0,"comment_id":4421987,"bug_id":2346446,"comment":{"karma":-1,"karma_critpath":0,"text":"Yes it is, but I don't think that problem would manifest this way. I can't easily tell whether @spot has the necessary permission.\n\n@spot , *you* may not have touched the grub2 code, but it was touched. A lot. The previously tagged build was [grub2-2.12-41.fc44](https://koji.fedoraproject.org/koji/buildinfo?buildID=2804120), which was built from e02b6e88c71642ecc063ae7aefbd09b9be80d50e . Since then, there have been five committed-but-not-built changes by @lsandoval , @nfrayer and @jstancek :\n\n* [55-set-boot-entry.install: move to 95](https://src.fedoraproject.org/rpms/grub2/c/f6bc25c3e72a962cb59f568ec5fcc4dd374a9be2?branch=rawhide)\n* [gen_grub_cfgstub: Removed output messages](https://src.fedoraproject.org/rpms/grub2/c/730ce277473cc673793f79437426c1403ea47621?branch=rawhide)\n* [Include function name on debug and error print functions](https://src.fedoraproject.org/rpms/grub2/c/b9b1d1e384bc49e29f4398d0e3ac176c584684a0?branch=rawhide)\n* [Include upstream blsuki related patches](https://src.fedoraproject.org/rpms/grub2/c/4614a09b9fba8c2ebd3f52f39d9a49ecb12c4c59?branch=rawhide)\n* [Fix blsuki patch enumeration](https://src.fedoraproject.org/rpms/grub2/c/f4663b0ddc6e7b05b81bff630061838b77e725bc?branch=rawhide)\n\nso the problem is likely in one of those. grub maintainers, can you please avoid unbuilt commits? It causes problems...exactly like this.","timestamp":"2025-11-10 17:34:49","update_id":778301,"user_id":302,"id":4421987,"testcase_feedback":[{"karma":0,"comment_id":4421987,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4421989,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"@lsandova\n\ncan't find the right FAS name for jstancek.","timestamp":"2025-11-10 17:35:32","update_id":778301,"user_id":302,"id":4421989,"testcase_feedback":[{"karma":0,"comment_id":4421989,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4421996,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"The serial console output fortunately captures this error, which doesn't appear in the pre-update boot, or in passed tests:\n```\n00BdsDxe: loading Boot0003 \"Fedora\" from HD(1,GPT,FCCD1E98-E89E-4571-A00F-02D3BB70E0D4,0x800,0x12C000)/\\EFI\\fedora\\shimx64.efi\nBdsDxe: starting Boot0003 \"Fedora\" from HD(1,GPT,FCCD1E98-E89E-4571-A00F-02D3BB70E0D4,0x800,0x12C000)/\\EFI\\fedora\\shimx64.efi\nerror: ../../grub-core/kern/misc.c:grub_strtoull:606:unrecognized number.\n\nGRUB version 2.12\n```","timestamp":"2025-11-10 17:39:29","update_id":778301,"user_id":302,"id":4421996,"testcase_feedback":[{"karma":0,"comment_id":4421996,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4422036,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"BTW, rmdepcheck also found some things that you missed rebuilding, @spot :\n```\nDependencies of other packages that would be BROKEN by the tested packages:\npackage: apfs-fuse-0-30.20200928gitee71aa5.fc43.x86_64 from https://kojipkgs.fedoraproject.org/repos/f44-build/latest/x86_64\n libfuse3.so.3()(64bit)\n libfuse3.so.3(FUSE_3.0)(64bit)\npackage: bindfs-1.18.3-1.fc44.x86_64 from https://kojipkgs.fedoraproject.org/repos/f44-build/latest/x86_64\n libfuse3.so.3()(64bit)\n libfuse3.so.3(FUSE_3.0)(64bit)\n```","timestamp":"2025-11-10 18:47:04","update_id":778301,"user_id":302,"id":4422036,"testcase_feedback":[{"karma":0,"comment_id":4422036,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4422405,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"Added the missing deps. Still not touching grub.","timestamp":"2025-11-11 14:16:40","update_id":778301,"user_id":224,"id":4422405,"testcase_feedback":[{"karma":0,"comment_id":4422405,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"spot","email":"spotrh@gmail.com","id":224,"avatar":null,"openid":null,"groups":[{"name":"provenpackager"},{"name":"packager"},{"name":"arm-qa"},{"name":"cvsfedora"},{"name":"mirror-ia64"},{"name":"gitfedora-logos"},{"name":"fedorabugs"},{"name":"ambassadors"},{"name":"signed_fpca"},{"name":"openhw2012"},{"name":"paste-deleter"},{"name":"3d-printing-sig"},{"name":"cla_redhat"},{"name":"fedora-contributor"},{"name":"gitgeneric-release"},{"name":"gitmoksha"},{"name":"irc-support-operators"},{"name":"ipausers"},{"name":"r-maint-sig"}]}}},{"karma":0,"comment_id":4422564,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"thanks. indeed grub still broken. Guess we need the maintainers to figure out what they broke. Might need to ping them internally, not sure they read bodhi mail.","timestamp":"2025-11-11 17:05:08","update_id":778301,"user_id":302,"id":4422564,"testcase_feedback":[{"karma":0,"comment_id":4422564,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4424246,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"Note this update also has at least one conflict - gvfs - with the [massive ffmpeg 8 rebuild](https://bodhi.fedoraproject.org/updates/FEDORA-2025-2a86d059f0) that is currently in-flight. that one *should* land soon, so anything in that update that is also in this update will need to be re-done in this update so it's built against both ffmpeg 8 *and* fuse 3.17.4.","timestamp":"2025-11-12 19:02:42","update_id":778301,"user_id":302,"id":4424246,"testcase_feedback":[{"karma":0,"comment_id":4424246,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4424259,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"@adamwill sorry for missing the notifications on this one. Let me investigate what's going on","timestamp":"2025-11-12 19:30:56","update_id":778301,"user_id":8326,"id":4424259,"testcase_feedback":[{"karma":0,"comment_id":4424259,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lsandova","email":"lsandova@redhat.com","id":8326,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"}]}}},{"karma":0,"comment_id":4424274,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"I did a new gvfs build.","timestamp":"2025-11-12 20:03:14","update_id":778301,"user_id":302,"id":4424274,"testcase_feedback":[{"karma":0,"comment_id":4424274,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4424275,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"@adamwill, as you pointed out, we missed several unbuilds commits but in case there is mundane reason[*]. BTW, scratch builds work fine [1] so this is confusing.\n\nBelow are the related commits and perhaps 2.12-42 or 2.12-46 may have introduced this issue but I am not seeing immediately how. The rest of the patches are not related at all but of course I have to prove it.\n\nBesides the debug log provided in previous comments, is there other serial/console log to look?\n\n* Tue Nov 04 2025 Tom Callaway <spot@fedoraproject.org> - 2.12-46\n- rebuild for new fuse3\n\n* Wed Oct 15 2025 Leo Sandoval <lsandova@redhat.com> - 2.12-45\n- Include upstream blsuki related patches\n\n* Mon Sep 15 2025 Leo Sandoval <lsandova@redhat.com> - 2.12-44\n- Include function name on debug print function\n\n* Fri Aug 29 2025 Nicolas Frayer <nfrayer@redhat.com> - 2.12-43\n- gen_grub_cfgstub: Removed output messages\n\n* Wed Aug 20 2025 Jan Stancek <jstancek@redhat.com> - 2.12-42\n- move 55-set-boot-entry.install to 95\n- Related: #2389020\n\n[*] my fedpkg build hangs at some point and perhaps this has to do with my IP provider not support IPv6\n\n[1] https://koji.fedoraproject.org/koji/taskinfo?taskID=138860636","timestamp":"2025-11-12 20:04:00","update_id":778301,"user_id":8326,"id":4424275,"testcase_feedback":[{"karma":0,"comment_id":4424275,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lsandova","email":"lsandova@redhat.com","id":8326,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"}]}}},{"karma":0,"comment_id":4424371,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"All we really know is that after we install the grub2 update and reboot, the system (a UEFI VM) boots to the grub menu but the grub menu does not contain the expected boot menu entry for booting Fedora, instead it contains only the menu entry for running the UEFI firmware setup. And there's that `strtoull` error in the serial console log.\n\nI can hack the test up to check whether the Fedora kernel entry is actually there in the grub/bls config - I suspect it *is* and the problem is that grub is choking on parsing it for some reason so it's not showing it, but I haven't checked for sure.\n\nBeyond that, you'd have to let us know how to get grub to output more verbose debugging info, then we can hack up a test to do that. We can also try to reproduce in a local VM.","timestamp":"2025-11-12 21:02:32","update_id":778301,"user_id":302,"id":4424371,"testcase_feedback":[{"karma":0,"comment_id":4424371,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4424457,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"OK, so I can reproduce this in a local UEFI (non-SB) VM. Just do a minimal Rawhide install, download the update packages, update, and reboot.\n\nThe grub config file has the `blscfg` line which should generate entries from the BLS snippets, but obviously...isn't, somehow. The BLS snippets are there.\n\nI can get to the grub console, but no idea what to do there to diagnose the problem. If I run `blscfg` nothing appears to happen - there's no output, either good or bad.\n\nPlease let me know what I can do to help diagnose the problem.","timestamp":"2025-11-12 22:31:04","update_id":778301,"user_id":302,"id":4424457,"testcase_feedback":[{"karma":0,"comment_id":4424457,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4426138,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"@adamwill\n\nlet me start debugging. \n\nBTW, in case you want to debug it further, on a running system, at the prompt, type\n\n$ grub2-editenv - set debug=all,-lexer,-scripting\n\nthen reboot. That indicates high verbosity except the parsing stuff. Expect lots of log.","timestamp":"2025-11-13 15:46:03","update_id":778301,"user_id":8326,"id":4426138,"testcase_feedback":[{"karma":0,"comment_id":4426138,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"lsandova","email":"lsandova@redhat.com","id":8326,"avatar":null,"openid":null,"groups":[{"name":"packager"},{"name":"ipausers"},{"name":"fedora-contributor"},{"name":"signed_fpca"},{"name":"fedorabugs"}]}}},{"karma":0,"comment_id":4426189,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"I got some logs for @lsandova and it seems the problem is identified now, so hopefully a fix will come soon.","timestamp":"2025-11-13 17:32:08","update_id":778301,"user_id":302,"id":4426189,"testcase_feedback":[{"karma":0,"comment_id":4426189,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4426556,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"regenerated with a fixed (we hope) grub2.","timestamp":"2025-11-13 19:24:05","update_id":778301,"user_id":302,"id":4426556,"testcase_feedback":[{"karma":0,"comment_id":4426556,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}},{"karma":0,"comment_id":4426574,"bug_id":2346446,"comment":{"karma":0,"karma_critpath":0,"text":"ugh, now fuse-sshfs needs rebuilding again. doing it.","timestamp":"2025-11-13 19:40:49","update_id":778301,"user_id":302,"id":4426574,"testcase_feedback":[{"karma":0,"comment_id":4426574,"testcase_id":575,"testcase":{"name":"QA:Testcase e2fsprogs","id":575}}],"user":{"name":"adamwill","email":"awilliam@redhat.com","id":302,"avatar":null,"openid":null,"groups":[{"name":"proventesters"},{"name":"provenpackager"},{"name":"packager"},{"name":"qa-tools-sig"},{"name":"fedora-contributor"},{"name":"news"},{"name":"gittriage"},{"name":"sysadmin"},{"name":"gitspin-kickstarts"},{"name":"signed_fpca"},{"name":"gitgeneric-release"},{"name":"yak_farmers"},{"name":"triagers"},{"name":"qa"},{"name":"sysadmin-qa"},{"name":"fedorabugs"},{"name":"ipausers"},{"name":"gitmkinitrd"},{"name":"qa-admin"},{"name":"server-wg"},{"name":"forge-cle-members"},{"name":"aws-qa"},{"name":"change-wranglers"},{"name":"fedora-ci-admins"},{"name":"common-issues-triage"},{"name":"sysadmin-main"},{"name":"program-management"},{"name":"gitfedora-project-schedule"},{"name":"forge-atomic-desktops-members"}]}}}]}],"updateid":"FEDORA-2025-fb66eccf2c","karma":0,"content_type":"rpm","test_cases":[{"name":"QA:Testcase e2fsprogs","id":575}]}} 19:53:20 [2025-11-13T19:53:20.165Z] [Pipeline] readJSON 19:53:20 [2025-11-13T19:53:20.279Z] [Pipeline] libraryResource 19:53:20 [2025-11-13T19:53:20.290Z] [Pipeline] readJSON 19:53:20 [2025-11-13T19:53:20.342Z] [Pipeline] node 19:53:20 [2025-11-13T19:53:20.351Z] Running on Jenkins in /var/lib/jenkins/jobs/bodhi-trigger/workspace 19:53:20 [2025-11-13T19:53:20.388Z] [Pipeline] { 19:53:20 [2025-11-13T19:53:20.435Z] [Pipeline] writeYaml 19:53:20 [2025-11-13T19:53:20.483Z] [Pipeline] readFile 19:53:20 [2025-11-13T19:53:20.527Z] [Pipeline] } 19:53:20 [2025-11-13T19:53:20.620Z] [Pipeline] // node 19:53:20 [2025-11-13T19:53:20.639Z] [Pipeline] podTemplate 19:53:20 [2025-11-13T19:53:20.643Z] [Pipeline] { 19:53:20 [2025-11-13T19:53:20.691Z] [Pipeline] node 19:53:35 [2025-11-13T19:53:35.695Z] Still waiting to schedule task 19:53:35 [2025-11-13T19:53:35.695Z] All nodes of label ‘pod-915e8da4-ab7a-4d86-8932-06652e868669’ are offline 23:15:52 [2025-11-13T23:15:52.144Z] Created Pod: openshift coreos-ci/pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w 23:15:52 [2025-11-13T23:15:52.193Z] [PodInfo] coreos-ci/pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w 23:15:52 [2025-11-13T23:15:52.193Z] Container [jnlp] waiting [ContainerCreating] No message 23:15:52 [2025-11-13T23:15:52.193Z] Container [worker] waiting [ContainerCreating] No message 23:15:52 [2025-11-13T23:15:52.193Z] Pod [Pending][ContainersNotReady] containers with unready status: [worker jnlp] 23:15:52 [2025-11-13T23:15:52.779Z] [PodInfo] coreos-ci/pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w 23:15:52 [2025-11-13T23:15:52.779Z] Container [jnlp] waiting [ContainerCreating] No message 23:15:52 [2025-11-13T23:15:52.779Z] Container [worker] waiting [ContainerCreating] No message 23:15:52 [2025-11-13T23:15:52.779Z] Pod [Pending][ContainersNotReady] containers with unready status: [worker jnlp] 23:15:54 [2025-11-13T23:15:54.205Z] [PodInfo] coreos-ci/pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w 23:15:54 [2025-11-13T23:15:54.205Z] Container [jnlp] waiting [ContainerCreating] No message 23:15:54 [2025-11-13T23:15:54.205Z] Container [worker] waiting [ContainerCreating] No message 23:15:54 [2025-11-13T23:15:54.205Z] Pod [Pending][ContainersNotReady] containers with unready status: [worker jnlp] 23:15:56 [2025-11-13T23:15:56.497Z] Agent pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w is provisioned from template pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52 23:15:56 [2025-11-13T23:15:56.498Z] --- 23:15:56 [2025-11-13T23:15:56.498Z] apiVersion: "v1" 23:15:56 [2025-11-13T23:15:56.498Z] kind: "Pod" 23:15:56 [2025-11-13T23:15:56.498Z] metadata: 23:15:56 [2025-11-13T23:15:56.498Z] annotations: 23:15:56 [2025-11-13T23:15:56.498Z] kubernetes.jenkins.io/last-refresh: "1763075752124" 23:15:56 [2025-11-13T23:15:56.498Z] buildUrl: "http://172.30.177.66:80/job/bodhi-trigger/413/" 23:15:56 [2025-11-13T23:15:56.498Z] runUrl: "job/bodhi-trigger/413/" 23:15:56 [2025-11-13T23:15:56.498Z] labels: 23:15:56 [2025-11-13T23:15:56.498Z] jenkins: "slave" 23:15:56 [2025-11-13T23:15:56.498Z] jenkins/label-digest: "c6fe07099b4022cd98d01c1a8a7852ccd79e7ca8" 23:15:56 [2025-11-13T23:15:56.498Z] jenkins/label: "pod-915e8da4-ab7a-4d86-8932-06652e868669" 23:15:56 [2025-11-13T23:15:56.498Z] kubernetes.jenkins.io/controller: "http___172_30_177_66_80x" 23:15:56 [2025-11-13T23:15:56.498Z] name: "pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w" 23:15:56 [2025-11-13T23:15:56.498Z] namespace: "coreos-ci" 23:15:56 [2025-11-13T23:15:56.498Z] spec: 23:15:56 [2025-11-13T23:15:56.498Z] containers: 23:15:56 [2025-11-13T23:15:56.498Z] - command: 23:15:56 [2025-11-13T23:15:56.498Z] - "/usr/bin/dumb-init" 23:15:56 [2025-11-13T23:15:56.498Z] - "/usr/bin/sleep" 23:15:56 [2025-11-13T23:15:56.498Z] - "infinity" 23:15:56 [2025-11-13T23:15:56.498Z] env: 23:15:56 [2025-11-13T23:15:56.498Z] - name: "NCPUS" 23:15:56 [2025-11-13T23:15:56.498Z] value: "0.1" 23:15:56 [2025-11-13T23:15:56.498Z] image: "quay.io/coreos-assembler/coreos-assembler:main" 23:15:56 [2025-11-13T23:15:56.498Z] imagePullPolicy: "Always" 23:15:56 [2025-11-13T23:15:56.498Z] name: "worker" 23:15:56 [2025-11-13T23:15:56.498Z] resources: 23:15:56 [2025-11-13T23:15:56.498Z] limits: 23:15:56 [2025-11-13T23:15:56.498Z] cpu: "0.1" 23:15:56 [2025-11-13T23:15:56.498Z] requests: 23:15:56 [2025-11-13T23:15:56.498Z] cpu: "0.1" 23:15:56 [2025-11-13T23:15:56.498Z] volumeMounts: 23:15:56 [2025-11-13T23:15:56.498Z] - mountPath: "/srv/" 23:15:56 [2025-11-13T23:15:56.498Z] name: "emptydir-0" 23:15:56 [2025-11-13T23:15:56.498Z] - mountPath: "/home/jenkins/agent" 23:15:56 [2025-11-13T23:15:56.498Z] name: "workspace-volume" 23:15:56 [2025-11-13T23:15:56.498Z] readOnly: false 23:15:56 [2025-11-13T23:15:56.498Z] - env: 23:15:56 [2025-11-13T23:15:56.498Z] - name: "JENKINS_SECRET" 23:15:56 [2025-11-13T23:15:56.498Z] value: "********" 23:15:56 [2025-11-13T23:15:56.498Z] - name: "JENKINS_TUNNEL" 23:15:56 [2025-11-13T23:15:56.498Z] value: "172.30.178.247:50000" 23:15:56 [2025-11-13T23:15:56.498Z] - name: "JENKINS_AGENT_NAME" 23:15:56 [2025-11-13T23:15:56.498Z] value: "pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w" 23:15:56 [2025-11-13T23:15:56.498Z] - name: "REMOTING_OPTS" 23:15:56 [2025-11-13T23:15:56.498Z] value: "-noReconnectAfter 1d" 23:15:56 [2025-11-13T23:15:56.498Z] - name: "JENKINS_NAME" 23:15:56 [2025-11-13T23:15:56.498Z] value: "pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w" 23:15:56 [2025-11-13T23:15:56.498Z] - name: "JENKINS_AGENT_WORKDIR" 23:15:56 [2025-11-13T23:15:56.498Z] value: "/home/jenkins/agent" 23:15:56 [2025-11-13T23:15:56.498Z] - name: "JENKINS_URL" 23:15:56 [2025-11-13T23:15:56.498Z] value: "http://172.30.177.66:80/" 23:15:56 [2025-11-13T23:15:56.498Z] image: "jenkins-agent-base:latest" 23:15:56 [2025-11-13T23:15:56.498Z] name: "jnlp" 23:15:56 [2025-11-13T23:15:56.498Z] resources: 23:15:56 [2025-11-13T23:15:56.498Z] limits: 23:15:56 [2025-11-13T23:15:56.498Z] memory: "512Mi" 23:15:56 [2025-11-13T23:15:56.498Z] cpu: "1" 23:15:56 [2025-11-13T23:15:56.498Z] requests: 23:15:56 [2025-11-13T23:15:56.498Z] memory: "512Mi" 23:15:56 [2025-11-13T23:15:56.498Z] cpu: "1" 23:15:56 [2025-11-13T23:15:56.498Z] volumeMounts: 23:15:56 [2025-11-13T23:15:56.498Z] - mountPath: "/home/jenkins/agent" 23:15:56 [2025-11-13T23:15:56.498Z] name: "workspace-volume" 23:15:56 [2025-11-13T23:15:56.498Z] readOnly: false 23:15:56 [2025-11-13T23:15:56.498Z] nodeSelector: 23:15:56 [2025-11-13T23:15:56.498Z] kubernetes.io/os: "linux" 23:15:56 [2025-11-13T23:15:56.498Z] restartPolicy: "Never" 23:15:56 [2025-11-13T23:15:56.498Z] serviceAccountName: "default" 23:15:56 [2025-11-13T23:15:56.498Z] volumes: 23:15:56 [2025-11-13T23:15:56.498Z] - emptyDir: {} 23:15:56 [2025-11-13T23:15:56.498Z] name: "emptydir-0" 23:15:56 [2025-11-13T23:15:56.498Z] - emptyDir: 23:15:56 [2025-11-13T23:15:56.498Z] medium: "" 23:15:56 [2025-11-13T23:15:56.498Z] name: "workspace-volume" 23:15:56 [2025-11-13T23:15:56.498Z] 23:15:56 [2025-11-13T23:15:56.517Z] Running on pod-915e8da4-ab7a-4d86-8932-06652e868669-g6c52-c9h6w in /home/jenkins/agent/workspace/bodhi-trigger 23:15:56 [2025-11-13T23:15:56.526Z] [Pipeline] { 23:15:56 [2025-11-13T23:15:56.577Z] [Pipeline] container 23:15:56 [2025-11-13T23:15:56.582Z] [Pipeline] { 23:15:56 [2025-11-13T23:15:56.636Z] [Pipeline] withEnv 23:15:56 [2025-11-13T23:15:56.640Z] [Pipeline] { 23:15:56 [2025-11-13T23:15:56.685Z] [Pipeline] sh 23:15:57 [2025-11-13T23:15:57.575Z] + set -xeuo pipefail 23:15:57 [2025-11-13T23:15:57.575Z] ++ umask 23:15:57 [2025-11-13T23:15:57.575Z] + '[' 0022 = 0000 ']' 23:15:57 [2025-11-13T23:15:57.575Z] + cat /cosa/coreos-assembler-git.json 23:15:57 [2025-11-13T23:15:57.575Z] + tee coreos-assembler-git.json 23:15:57 [2025-11-13T23:15:57.831Z] { 23:15:57 [2025-11-13T23:15:57.831Z] "date": "2025-11-11T21:38:38Z", 23:15:57 [2025-11-13T23:15:57.831Z] "git": { 23:15:57 [2025-11-13T23:15:57.831Z] "commit": "fb6410e1415f2f73dc57a97dc82a22283cbf20f6", 23:15:57 [2025-11-13T23:15:57.831Z] "origin": "https://github.com/coreos/coreos-assembler.git", 23:15:57 [2025-11-13T23:15:57.831Z] "branch": "HEAD", 23:15:57 [2025-11-13T23:15:57.831Z] "dirty": "false" 23:15:57 [2025-11-13T23:15:57.831Z] }, 23:15:57 [2025-11-13T23:15:57.831Z] "file": { 23:15:57 [2025-11-13T23:15:57.831Z] "checksum": "306ac08f59c193aff8289f678f89c93be9de3f345cfe2eeebcf7b66ff77995fe", 23:15:57 [2025-11-13T23:15:57.831Z] "checksum_type": "sha256", 23:15:57 [2025-11-13T23:15:57.831Z] "format": "tar.gz", 23:15:57 [2025-11-13T23:15:57.831Z] "name": "coreos-assembler-git.tar.gz", 23:15:57 [2025-11-13T23:15:57.831Z] "size": "13274736" 23:15:57 [2025-11-13T23:15:57.831Z] } 23:15:57 [2025-11-13T23:15:57.831Z] } 23:15:57 [2025-11-13T23:15:57.869Z] [Pipeline] } 23:15:57 [2025-11-13T23:15:57.942Z] [Pipeline] // withEnv 23:15:57 [2025-11-13T23:15:57.963Z] [Pipeline] archiveArtifacts 23:15:57 [2025-11-13T23:15:57.971Z] Archiving artifacts 23:15:58 [2025-11-13T23:15:58.393Z] [Pipeline] withEnv 23:15:58 [2025-11-13T23:15:58.398Z] [Pipeline] { 23:15:58 [2025-11-13T23:15:58.446Z] [Pipeline] sh 23:15:59 [2025-11-13T23:15:59.609Z] + set -xeuo pipefail 23:15:59 [2025-11-13T23:15:59.610Z] ++ umask 23:15:59 [2025-11-13T23:15:59.610Z] + '[' 0022 = 0000 ']' 23:15:59 [2025-11-13T23:15:59.610Z] + rpm -qa 23:15:59 [2025-11-13T23:15:59.610Z] + sort 23:16:02 [2025-11-13T23:16:02.134Z] [Pipeline] } 23:16:02 [2025-11-13T23:16:02.204Z] [Pipeline] // withEnv 23:16:02 [2025-11-13T23:16:02.219Z] [Pipeline] archiveArtifacts 23:16:02 [2025-11-13T23:16:02.229Z] Archiving artifacts 23:16:02 [2025-11-13T23:16:02.272Z] [Pipeline] withEnv 23:16:02 [2025-11-13T23:16:02.277Z] [Pipeline] { 23:16:02 [2025-11-13T23:16:02.324Z] [Pipeline] sh 23:16:03 [2025-11-13T23:16:03.482Z] + set -xeuo pipefail 23:16:03 [2025-11-13T23:16:03.482Z] ++ umask 23:16:03 [2025-11-13T23:16:03.482Z] + '[' 0022 = 0000 ']' 23:16:03 [2025-11-13T23:16:03.482Z] + rm coreos-assembler-git.json coreos-assembler-rpmdb.txt 23:16:03 [2025-11-13T23:16:03.518Z] [Pipeline] } 23:16:03 [2025-11-13T23:16:03.585Z] [Pipeline] // withEnv 23:16:03 [2025-11-13T23:16:03.603Z] [Pipeline] stage 23:16:03 [2025-11-13T23:16:03.607Z] [Pipeline] { (Trigger Test) 23:16:03 [2025-11-13T23:16:03.658Z] [Pipeline] build 23:16:03 [2025-11-13T23:16:03.663Z] Scheduling project: test-override 23:16:03 [2025-11-13T23:16:03.671Z] [Pipeline] } 23:16:03 [2025-11-13T23:16:03.742Z] [Pipeline] // stage 23:16:03 [2025-11-13T23:16:03.757Z] [Pipeline] } 23:16:03 [2025-11-13T23:16:03.825Z] [Pipeline] // container 23:16:03 [2025-11-13T23:16:03.837Z] [Pipeline] } 23:16:03 [2025-11-13T23:16:03.941Z] [Pipeline] // node 23:16:03 [2025-11-13T23:16:03.953Z] [Pipeline] } 23:16:04 [2025-11-13T23:16:04.021Z] [Pipeline] // podTemplate 23:16:04 [2025-11-13T23:16:04.033Z] [Pipeline] End of Pipeline 23:16:04 [2025-11-13T23:16:04.062Z] Finished: SUCCESS