USHIFT-7488: scripts: prefer locally built RPMs over product repos in configure-vm.sh - #7257
Conversation
CI installs MicroShift by building RPMs from source and installing them via a --repofrompath local repository. Once microshift RPMs became available in the rhocp-4.21 product repository with a release version (e.g. 4.21.29-...) that sorts higher than the locally built nightly version, dnf silently resolved 'microshift' from the product repository instead of the local one. As a result, CI jobs tested the released RPM (pinning an outdated ovn-kubernetes image affected by OCPBUGS-105440) instead of the RPMs built from the checked-out source, causing all release-4.21 conformance jobs to permafail with 'failed to get ofport of -ex' even after the fix merged. Set the highest repository priority on the local repository so dnf always prefers the locally built RPMs regardless of version ordering. Assisted-By: Claude Fable 5
openshift-ci-robot
added
the
jira/valid-reference
|
@mkowalski: This pull request explicitly references no jira issue. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Repository: openshift/coderabbit/.coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Comment |
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: mkowalski The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
This fix is correct and addresses the root cause of the 4.21 nightly permafail. The problem: The The fix: Evidence: Confirmed by examining the This is the critical PR for unblocking the 4.21 nightly stream. Once merged, the rebase PR #7242 should also be retested — it should pass since its pinned images contain the OVN fix. Tracked in USHIFT-7489. AI-generated. Review for accuracy. |
|
@mkowalski: The following test failed, say
Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
|
/payload-job periodic-ci-openshift-microshift-release-4.21-periodics-e2e-aws-ovn-ocp-conformance |
|
@sdodson: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command
See details on https://pr-payload-tests.ci.openshift.org/runs/ci/aa4f97d0-a212-11f1-87e9-cb99bb355760-0 |
pacevedom
changed the title
4 participants
What
Set
priority=1on themicroshift-localrepository used byconfigure-vm.shso dnf always installs the locally built RPMs instead of anymicroshiftRPMs published in enabled product repositories.Why
All
release-4.21conformance CI jobs (periodics and presubmits) have been permafailing with OVN never initializing (failed to get ofport of -ex, OCPBUGS-105440) even after the ovn-kubernetes fix merged (openshift/ovn-kubernetes#3413) and is present in nightlies since4.21.0-0.nightly-2026-08-24-221323.Investigation of the failing job sosreports showed why: CI builds RPMs from the checked-out source into
_output/rpmbuildand installs them via--repofrompath, but dnf resolvedmicroshiftfromrhocp-4.21-for-rhel-9-x86_64-rpmsinstead, because the released NEVRA (4.21.29-202608170915.p0.gbc6f556) sorts higher than the locally built nightly version. Install transaction from a failing run of pull-ci-openshift-microshift-release-4.21-ocp-full-conformance-rhel-eus:That released RPM pins the pre-fix
ovn-kubernetes-microshiftimage (built 2026-08-12 fromcf07889, 44 commits behindrelease-4.21, missing the OCPBUGS-105440 fix), so the tested nodes always hit the already-fixed bug. This is also why the rebase PR #7242 cannot pass CI despite pinning a fixed image.With repository priority 1 on the local repo, dnf prefers packages from it regardless of version ordering, so CI tests what it built.
How was this tested
bash -nandshellcheckon the modified script (no new findings). Behavioral verification will come from CI on this PR: the conformance jobs should now install the source-built RPMs (which pin the fixed ovn-kubernetes image from the rebase base) — not verified locally.This PR description was generated using AI. Please verify before acting on it.
Assisted-By: Claude Fable 5