PR #9031 - 07-17 16:24

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

599
Total Tests
563
Passed
6
Failed
30
Skipped

Failed Tests

TestCreateCluster
1h7m30.76s
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-6sk5h/create-cluster-d7mdn in 56s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-d7mdn util.go:3158: Successfully waited for HostedCluster e2e-clusters-6sk5h/create-cluster-d7mdn to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateCluster/Main
40m54.3s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-6sk5h/create-cluster-d7mdn in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s create_cluster_test.go:87: fetching mgmt kubeconfig util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-6sk5h/create-cluster-d7mdn in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s
TestCreateCluster/Main/EnsureGlobalPullSecret
22m25.31s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-6sk5h/create-cluster-d7mdn in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s util.go:2004: NodePool replicas: 1 util.go:2175: Waiting for nodes to stabilize after pull secret update util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-6sk5h/create-cluster-d7mdn-us-east-1a in 0s util.go:2207: Deleting the additional-pull-secret secret in the DataPlane util.go:2226: Waiting for nodes to stabilize after pull secret deletion util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-6sk5h/create-cluster-d7mdn-us-east-1a in 0s
TestCreateCluster/Main/EnsureGlobalPullSecret/When_management-cluster_hostedCluster.Spec.PullSecret_is_updated_in-place_it_should_propagate_to_guest_without_rollout
20m25.07s
util.go:2021: Reading management-cluster pull secret e2e-clusters-6sk5h/create-cluster-d7mdn-pull-secret util.go:2057: Patching management-cluster pull secret with dummy auth entry util.go:2062: Waiting for openshift-config/pull-secret to update in guest cluster util.go:2072: Waiting for kube-system/original-pull-secret to update in guest cluster util.go:2082: Verifying no NodePool rollout was triggered globalps.go:244: Creating kubelet config verifier DaemonSet globalps.go:249: Waiting for OVN, GlobalPullSecret, Konnectivity and kubelet config verifier DaemonSets to be ready util.go:2264: Waiting for ovnkube-node DaemonSet to be ready (min expected: 1) util.go:2294: DaemonSet ovnkube-node ready: 3/3 pods util.go:2302: ✓ ovnkube-node DaemonSet is ready util.go:2264: Waiting for global-pull-secret-syncer DaemonSet to be ready (min expected: 1) util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2294: DaemonSet global-pull-secret-syncer ready: 3/3 pods util.go:2302: ✓ global-pull-secret-syncer DaemonSet is ready util.go:2264: Waiting for konnectivity-agent DaemonSet to be ready (min expected: 1) util.go:2294: DaemonSet konnectivity-agent ready: 3/3 pods util.go:2302: ✓ konnectivity-agent DaemonSet is ready util.go:2264: Waiting for kubelet-config-verifier DaemonSet to be ready (min expected: 1) util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2270: Failed to get DaemonSet kubelet-config-verifier: context deadline exceeded globalps.go:255: Expected success, but got an error: <*fmt.wrapError | 0xc000b87a40>: failed to wait for DaemonSet kubelet-config-verifier to be ready: context deadline exceeded { msg: "failed to wait for DaemonSet kubelet-config-verifier to be ready: context deadline exceeded", err: <context.deadlineExceededError>{}, } globalps.go:222: Cleaning up kubelet config verifier resources util.go:2032: Restoring original management-cluster pull secret data
TestKarpenterUpgradeControlPlane
1h43m49.84s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-hwnzh/karpenter-upgrade-control-plane-5ct7k in 1m41s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-5ct7k upgrade_safe_check.go:87: UpgradeSafeFieldCheck: latch engaged for status.controlPlaneVersion util.go:3158: Successfully waited for HostedCluster e2e-clusters-hwnzh/karpenter-upgrade-control-plane-5ct7k to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestKarpenterUpgradeControlPlane/Main
1h9m9.74s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-hwnzh/karpenter-upgrade-control-plane-5ct7k in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s karpenter_control_plane_upgrade_test.go:57: Starting Karpenter control plane upgrade. FromImage: registry.build01.ci.openshift.org/ci-op-mm233z50/release@sha256:a9d15ae23ed23b9f5b242b35049eff2e830d9819d532643a99fa7d3f899b08f1, toImage: registry.build01.ci.openshift.org/ci-op-mm233z50/release@sha256:635e7c2ce5350f6282256206a56945411c531ade220dacb4edfa3134bddd67cc karpenter_control_plane_upgrade_test.go:68: machine-os version(s) in latest release: [9.8.20260715-1 10.2.20260715-0] karpenter_control_plane_upgrade_test.go:73: Created Karpenter NodePool karpenter_control_plane_upgrade_test.go:75: Created workloads util.go:583: Successfully waited for 1 nodes to become ready in 5m36s karpenter_test.go:1560: Successfully waited for NodeClaims to be ready in 3s karpenter_test.go:1516: Successfully waited for Pods to be scheduled on provisioned Karpenter nodes in 9s karpenter_control_plane_upgrade_test.go:82: Pre-upgrade node: ip-10-0-140-120.ec2.internal, OS image: Red Hat Enterprise Linux CoreOS 9.8.20260708-0 (Plow) karpenter_control_plane_upgrade_test.go:84: Updating cluster image. Image: registry.build01.ci.openshift.org/ci-op-mm233z50/release@sha256:635e7c2ce5350f6282256206a56945411c531ade220dacb4edfa3134bddd67cc eventually.go:105: Failed to get *v1.NodeClaim: condition Drifted not found in NodeClaim on-demand-gscsj karpenter_test.go:1611: Successfully waited for NodeClaim on-demand-gscsj to be drifted in 3s util.go:620: Successfully waited for HostedCluster e2e-clusters-hwnzh/karpenter-upgrade-control-plane-5ct7k to rollout in 18m21s karpenter_control_plane_upgrade_test.go:110: Karpenter Nodes drifted eventually.go:259: Failed to get **v1.Node: context deadline exceeded util.go:583: Failed to wait for 1 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 1 nodes, got 2 eventually.go:401: - observed **v1.Node /ip-10-0-140-120.ec2.internal invalid: expected node OS image "Red Hat Enterprise Linux CoreOS 9.8.20260708-0 (Plow)" to contain one of [9.8.20260715-1 10.2.20260715-0] util.go:583: *v1.Node /ip-10-0-140-120.ec2.internal conditions: util.go:583: MemoryPressure=False: KubeletHasSufficientMemory(kubelet has sufficient memory available) util.go:583: DiskPressure=False: KubeletHasNoDiskPressure(kubelet has no disk pressure) util.go:583: PIDPressure=False: KubeletHasSufficientPID(kubelet has sufficient PID available) util.go:583: Ready=True: KubeletReady(kubelet is posting ready status)