PR #8996 - 07-15 08:23

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

556
Total Tests
520
Passed
7
Failed
29
Skipped

Failed Tests

TestCreateCluster
1h5m58.66s
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-q4m9w/create-cluster-xgj8s in 58s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-xgj8s util.go:3158: Successfully waited for HostedCluster e2e-clusters-q4m9w/create-cluster-xgj8s to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateCluster/Main
40m10.99s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-q4m9w/create-cluster-xgj8s in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s create_cluster_test.go:87: fetching mgmt kubeconfig util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-q4m9w/create-cluster-xgj8s in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s
TestCreateCluster/Main/EnsureGlobalPullSecret
22m15.38s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-q4m9w/create-cluster-xgj8s in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 25ms util.go:2004: NodePool replicas: 1 util.go:2175: Waiting for nodes to stabilize after pull secret update util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-q4m9w/create-cluster-xgj8s-us-east-1a in 0s util.go:2207: Deleting the additional-pull-secret secret in the DataPlane util.go:2226: Waiting for nodes to stabilize after pull secret deletion util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-q4m9w/create-cluster-xgj8s-us-east-1a in 0s
TestCreateCluster/Main/EnsureGlobalPullSecret/When_management-cluster_hostedCluster.Spec.PullSecret_is_updated_in-place_it_should_propagate_to_guest_without_rollout
20m5.1s
util.go:2021: Reading management-cluster pull secret e2e-clusters-q4m9w/create-cluster-xgj8s-pull-secret util.go:2057: Patching management-cluster pull secret with dummy auth entry util.go:2062: Waiting for openshift-config/pull-secret to update in guest cluster util.go:2072: Waiting for kube-system/original-pull-secret to update in guest cluster util.go:2082: Verifying no NodePool rollout was triggered globalps.go:244: Creating kubelet config verifier DaemonSet globalps.go:249: Waiting for OVN, GlobalPullSecret, Konnectivity and kubelet config verifier DaemonSets to be ready util.go:2264: Waiting for ovnkube-node DaemonSet to be ready (min expected: 1) util.go:2294: DaemonSet ovnkube-node ready: 3/3 pods util.go:2302: ✓ ovnkube-node DaemonSet is ready util.go:2264: Waiting for global-pull-secret-syncer DaemonSet to be ready (min expected: 1) util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready globalps.go:252: Expected success, but got an error: <*fmt.wrapError | 0xc004002100>: failed to wait for DaemonSet global-pull-secret-syncer to be ready: context deadline exceeded { msg: "failed to wait for DaemonSet global-pull-secret-syncer to be ready: context deadline exceeded", err: <context.deadlineExceededError>{}, } globalps.go:222: Cleaning up kubelet config verifier resources util.go:2032: Restoring original management-cluster pull secret data
TestCreateClusterHABreakGlassCredentials
1m44.19s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: cannot create VPC S3 endpoint: operation error EC2: CreateVpcEndpoint, exceeded maximum number of attempts, 11, https response error StatusCode: 503, RequestID: 870ebb45-53f6-4f5a-8f0d-67bee3a5038a, api error RequestLimitExceeded: Request limit exceeded. Account 820196288204 has been throttled on ec2:CreateVpcEndpoint because it exceeded its request rate limit. fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "ha-break-glass-creds-t6dzd" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-cs7ln, name: ha-break-glass-creds-t6dzd
TestKarpenterUpgradeControlPlane
1h43m21.17s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-hq6qs/karpenter-upgrade-control-plane-mv8vc in 26s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-mv8vc upgrade_safe_check.go:87: UpgradeSafeFieldCheck: latch engaged for status.controlPlaneVersion util.go:3158: Successfully waited for HostedCluster e2e-clusters-hq6qs/karpenter-upgrade-control-plane-mv8vc to have valid conditions in 25ms hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestKarpenterUpgradeControlPlane/Main
1h12m48.67s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-hq6qs/karpenter-upgrade-control-plane-mv8vc in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s karpenter_control_plane_upgrade_test.go:57: Starting Karpenter control plane upgrade. FromImage: registry.build01.ci.openshift.org/ci-op-i06f3ij5/release@sha256:622e3aad9f1316badf4e7c2069a15bb6e480d3a5783727abee78031623fec157, toImage: registry.build01.ci.openshift.org/ci-op-i06f3ij5/release@sha256:c4b354866192b68a94089e30af4e157035ddde23d6aafebca299a14ffbf80b0d karpenter_control_plane_upgrade_test.go:68: machine-os version(s) in latest release: [9.8.20260713-1 10.2.20260714-0] karpenter_control_plane_upgrade_test.go:73: Created Karpenter NodePool karpenter_control_plane_upgrade_test.go:75: Created workloads util.go:583: Successfully waited for 1 nodes to become ready in 5m45s karpenter_test.go:1560: Successfully waited for NodeClaims to be ready in 0s karpenter_test.go:1516: Successfully waited for Pods to be scheduled on provisioned Karpenter nodes in 12s karpenter_control_plane_upgrade_test.go:82: Pre-upgrade node: ip-10-0-133-17.ec2.internal, OS image: Red Hat Enterprise Linux CoreOS 9.8.20260708-0 (Plow) karpenter_control_plane_upgrade_test.go:84: Updating cluster image. Image: registry.build01.ci.openshift.org/ci-op-i06f3ij5/release@sha256:c4b354866192b68a94089e30af4e157035ddde23d6aafebca299a14ffbf80b0d eventually.go:105: Failed to get *v1.NodeClaim: condition Drifted not found in NodeClaim on-demand-mmghw karpenter_test.go:1611: Successfully waited for NodeClaim on-demand-mmghw to be drifted in 3s util.go:620: Successfully waited for HostedCluster e2e-clusters-hq6qs/karpenter-upgrade-control-plane-mv8vc to rollout in 21m51s karpenter_control_plane_upgrade_test.go:110: Karpenter Nodes drifted util.go:583: Failed to wait for 1 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 1 nodes, got 2 eventually.go:401: - observed **v1.Node /ip-10-0-133-17.ec2.internal invalid: expected node OS image "Red Hat Enterprise Linux CoreOS 9.8.20260708-0 (Plow)" to contain one of [9.8.20260713-1 10.2.20260714-0] util.go:583: *v1.Node /ip-10-0-133-17.ec2.internal conditions: util.go:583: MemoryPressure=False: KubeletHasSufficientMemory(kubelet has sufficient memory available) util.go:583: DiskPressure=False: KubeletHasNoDiskPressure(kubelet has no disk pressure) util.go:583: PIDPressure=False: KubeletHasSufficientPID(kubelet has sufficient PID available) util.go:583: Ready=True: KubeletReady(kubelet is posting ready status)