Failed Tests
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-2thqd/autoscaling-6lk2m in 23s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-6lk2m
util.go:3215: Successfully waited for HostedCluster e2e-clusters-2thqd/autoscaling-6lk2m to have valid conditions in 25ms
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-2thqd/autoscaling-6lk2m in 1m3.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-6lk2m.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-6lk2m.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-6lk2m.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.220.108.162:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 2m9.175s
util.go:590: Successfully waited for 1 nodes to become ready in 15m27.025s
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-2thqd/hostedclusters/autoscaling-6lk2m?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-2thqd/hostedclusters/autoscaling-6lk2m?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
util.go:627: Successfully waited for HostedCluster e2e-clusters-2thqd/autoscaling-6lk2m to rollout in 13m28.55s
util.go:3215: Successfully waited for HostedCluster e2e-clusters-2thqd/autoscaling-6lk2m to have valid conditions in 50ms
util.go:836: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-5b7765cb69-7ppng has a restartCount > 0 (6)
util.go:833: Leader election failure detected in container manager in pod capi-provider-559d69b77c-szx52
util.go:836: Container manager in pod cluster-api-68cd448b5c-pdr6n has a restartCount > 0 (5)
util.go:836: Container cluster-network-operator in pod cluster-network-operator-685c8c588c-gr666 has a restartCount > 1 (5)
util.go:833: Leader election failure detected in container cluster-storage-operator in pod cluster-storage-operator-78bcb7c999-6ldkt
util.go:836: Container control-plane-operator in pod control-plane-operator-d5846fcfb-dhqxf has a restartCount > 0 (9)
util.go:833: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-7f7fcbd4c8-5kpk4
util.go:833: Leader election failure detected in container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-bb68db8b7-whw42
util.go:836: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-5cbb5d565f-6qbtf has a restartCount > 0 (7)
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-q4klz/create-cluster-9566h in 59s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-9566h
util.go:3215: Failed to wait for HostedCluster e2e-clusters-q4klz/create-cluster-9566h to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-q4klz/create-cluster-9566h invalid at RV 83651 after 2s:
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator monitoring is not available)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-02-081821-test-ci-op-1wwbz7fr-latest: the cluster operator monitoring is not available)
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-q4klz/create-cluster-9566h in 1m6.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-9566h.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-9566h.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-9566h.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 107.23.203.136:443: i/o timeout
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-9566h.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 184.73.180.236:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 2m18.125s
util.go:590: Failed to wait for 3 nodes to become ready in 45m0s: context deadline exceeded
eventually.go:384: observed invalid **v1.Node state after 45m0s
eventually.go:401: - observed **v1.Node collection invalid: expected 3 nodes, got 1
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-5r2wp/custom-config-xnxh5 in 23s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-xnxh5
util.go:3215: Successfully waited for HostedCluster e2e-clusters-5r2wp/custom-config-xnxh5 to have valid conditions in 25ms
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-5r2wp/custom-config-xnxh5 in 57.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-xnxh5.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-xnxh5.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-xnxh5.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 98.95.13.232:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 2m34.075s
util.go:590: Successfully waited for 2 nodes to become ready in 15m24.025s
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-5r2wp/hostedclusters/custom-config-xnxh5?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-5r2wp/hostedclusters/custom-config-xnxh5?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
util.go:627: Successfully waited for HostedCluster e2e-clusters-5r2wp/custom-config-xnxh5 to rollout in 13m3.025s
util.go:3215: Successfully waited for HostedCluster e2e-clusters-5r2wp/custom-config-xnxh5 to have valid conditions in 8.825s
util.go:833: Leader election failure detected in container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-764f946cd5-5mlfr
util.go:833: Leader election failure detected in container manager in pod capi-provider-5878d68568-c6c5m
util.go:836: Container manager in pod cluster-api-5d466b4766-nmm97 has a restartCount > 0 (5)
util.go:833: Leader election failure detected in container cluster-storage-operator in pod cluster-storage-operator-569cf659b7-n5d2z
util.go:836: Container control-plane-operator in pod control-plane-operator-6df455566c-5s6ml has a restartCount > 0 (12)
util.go:833: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-696b9ddf-p9jbf
util.go:833: Leader election failure detected in container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-7c58577bd7-zpspz
util.go:836: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-796b85c974-55s9r has a restartCount > 0 (9)
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-cvpsb/ha-break-glass-creds-hmfxj in 16s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-hmfxj
eventually.go:105: Failed to get *v1beta1.HostedCluster: unexpected error when reading response body. Please retry. Original error: context deadline exceeded
util.go:3215: Failed to wait for HostedCluster e2e-clusters-cvpsb/ha-break-glass-creds-hmfxj to have valid conditions in 2s: context deadline exceeded
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
journals.go:79: No machines associated with infra id ha-break-glass-creds-hmfxj were found. Skipping journal dump.
hypershift_framework.go:576: Failed to destroy cluster, will retry: hostedcluster wasn't finalized, aborting delete: context deadline exceeded
journals.go:79: No machines associated with infra id ha-break-glass-creds-hmfxj were found. Skipping journal dump.
hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-cvpsb, name: ha-break-glass-creds-hmfxj
hypershift_framework.go:613: Failed to dump cluster: failed to dump hosted cluster: failed to dump cluster: the server is currently unable to handle the request
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-cvpsb/ha-break-glass-creds-hmfxj in 1m12.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-hmfxj.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-ha-break-glass-creds-hmfxj.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-hmfxj.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 52.70.211.235:443: i/o timeout
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-hmfxj.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.209.179.195:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 2m3.85s
util.go:590: Successfully waited for 0 nodes to become ready in 75ms
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cvpsb/hostedclusters/ha-break-glass-creds-hmfxj?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cvpsb/hostedclusters/ha-break-glass-creds-hmfxj?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cvpsb/hostedclusters/ha-break-glass-creds-hmfxj?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: the server was unable to return a response in the time allotted, but may still be processing the request (get hostedclusters.hypershift.openshift.io ha-break-glass-creds-hmfxj)
eventually.go:105: Failed to get *v1beta1.HostedCluster: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 2547; INTERNAL_ERROR; received from peer
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cvpsb/hostedclusters/ha-break-glass-creds-hmfxj?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cvpsb/hostedclusters/ha-break-glass-creds-hmfxj?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cvpsb/hostedclusters/ha-break-glass-creds-hmfxj?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: unexpected error when reading response body. Please retry. Original error: context deadline exceeded
util.go:3215: Failed to wait for HostedCluster e2e-clusters-cvpsb/ha-break-glass-creds-hmfxj to have valid conditions in 20m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-cvpsb/ha-break-glass-creds-hmfxj invalid at RV 69088 after 20m0s:
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([hosted-cluster-config-operator deployment has 1 unavailable replicas, ignition-server-proxy deployment has 1 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas, oauth-openshift deployment has 1 unavailable replicas])
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-4x2g6/private-n4cvx in 19s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster private-n4cvx
util.go:3215: Failed to wait for HostedCluster e2e-clusters-4x2g6/private-n4cvx to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-4x2g6/private-n4cvx invalid at RV 78904 after 2s:
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-02-081821-test-ci-op-1wwbz7fr-latest: some cluster operators are not available)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, openshift-samples, service-ca, storage are not available)
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(kube-controller-manager deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=False: KASAccessFailed(Data plane to control plane connection is not available: no successful connectivity check recorded)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-4x2g6/private-n4cvx in 54.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4x2g6/nodepools?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout - error from a previous attempt: http2: client connection lost
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4x2g6/nodepools?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4x2g6/nodepools?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:259: Failed to get **v1beta1.NodePool: the server was unable to return a response in the time allotted, but may still be processing the request (get nodepools.hypershift.openshift.io)
eventually.go:259: Failed to get **v1beta1.NodePool: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 2545; INTERNAL_ERROR; received from peer
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4x2g6/nodepools?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4x2g6/nodepools?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4x2g6/nodepools?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:259: Failed to get **v1beta1.NodePool: context deadline exceeded
util.go:751: Failed to wait for NodePools for HostedCluster e2e-clusters-4x2g6/private-n4cvx to have all of their desired nodes in 30m0s: context deadline exceeded
eventually.go:384: observed invalid **v1beta1.NodePool state after 30m0s
eventually.go:401: - observed **v1beta1.NodePool e2e-clusters-4x2g6/private-n4cvx-us-east-1b invalid: expected 2 replicas, got 1
util.go:751: *v1beta1.NodePool e2e-clusters-4x2g6/private-n4cvx-us-east-1b conditions:
util.go:751: AutoscalingEnabled=False: AsExpected
util.go:751: UpdateManagementEnabled=True: AsExpected
util.go:751: ValidReleaseImage=True: AsExpected(Using release image: registry.build09.ci.openshift.org/ci-op-1wwbz7fr/release@sha256:402960bd7eb77c74f2fd9ec99de10155631521d6e7a09f66c9c1414501a666b8)
util.go:751: ValidArchPlatform=True: AsExpected
util.go:751: ReconciliationActive=True: ReconciliationActive(Reconciliation active on resource)
util.go:751: SupportedVersionSkew=True: AsExpected(Release image version is valid)
util.go:751: ValidMachineConfig=True: AsExpected
util.go:751: UpdatingConfig=True: AsExpected(Updating config in progress. Target config: 22837102)
util.go:751: UpdatingVersion=True: AsExpected(Updating version in progress. Target version: 5.1.0-0.ci-2026-09-02-081821-test-ci-op-1wwbz7fr-latest)
util.go:751: ValidGeneratedPayload=True: AsExpected(Payload generated successfully)
util.go:751: ReachedIgnitionEndpoint=True: AsExpected
util.go:751: AllMachinesReady=True: AsExpected(All is well)
util.go:751: AllNodesHealthy=False: NodeConditionsFailed(1 of 2 machines are not healthy
Machine private-n4cvx-us-east-1b-cgddk-trl9f: NodeConditionsFailed: Node condition Ready is False
)
util.go:751: ValidPlatformConfig=True: AsExpected(All is well)
util.go:751: AWSResourceTagConflict=False: NoTagConflict(No AWS resource tag conflicts detected)
util.go:751: ValidPlatformImage=True: AsExpected(Bootstrap AMI is "ami-0c6ace7ae6dea6e9d")
util.go:751: AWSSecurityGroupAvailable=True: AsExpected(NodePool has a default security group)
util.go:751: ValidTuningConfig=True: AsExpected
util.go:751: UpdatingPlatformMachineTemplate=True: AsExpected(platform machine template update in progress. Target template: private-n4cvx-us-east-1b-4675dec7)
util.go:751: AutorepairEnabled=False: AsExpected
util.go:751: Ready=False: WaitingForAvailableMachines(Minimum availability requires 2 replicas, current 1 available)
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-cbc4d/private-8tk5h in 33s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster private-8tk5h
util.go:3215: Failed to wait for HostedCluster e2e-clusters-cbc4d/private-8tk5h to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-cbc4d/private-8tk5h invalid at RV 75171 after 2s:
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([hosted-cluster-config-operator deployment has 1 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas])
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-02-081821-test-ci-op-1wwbz7fr-latest: some cluster operators are not available)
eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion
eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity)
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-cbc4d/private-8tk5h in 1m0.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cbc4d/nodepools?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout - error from a previous attempt: http2: client connection lost
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cbc4d/nodepools?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cbc4d/nodepools?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:259: Failed to get **v1beta1.NodePool: the server was unable to return a response in the time allotted, but may still be processing the request (get nodepools.hypershift.openshift.io)
eventually.go:259: Failed to get **v1beta1.NodePool: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 2543; INTERNAL_ERROR; received from peer
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cbc4d/nodepools?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cbc4d/nodepools?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:259: Failed to get **v1beta1.NodePool: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-cbc4d/nodepools?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:259: Failed to get **v1beta1.NodePool: context deadline exceeded
util.go:751: Failed to wait for NodePools for HostedCluster e2e-clusters-cbc4d/private-8tk5h to have all of their desired nodes in 30m0s: context deadline exceeded
eventually.go:384: observed invalid **v1beta1.NodePool state after 30m0s
eventually.go:401: - observed **v1beta1.NodePool e2e-clusters-cbc4d/private-8tk5h-us-east-1a invalid: expected 2 replicas, got 0
util.go:751: *v1beta1.NodePool e2e-clusters-cbc4d/private-8tk5h-us-east-1a conditions:
util.go:751: AutoscalingEnabled=False: AsExpected
util.go:751: UpdateManagementEnabled=True: AsExpected
util.go:751: ValidReleaseImage=True: AsExpected(Using release image: registry.build09.ci.openshift.org/ci-op-1wwbz7fr/release@sha256:402960bd7eb77c74f2fd9ec99de10155631521d6e7a09f66c9c1414501a666b8)
util.go:751: ValidArchPlatform=True: AsExpected
util.go:751: ReconciliationActive=True: ReconciliationActive(Reconciliation active on resource)
util.go:751: SupportedVersionSkew=True: AsExpected(Release image version is valid)
util.go:751: ValidMachineConfig=True: AsExpected
util.go:751: UpdatingConfig=True: AsExpected(Updating config in progress. Target config: 13101aa4)
util.go:751: UpdatingVersion=True: AsExpected(Updating version in progress. Target version: 5.1.0-0.ci-2026-09-02-081821-test-ci-op-1wwbz7fr-latest)
util.go:751: ValidGeneratedPayload=True: AsExpected(Payload generated successfully)
util.go:751: ReachedIgnitionEndpoint=True: AsExpected
util.go:751: AllMachinesReady=True: AsExpected(All is well)
util.go:751: AllNodesHealthy=False: NodeProvisioning(2 of 2 machines are not healthy
Machine private-8tk5h-us-east-1a-ftlxx-4xdsz: NodeProvisioning: Waiting for a node with matching ProviderID to exist
Machine private-8tk5h-us-east-1a-ftlxx-fhgzg: NodeProvisioning: Waiting for a node with matching ProviderID to exist
)
util.go:751: ValidPlatformConfig=True: AsExpected(All is well)
util.go:751: AWSResourceTagConflict=False: NoTagConflict(No AWS resource tag conflicts detected)
util.go:751: ValidPlatformImage=True: AsExpected(Bootstrap AMI is "ami-0c6ace7ae6dea6e9d")
util.go:751: AWSSecurityGroupAvailable=True: AsExpected(NodePool has a default security group)
util.go:751: ValidTuningConfig=True: AsExpected
util.go:751: UpdatingPlatformMachineTemplate=True: AsExpected(platform machine template update in progress. Target template: private-8tk5h-us-east-1a-94aa0802)
util.go:751: AutorepairEnabled=False: AsExpected
util.go:751: Ready=False: WaitingForAvailableMachines(Minimum availability requires 2 replicas, current 0 available)
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-8sg7p/proxy-97cg6 in 50s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster proxy-97cg6
util.go:3215: Successfully waited for HostedCluster e2e-clusters-8sg7p/proxy-97cg6 to have valid conditions in 25ms
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-8sg7p/proxy-97cg6 in 45.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-proxy-97cg6.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-proxy-97cg6.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-proxy-97cg6.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 52.45.186.97:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 2m34.075s
util.go:590: Successfully waited for 2 nodes to become ready in 27m51.025s
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-8sg7p/hostedclusters/proxy-97cg6?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-8sg7p/hostedclusters/proxy-97cg6?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 2157; INTERNAL_ERROR; received from peer
util.go:627: Successfully waited for HostedCluster e2e-clusters-8sg7p/proxy-97cg6 to rollout in 8m33.025s
util.go:3215: Successfully waited for HostedCluster e2e-clusters-8sg7p/proxy-97cg6 to have valid conditions in 25ms
util.go:836: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-64b677f765-lhdkq has a restartCount > 0 (3)
util.go:833: Leader election failure detected in container manager in pod capi-provider-66d99d4558-dcsp9
util.go:836: Container manager in pod cluster-api-8965c46c4-zldm6 has a restartCount > 0 (10)
util.go:836: Container cluster-storage-operator in pod cluster-storage-operator-9646ddb8c-qhq96 has a restartCount > 0 (8)
util.go:833: Leader election failure detected in container control-plane-operator in pod control-plane-operator-99bf59d79-27p8q
util.go:833: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-6c557689fb-6f46v
util.go:836: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-7c4897b479-vrnzd has a restartCount > 0 (7)
util.go:833: Leader election failure detected in container hosted-cluster-config-operator in pod hosted-cluster-config-operator-78ff57d97d-9s2zc
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-jbvmt/karpenter-v64r4 in 1m0s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-v64r4
util.go:3215: Successfully waited for HostedCluster e2e-clusters-jbvmt/karpenter-v64r4 to have valid conditions in 25ms
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-jbvmt/karpenter-v64r4 in 1m15.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-v64r4.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-karpenter-v64r4.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-v64r4.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 52.73.37.186:443: i/o timeout
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-v64r4.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 44.195.158.225:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 2m19.075s
util.go:590: Successfully waited for 2 nodes to become ready in 14m51.025s
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jbvmt/hostedclusters/karpenter-v64r4?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jbvmt/hostedclusters/karpenter-v64r4?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
util.go:627: Successfully waited for HostedCluster e2e-clusters-jbvmt/karpenter-v64r4 to rollout in 13m9.025s
util.go:3215: Successfully waited for HostedCluster e2e-clusters-jbvmt/karpenter-v64r4 to have valid conditions in 25ms
util.go:833: Leader election failure detected in container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-d56cd78df-g9w9z
util.go:833: Leader election failure detected in container manager in pod capi-provider-c7d8f497d-vn9dn
util.go:836: Container manager in pod cluster-api-c5cfc496d-42bsr has a restartCount > 0 (7)
util.go:833: Leader election failure detected in container cluster-storage-operator in pod cluster-storage-operator-599fcb874d-zxh8g
util.go:836: Container control-plane-operator in pod control-plane-operator-6c6f6c5b7d-lfq25 has a restartCount > 0 (10)
util.go:833: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-69c49bff66-gn4mr
util.go:833: Leader election failure detected in container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-67c648756b-p7vs7
util.go:836: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-665465cf9f-n9r7f has a restartCount > 0 (7)
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-2tmst/karpenter-upgrade-control-plane-6mlmh in 47s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-6mlmh
util.go:3215: Successfully waited for HostedCluster e2e-clusters-2tmst/karpenter-upgrade-control-plane-6mlmh to have valid conditions in 25ms
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-2tmst/karpenter-upgrade-control-plane-6mlmh in 3m6.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
util.go:391: Successfully waited for a successful connection to the guest API server in 27.175s
util.go:590: Successfully waited for 2 nodes to become ready in 36m48.025s
util.go:627: Successfully waited for HostedCluster e2e-clusters-2tmst/karpenter-upgrade-control-plane-6mlmh to rollout in 2m45.025s
util.go:3215: Successfully waited for HostedCluster e2e-clusters-2tmst/karpenter-upgrade-control-plane-6mlmh to have valid conditions in 4m0.025s
util.go:833: Leader election failure detected in container manager in pod capi-provider-767dbc44fb-dkd6r
util.go:836: Container manager in pod cluster-api-74944f8ff6-snhbv has a restartCount > 0 (5)
util.go:833: Leader election failure detected in container control-plane-operator in pod control-plane-operator-785869c64d-n9jl2
util.go:836: Container control-plane-pki-operator in pod control-plane-pki-operator-d4795747c-pqq6q has a restartCount > 0 (3)
util.go:833: Leader election failure detected in container etcd-defrag in pod etcd-2
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-tjld5/node-pool-lq2h8 in 1m12s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-lq2h8
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tjld5/hostedclusters/node-pool-lq2h8?timeout=5m0s": context deadline exceeded
util.go:3215: Failed to wait for HostedCluster e2e-clusters-tjld5/node-pool-lq2h8 to have valid conditions in 2s: context deadline exceeded
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
journals.go:79: No machines associated with infra id node-pool-lq2h8 were found. Skipping journal dump.
hypershift_framework.go:576: Failed to destroy cluster, will retry: hostedcluster wasn't finalized, aborting delete: context deadline exceeded
journals.go:79: No machines associated with infra id node-pool-lq2h8 were found. Skipping journal dump.
fixture.go:346: Failed to wait for infra resources in guest cluster to be deleted: context deadline exceeded
fixture.go:353: Failed to clean up 1 remaining resources for guest cluster
fixture.go:360: Resource: arn:aws:elasticloadbalancing:us-east-1:820196288204:loadbalancer/net/a1e246a4834374a348d114e771de3081/fb5f46e12a5a6ccb, tags: kubernetes.io/service-name=openshift-ingress/router-default,red-hat-clustertype=rosa,kubernetes.io/cluster/node-pool-lq2h8=owned,red-hat-managed=true,expirationDate=2026-09-02T12:46+00:00, service: elasticloadbalancing
hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-tjld5, name: node-pool-lq2h8
hypershift_framework.go:613: Failed to dump cluster: failed to dump hosted cluster: failed to dump cluster: the server is currently unable to handle the request
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tjld5/node-pool-lq2h8 in 1m39.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-lq2h8.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-lq2h8.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-lq2h8.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 54.144.203.57:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 1m43.075s
util.go:590: Successfully waited for 0 nodes to become ready in 125ms
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tjld5/hostedclusters/node-pool-lq2h8?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tjld5/hostedclusters/node-pool-lq2h8?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tjld5/hostedclusters/node-pool-lq2h8?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: the server was unable to return a response in the time allotted, but may still be processing the request (get hostedclusters.hypershift.openshift.io node-pool-lq2h8)
eventually.go:105: Failed to get *v1beta1.HostedCluster: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 2551; INTERNAL_ERROR; received from peer
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tjld5/hostedclusters/node-pool-lq2h8?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tjld5/hostedclusters/node-pool-lq2h8?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tjld5/hostedclusters/node-pool-lq2h8?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: unexpected error when reading response body. Please retry. Original error: context deadline exceeded
util.go:3215: Failed to wait for HostedCluster e2e-clusters-tjld5/node-pool-lq2h8 to have valid conditions in 20m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-tjld5/node-pool-lq2h8 invalid at RV 65461 after 20m0s:
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(kube-controller-manager deployment has 1 unavailable replicas)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-d24t5/node-pool-9t2tg in 27s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-9t2tg
eventually.go:105: Failed to get *v1beta1.HostedCluster: unexpected error when reading response body. Please retry. Original error: context deadline exceeded
util.go:3215: Failed to wait for HostedCluster e2e-clusters-d24t5/node-pool-9t2tg to have valid conditions in 2s: context deadline exceeded
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
journals.go:79: No machines associated with infra id node-pool-9t2tg were found. Skipping journal dump.
hypershift_framework.go:576: Failed to destroy cluster, will retry: hostedcluster wasn't finalized, aborting delete: context deadline exceeded
journals.go:79: No machines associated with infra id node-pool-9t2tg were found. Skipping journal dump.
hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-d24t5, name: node-pool-9t2tg
hypershift_framework.go:613: Failed to dump cluster: failed to dump hosted cluster: failed to dump cluster: the server is currently unable to handle the request
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-d24t5/node-pool-9t2tg in 1m3.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-9t2tg.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-9t2tg.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-9t2tg.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 100.62.156.185:443: i/o timeout
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-9t2tg.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 18.210.194.196:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 2m15.075s
util.go:590: Successfully waited for 0 nodes to become ready in 75ms
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-d24t5/hostedclusters/node-pool-9t2tg?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-d24t5/hostedclusters/node-pool-9t2tg?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-d24t5/hostedclusters/node-pool-9t2tg?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: the server was unable to return a response in the time allotted, but may still be processing the request (get hostedclusters.hypershift.openshift.io node-pool-9t2tg)
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-d24t5/hostedclusters/node-pool-9t2tg?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-d24t5/hostedclusters/node-pool-9t2tg?timeout=5m0s": net/http: TLS handshake timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-d24t5/hostedclusters/node-pool-9t2tg?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: unexpected error when reading response body. Please retry. Original error: context deadline exceeded
util.go:3215: Failed to wait for HostedCluster e2e-clusters-d24t5/node-pool-9t2tg to have valid conditions in 20m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-d24t5/node-pool-9t2tg invalid at RV 66050 after 20m0s:
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(kube-controller-manager deployment has 1 unavailable replicas)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-f6h69/scale-from-zero-gqgwm in 1m21s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster scale-from-zero-gqgwm
util.go:3215: Successfully waited for HostedCluster e2e-clusters-f6h69/scale-from-zero-gqgwm to have valid conditions in 25ms
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-f6h69/scale-from-zero-gqgwm in 1m39.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-scale-from-zero-gqgwm.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-scale-from-zero-gqgwm.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-scale-from-zero-gqgwm.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 35.168.71.1:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 1m52.05s
util.go:590: Successfully waited for 1 nodes to become ready in 14m48.025s
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f6h69/hostedclusters/scale-from-zero-gqgwm?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f6h69/hostedclusters/scale-from-zero-gqgwm?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost
eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://ae2935d6764044e98921c00ea0afe0e9-620862b65031eb3e.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f6h69/hostedclusters/scale-from-zero-gqgwm?timeout=5m0s": dial tcp 52.1.193.129:6443: i/o timeout
eventually.go:105: Failed to get *v1beta1.HostedCluster: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 2155; INTERNAL_ERROR; received from peer
util.go:627: Successfully waited for HostedCluster e2e-clusters-f6h69/scale-from-zero-gqgwm to rollout in 20m54.025s
util.go:3215: Successfully waited for HostedCluster e2e-clusters-f6h69/scale-from-zero-gqgwm to have valid conditions in 25ms
util.go:836: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-578bb49cbd-rvqgd has a restartCount > 0 (3)
util.go:833: Leader election failure detected in container manager in pod capi-provider-847d47fb-trbvz
util.go:836: Container manager in pod cluster-api-b78ff677c-zsr9r has a restartCount > 0 (7)
util.go:836: Container cluster-node-tuning-operator in pod cluster-node-tuning-operator-658cb54997-78mf6 has a restartCount > 0 (2)
util.go:836: Container cluster-storage-operator in pod cluster-storage-operator-85b6d86d89-hrgw9 has a restartCount > 0 (7)
util.go:833: Leader election failure detected in container control-plane-operator in pod control-plane-operator-669b675d84-nc6vj
util.go:833: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-69874bd645-rmjdd
util.go:833: Leader election failure detected in container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-9f78d9c7f-x956b
util.go:833: Leader election failure detected in container hosted-cluster-config-operator in pod hosted-cluster-config-operator-5b968b966f-sfdf7
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build09.ci.openshift.org/ci-op-1wwbz7fr/release@sha256:ed42992cb5d3c0f518de9884d53951fe996f5d197830469f1bce47774b7ef2c3, toImage: registry.build09.ci.openshift.org/ci-op-1wwbz7fr/release@sha256:402960bd7eb77c74f2fd9ec99de10155631521d6e7a09f66c9c1414501a666b8
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-jpgxk/control-plane-upgrade-xz7pg in 21s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-xz7pg
util.go:3215: Successfully waited for HostedCluster e2e-clusters-jpgxk/control-plane-upgrade-xz7pg to have valid conditions in 25ms
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:312: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-jpgxk/control-plane-upgrade-xz7pg in 1m48.025s
util.go:329: Successfully waited for kubeconfig secret to have data in 25ms
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-xz7pg.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-control-plane-upgrade-xz7pg.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-xz7pg.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.212.221.91:443: i/o timeout
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-xz7pg.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 44.207.67.23:443: i/o timeout
util.go:391: Successfully waited for a successful connection to the guest API server in 1m57.25s
util.go:590: Successfully waited for 2 nodes to become ready in 33m54.025s
eventually.go:105: Failed to get *v1beta1.HostedCluster: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 2165; INTERNAL_ERROR; received from peer
util.go:627: Successfully waited for HostedCluster e2e-clusters-jpgxk/control-plane-upgrade-xz7pg to rollout in 2m33.025s
util.go:3215: Successfully waited for HostedCluster e2e-clusters-jpgxk/control-plane-upgrade-xz7pg to have valid conditions in 25ms
util.go:833: Leader election failure detected in container manager in pod capi-provider-7dfbdd45ff-4974t
util.go:836: Container manager in pod cluster-api-85596b8679-f7l67 has a restartCount > 0 (8)
util.go:836: Container cluster-network-operator in pod cluster-network-operator-b4b8b7b5c-kfsfl has a restartCount > 1 (2)
util.go:836: Container cluster-storage-operator in pod cluster-storage-operator-659c489cb8-9dzqz has a restartCount > 0 (3)
util.go:833: Leader election failure detected in container control-plane-operator in pod control-plane-operator-64b6d58bf6-8l259
util.go:833: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-75857c99d8-qt69d
util.go:836: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-86c967f6fc-x7c8t has a restartCount > 0 (3)
util.go:833: Leader election failure detected in container etcd-defrag in pod etcd-0
util.go:836: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-6cdf96b75-s7bqj has a restartCount > 0 (5)