PR #8537 - 06-02 13:01

util.go:304: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-mhz7v/autoscaling-28zgf in 1m51.05s util.go:321: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-28zgf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-28zgf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-28zgf.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-28zgf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:383: Successfully waited for a successful connection to the guest API server in 3m18.125s eventually.go:259: Failed to get **v1.Node: context deadline exceeded util.go:578: Failed to wait for 1 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 1 nodes, got 0

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-bbx4d/azure-scheduler-szvhg in 2m19s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster azure-scheduler-szvhg util.go:3135: Failed to wait for HostedCluster e2e-clusters-bbx4d/azure-scheduler-szvhg to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-bbx4d/azure-scheduler-szvhg invalid at RV 139531 after 2s: eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: MultipleErrors(Unable to apply 5.0.0-0.ci-2026-06-02-131707-test-ci-op-h78wjq4z-latest: an unknown error has occurred: MultipleErrors) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators console, csi-snapshot-controller, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available * Could not update imagestream "openshift/driver-toolkit" (492 of 694): the server is down or not responding * Could not update imagestream "openshift/driver-toolkit" (493 of 694): the server is down or not responding) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://57.167.88.185:443/healthz": EOF) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:304: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-bbx4d/azure-scheduler-szvhg in 1m51.05s util.go:321: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:383: Successfully waited for a successful connection to the guest API server in 2m21.125s eventually.go:259: Failed to get **v1.Node: Get "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": dial tcp: lookup api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host - error from a previous attempt: read tcp 10.129.56.134:53864->13.86.58.217:443: read: connection reset by peer eventually.go:259: Failed to get **v1.Node: Get "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": dial tcp: lookup api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:259: Failed to get **v1.Node: Get "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": dial tcp: lookup api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host - error from a previous attempt: EOF eventually.go:259: Failed to get **v1.Node: Get "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": dial tcp: lookup api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:259: Failed to get **v1.Node: Get "https://api-azure-scheduler-szvhg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": EOF util.go:578: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 2 nodes, got 0

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-9d55r/create-cluster-vv4g9 in 2m18s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-vv4g9 util.go:3135: Failed to wait for HostedCluster e2e-clusters-9d55r/create-cluster-vv4g9 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-9d55r/create-cluster-vv4g9 invalid at RV 137799 after 2s: eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators console, csi-snapshot-controller, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available * Could not update imagestream "openshift/driver-toolkit" (505 of 709): the server is down or not responding * Could not update imagestream "openshift/driver-toolkit" (506 of 709): the server is down or not responding) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: MultipleErrors(Unable to apply 5.0.0-0.ci-2026-06-02-131707-test-ci-op-h78wjq4z-latest: an unknown error has occurred: MultipleErrors) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://57.167.88.185:443/healthz": EOF) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:304: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-9d55r/create-cluster-vv4g9 in 1m33.05s util.go:321: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-vv4g9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-vv4g9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-vv4g9.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-vv4g9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:383: Successfully waited for a successful connection to the guest API server in 5m33.1s eventually.go:259: Failed to get **v1.Node: Get "https://api-create-cluster-vv4g9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": context deadline exceeded util.go:578: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 2 nodes, got 0

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-72zhh/custom-config-9d96p in 2m50s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-9d96p util.go:3135: Failed to wait for HostedCluster e2e-clusters-72zhh/custom-config-9d96p to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-72zhh/custom-config-9d96p invalid at RV 40456 after 2s: eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([capi-provider deployment has 2 unavailable replicas, kube-apiserver deployment has 1 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: WaitingForAvailable(Waiting for Kube APIServer deployment to become available) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ValidAzureKMSConfig=True, got ValidAzureKMSConfig=False: AzureError(failed to encrypt data using KMS (key: e2e-key/76be6d25470b48dfa680f8db49645563): POST https://aks-e2e.vault.azure.net/keys/e2e-key/76be6d25470b48dfa680f8db49645563/encrypt RESPONSE 401: 401 Unauthorized ERROR CODE: Unauthorized { "error": { "code": "Unauthorized", "message": "AKV10000: Request is missing a Bearer, PoP, or MTLS_POP token." } } ) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingForAvailable(Waiting for Kube APIServer deployment to become available) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:304: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-72zhh/custom-config-9d96p in 1m30.05s util.go:321: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-9d96p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:383: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-csb8w/ha-break-glass-creds-pt2c2 in 2m40s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-pt2c2 util.go:3135: Failed to wait for HostedCluster e2e-clusters-csb8w/ha-break-glass-creds-pt2c2 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-csb8w/ha-break-glass-creds-pt2c2 invalid at RV 135431 after 2s: eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://57.167.88.185:443/healthz": EOF) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:304: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-csb8w/ha-break-glass-creds-pt2c2 in 2m12.1s util.go:321: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-pt2c2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-pt2c2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-ha-break-glass-creds-pt2c2.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-pt2c2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:383: Successfully waited for a successful connection to the guest API server in 6m30.1s util.go:578: Successfully waited for 0 nodes to become ready in 50ms util.go:3135: Failed to wait for HostedCluster e2e-clusters-csb8w/ha-break-glass-creds-pt2c2 to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-csb8w/ha-break-glass-creds-pt2c2 invalid at RV 135206 after 20m0s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://57.167.88.185:443/healthz": EOF) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-hd8gf/node-pool-d9l9s in 2m33s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-d9l9s util.go:3135: Failed to wait for HostedCluster e2e-clusters-hd8gf/node-pool-d9l9s to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-hd8gf/node-pool-d9l9s invalid at RV 110853 after 2s: eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: redhat-marketplace-catalog, catalog-operator, cluster-network-operator, olm-operator, redhat-operators-catalog, community-operators-catalog, cluster-image-registry-operator, machine-approver, azure-cloud-controller-manager, certified-operators-catalog, capi-provider, csi-snapshot-controller-operator, ignition-server, ignition-server-proxy, cluster-storage-operator, dns-operator, ingress-operator, packageserver, cluster-node-tuning-operator, konnectivity-agent, olm-collect-profiles) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:304: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-hd8gf/node-pool-d9l9s in 1m48.05s util.go:321: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-d9l9s.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-d9l9s.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-d9l9s.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-d9l9s.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-d9l9s.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-d9l9s.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-d9l9s.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:383: Successfully waited for a successful connection to the guest API server in 1m0.1s util.go:578: Successfully waited for 0 nodes to become ready in 50ms eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:3135: Failed to wait for HostedCluster e2e-clusters-hd8gf/node-pool-d9l9s to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-hd8gf/node-pool-d9l9s invalid at RV 110595 after 20m0s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://57.167.88.185:443/healthz": EOF) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-hswpv/node-pool-l2hzj in 2m44s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-l2hzj util.go:3135: Failed to wait for HostedCluster e2e-clusters-hswpv/node-pool-l2hzj to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-hswpv/node-pool-l2hzj invalid at RV 137941 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://57.167.88.185:443/healthz": EOF) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:304: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-hswpv/node-pool-l2hzj in 2m12.05s util.go:321: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-l2hzj.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:383: Successfully waited for a successful connection to the guest API server in 9m18.1s util.go:578: Successfully waited for 0 nodes to become ready in 50ms util.go:3135: Failed to wait for HostedCluster e2e-clusters-hswpv/node-pool-l2hzj to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-hswpv/node-pool-l2hzj invalid at RV 137941 after 20m0s: eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 2 unavailable replicas) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://57.167.88.185:443/healthz": EOF) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed

control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-h78wjq4z/release@sha256:b9e87235ef903faf046bc2601fc05e5b3ac72fd12f41f1821b20e6b8b6d5a75d, toImage: registry.build01.ci.openshift.org/ci-op-h78wjq4z/release@sha256:e10fdc868f89de85360b1eff47297ad78e17c2847d1eb0422d397553a78b3c4c hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-g5zgz/control-plane-upgrade-dkr2r in 2m37s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-dkr2r util.go:3135: Failed to wait for HostedCluster e2e-clusters-g5zgz/control-plane-upgrade-dkr2r to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-g5zgz/control-plane-upgrade-dkr2r invalid at RV 8560 after 2s: eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-dkr2r.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:304: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-g5zgz/control-plane-upgrade-dkr2r in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-g5zgz/control-plane-upgrade-dkr2r invalid at RV 8560 after 10m0s: expected a kubeconfig reference in status util.go:304: *v1beta1.HostedCluster e2e-clusters-g5zgz/control-plane-upgrade-dkr2r conditions: util.go:304: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:304: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:304: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:304: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:304: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:304: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:304: EtcdAvailable=False: StatefulSetNotFound util.go:304: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:304: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:304: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-dkr2r.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:304: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:304: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:304: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:304: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:304: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:304: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:304: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:304: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:304: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:304: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:304: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:304: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:304: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:304: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:304: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:304: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:304: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:304: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:304: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:304: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:304: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:304: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)