PR #8537 - 06-02 17:45

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-s7p8f/autoscaling-ws8nc in 2m26s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-ws8nc util.go:3140: Failed to wait for HostedCluster e2e-clusters-s7p8f/autoscaling-ws8nc to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-s7p8f/autoscaling-ws8nc invalid at RV 8279 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-ws8nc.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-sbz9l/azure-scheduler-655bh in 2m33s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster azure-scheduler-655bh util.go:3140: Failed to wait for HostedCluster e2e-clusters-sbz9l/azure-scheduler-655bh to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-sbz9l/azure-scheduler-655bh invalid at RV 9149 after 2s: eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-azure-scheduler-655bh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:305: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-sbz9l/azure-scheduler-655bh in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-sbz9l/azure-scheduler-655bh invalid at RV 9149 after 10m0s: expected a kubeconfig reference in status util.go:305: *v1beta1.HostedCluster e2e-clusters-sbz9l/azure-scheduler-655bh conditions: util.go:305: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:305: EtcdAvailable=False: StatefulSetNotFound util.go:305: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:305: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-azure-scheduler-655bh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:305: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:305: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:305: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:305: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:305: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:305: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:305: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:305: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:305: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:305: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:305: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:305: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-r2lmx/create-cluster-74hdv in 2m27s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-74hdv util.go:3140: Failed to wait for HostedCluster e2e-clusters-r2lmx/create-cluster-74hdv to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-r2lmx/create-cluster-74hdv invalid at RV 8284 after 2s: eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-74hdv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-r2lmx/create-cluster-74hdv in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-r2lmx/create-cluster-74hdv invalid at RV 8284 after 10m0s: expected a kubeconfig reference in status util.go:305: *v1beta1.HostedCluster e2e-clusters-r2lmx/create-cluster-74hdv conditions: util.go:305: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:305: EtcdAvailable=False: StatefulSetNotFound util.go:305: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:305: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-74hdv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:305: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:305: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:305: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:305: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:305: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:305: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:305: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:305: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:305: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:305: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:305: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:305: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-q2zsq/custom-config-bszms in 2m25s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-bszms util.go:3140: Failed to wait for HostedCluster e2e-clusters-q2zsq/custom-config-bszms to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-q2zsq/custom-config-bszms invalid at RV 9142 after 2s: eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidAzureKMSConfig=True, got ValidAzureKMSConfig=False: AzureError(failed to encrypt data using KMS (key: e2e-key/76be6d25470b48dfa680f8db49645563): POST https://aks-e2e.vault.azure.net/keys/e2e-key/76be6d25470b48dfa680f8db49645563/encrypt RESPONSE 401: 401 Unauthorized ERROR CODE: Unauthorized { "error": { "code": "Unauthorized", "message": "AKV10000: Request is missing a Bearer, PoP, or MTLS_POP token." } } ) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-bszms.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-q2zsq/custom-config-bszms in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-q2zsq/custom-config-bszms invalid at RV 9142 after 10m0s: expected a kubeconfig reference in status util.go:305: *v1beta1.HostedCluster e2e-clusters-q2zsq/custom-config-bszms conditions: util.go:305: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:305: EtcdAvailable=False: StatefulSetNotFound util.go:305: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:305: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-bszms.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:305: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:305: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:305: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:305: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:305: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:305: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:305: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:305: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:305: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:305: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:305: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:305: ValidAzureKMSConfig=False: AzureError(failed to encrypt data using KMS (key: e2e-key/76be6d25470b48dfa680f8db49645563): POST https://aks-e2e.vault.azure.net/keys/e2e-key/76be6d25470b48dfa680f8db49645563/encrypt RESPONSE 401: 401 Unauthorized ERROR CODE: Unauthorized { "error": { "code": "Unauthorized", "message": "AKV10000: Request is missing a Bearer, PoP, or MTLS_POP token." } } )

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-nnpc5/ha-break-glass-creds-zgtgv in 2m33s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-zgtgv util.go:3140: Failed to wait for HostedCluster e2e-clusters-nnpc5/ha-break-glass-creds-zgtgv to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-nnpc5/ha-break-glass-creds-zgtgv invalid at RV 9313 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-ha-break-glass-creds-zgtgv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:305: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-nnpc5/ha-break-glass-creds-zgtgv in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-nnpc5/ha-break-glass-creds-zgtgv invalid at RV 9313 after 10m0s: expected a kubeconfig reference in status util.go:305: *v1beta1.HostedCluster e2e-clusters-nnpc5/ha-break-glass-creds-zgtgv conditions: util.go:305: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:305: EtcdAvailable=False: StatefulSetNotFound util.go:305: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:305: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-ha-break-glass-creds-zgtgv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:305: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:305: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:305: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:305: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:305: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:305: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:305: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:305: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:305: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:305: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:305: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:305: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-svj66/node-pool-hkm27 in 2m32s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-hkm27 util.go:3140: Failed to wait for HostedCluster e2e-clusters-svj66/node-pool-hkm27 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-svj66/node-pool-hkm27 invalid at RV 9150 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-hkm27.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-svj66/node-pool-hkm27 in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-svj66/node-pool-hkm27 invalid at RV 9150 after 10m0s: expected a kubeconfig reference in status util.go:305: *v1beta1.HostedCluster e2e-clusters-svj66/node-pool-hkm27 conditions: util.go:305: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:305: EtcdAvailable=False: StatefulSetNotFound util.go:305: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:305: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-hkm27.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:305: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:305: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:305: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:305: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:305: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:305: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:305: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:305: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:305: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:305: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:305: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:305: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-khpzd/node-pool-bl8pj in 2m33s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-bl8pj util.go:3140: Failed to wait for HostedCluster e2e-clusters-khpzd/node-pool-bl8pj to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-khpzd/node-pool-bl8pj invalid at RV 8941 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-bl8pj.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-khpzd/node-pool-bl8pj in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-khpzd/node-pool-bl8pj invalid at RV 8941 after 10m0s: expected a kubeconfig reference in status util.go:305: *v1beta1.HostedCluster e2e-clusters-khpzd/node-pool-bl8pj conditions: util.go:305: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:305: EtcdAvailable=False: StatefulSetNotFound util.go:305: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:305: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-bl8pj.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:305: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:305: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:305: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:305: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:305: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:305: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:305: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:305: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:305: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:305: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:305: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:305: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)

control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-hw4d0nbb/release@sha256:9b9887d15bbfd1a33cefc194befb5b496844630e44db8da02ba00d541fc0c198, toImage: registry.build01.ci.openshift.org/ci-op-hw4d0nbb/release@sha256:fa56c40edde988b885e43eee5d9094dca37bb88d2916d18c41b557abeb45a074 hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-9sxcc/control-plane-upgrade-5k6lh in 2m32s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-5k6lh util.go:3140: Failed to wait for HostedCluster e2e-clusters-9sxcc/control-plane-upgrade-5k6lh to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-9sxcc/control-plane-upgrade-5k6lh invalid at RV 9336 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-5k6lh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-9sxcc/control-plane-upgrade-5k6lh in 10m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-9sxcc/control-plane-upgrade-5k6lh invalid at RV 9336 after 10m0s: expected a kubeconfig reference in status util.go:305: *v1beta1.HostedCluster e2e-clusters-9sxcc/control-plane-upgrade-5k6lh conditions: util.go:305: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:305: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas) util.go:305: EtcdAvailable=False: StatefulSetNotFound util.go:305: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found) util.go:305: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-5k6lh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) util.go:305: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to create azure creds to verify resource group locations: failed to read credential file /mnt/certs/cpo-miv3-aks-e2e: open /mnt/certs/cpo-miv3-aks-e2e: no such file or directory) util.go:305: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:305: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:305: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning) util.go:305: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:305: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:305: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:305: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:305: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:305: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:305: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:305: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:305: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:305: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:305: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)