Failed Tests
hypershift_framework.go:513: Successfully created hostedcluster e2e-clusters-whxgt/autoscaling-ltdfz in 2m35s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-ltdfz
util.go:3025: Failed to wait for HostedCluster e2e-clusters-whxgt/autoscaling-ltdfz to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-whxgt/autoscaling-ltdfz invalid at RV 43567 after 2s:
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 0c917593-1923-4def-adc2-9906a2671a00 Correlation ID: 1e984f33-ca5b-4e20-ab23-7f2f4a210f43 Timestamp: 2026-04-14 17:13:17Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:17Z",
"trace_id": "0c917593-1923-4def-adc2-9906a2671a00",
"correlation_id": "1e984f33-ca5b-4e20-ab23-7f2f4a210f43",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-ltdfz.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:332: skipping postTeardown()
hypershift_framework.go:310: skipping teardown, already called
util.go:297: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-whxgt/autoscaling-ltdfz in 10m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-whxgt/autoscaling-ltdfz invalid at RV 43395 after 10m0s: expected a kubeconfig reference in status
util.go:297: *v1beta1.HostedCluster e2e-clusters-whxgt/autoscaling-ltdfz conditions:
util.go:297: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
util.go:297: EtcdAvailable=False: StatefulSetNotFound
util.go:297: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
util.go:297: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-ltdfz.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
util.go:297: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: a2ce564d-018f-40f4-8ccf-4c4ece7e2b00 Correlation ID: acb0ceb0-bad4-4423-90f9-a1f1307cba3a Timestamp: 2026-04-14 17:13:14Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:14Z",
"trace_id": "a2ce564d-018f-40f4-8ccf-4c4ece7e2b00",
"correlation_id": "acb0ceb0-bad4-4423-90f9-a1f1307cba3a",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
util.go:297: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured)
util.go:297: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ValidConfiguration=True: AsExpected(Configuration passes validation)
util.go:297: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration)
util.go:297: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured)
util.go:297: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
util.go:297: ReconciliationActive=True: AsExpected(Reconciliation active on resource)
util.go:297: ValidReleaseImage=True: AsExpected(Release image is valid)
util.go:297: Progressing=False: AsExpected(HostedCluster is at expected version)
util.go:297: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found)
util.go:297: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)
util.go:297: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)
hypershift_framework.go:513: Successfully created hostedcluster e2e-clusters-55qnm/azure-scheduler-k85p7 in 2m28s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster azure-scheduler-k85p7
util.go:3025: Failed to wait for HostedCluster e2e-clusters-55qnm/azure-scheduler-k85p7 to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-55qnm/azure-scheduler-k85p7 invalid at RV 43199 after 2s:
eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 8a7bbecf-f707-474e-abab-23ceb68a1700 Correlation ID: d85550e0-0222-4c79-9b98-ac24eeadc392 Timestamp: 2026-04-14 17:13:11Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:11Z",
"trace_id": "8a7bbecf-f707-474e-abab-23ceb68a1700",
"correlation_id": "d85550e0-0222-4c79-9b98-ac24eeadc392",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-azure-scheduler-k85p7.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:332: skipping postTeardown()
hypershift_framework.go:310: skipping teardown, already called
eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded
util.go:297: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-55qnm/azure-scheduler-k85p7 in 10m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-55qnm/azure-scheduler-k85p7 invalid at RV 43032 after 10m0s: expected a kubeconfig reference in status
util.go:297: *v1beta1.HostedCluster e2e-clusters-55qnm/azure-scheduler-k85p7 conditions:
util.go:297: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
util.go:297: EtcdAvailable=False: StatefulSetNotFound
util.go:297: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
util.go:297: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-azure-scheduler-k85p7.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
util.go:297: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: ff49adc3-43d4-4d80-93c0-1fa9abfc2b00 Correlation ID: 52763a69-6734-444f-a6c3-84c49a33829f Timestamp: 2026-04-14 17:13:08Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:08Z",
"trace_id": "ff49adc3-43d4-4d80-93c0-1fa9abfc2b00",
"correlation_id": "52763a69-6734-444f-a6c3-84c49a33829f",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
util.go:297: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured)
util.go:297: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ValidConfiguration=True: AsExpected(Configuration passes validation)
util.go:297: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration)
util.go:297: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured)
util.go:297: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
util.go:297: ReconciliationActive=True: AsExpected(Reconciliation active on resource)
util.go:297: ValidReleaseImage=True: AsExpected(Release image is valid)
util.go:297: Progressing=False: AsExpected(HostedCluster is at expected version)
util.go:297: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found)
util.go:297: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)
util.go:297: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)
hypershift_framework.go:513: Successfully created hostedcluster e2e-clusters-hlsgw/create-cluster-db74l in 2m26s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-db74l
util.go:3025: Failed to wait for HostedCluster e2e-clusters-hlsgw/create-cluster-db74l to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-hlsgw/create-cluster-db74l invalid at RV 43078 after 2s:
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: cda47416-4936-478c-b30f-56f6ec4a3f00 Correlation ID: 80ee2734-9f19-46a2-b1e8-a8104c3fe646 Timestamp: 2026-04-14 17:13:09Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:09Z",
"trace_id": "cda47416-4936-478c-b30f-56f6ec4a3f00",
"correlation_id": "80ee2734-9f19-46a2-b1e8-a8104c3fe646",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-db74l.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:332: skipping postTeardown()
hypershift_framework.go:310: skipping teardown, already called
util.go:297: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-hlsgw/create-cluster-db74l in 10m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-hlsgw/create-cluster-db74l invalid at RV 42904 after 10m0s: expected a kubeconfig reference in status
util.go:297: *v1beta1.HostedCluster e2e-clusters-hlsgw/create-cluster-db74l conditions:
util.go:297: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
util.go:297: EtcdAvailable=False: StatefulSetNotFound
util.go:297: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
util.go:297: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-db74l.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
util.go:297: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 9956a562-2193-4ed7-a9f9-2d324d570b00 Correlation ID: a08eee22-a90a-40a9-b49d-13f02c8a2439 Timestamp: 2026-04-14 17:13:06Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:06Z",
"trace_id": "9956a562-2193-4ed7-a9f9-2d324d570b00",
"correlation_id": "a08eee22-a90a-40a9-b49d-13f02c8a2439",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
util.go:297: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured)
util.go:297: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ValidConfiguration=True: AsExpected(Configuration passes validation)
util.go:297: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration)
util.go:297: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured)
util.go:297: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
util.go:297: ReconciliationActive=True: AsExpected(Reconciliation active on resource)
util.go:297: ValidReleaseImage=True: AsExpected(Release image is valid)
util.go:297: Progressing=False: AsExpected(HostedCluster is at expected version)
util.go:297: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found)
util.go:297: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)
util.go:297: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)
hypershift_framework.go:513: Successfully created hostedcluster e2e-clusters-lq8pb/custom-config-dstn9 in 2m30s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-dstn9
util.go:3025: Failed to wait for HostedCluster e2e-clusters-lq8pb/custom-config-dstn9 to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-lq8pb/custom-config-dstn9 invalid at RV 43279 after 2s:
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-dstn9.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound
eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 078f6d0a-004d-4550-9c6b-128cc2ee1a00 Correlation ID: dd76741c-b6ff-42dc-955b-6a2064f51fe0 Timestamp: 2026-04-14 17:13:12Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:12Z",
"trace_id": "078f6d0a-004d-4550-9c6b-128cc2ee1a00",
"correlation_id": "dd76741c-b6ff-42dc-955b-6a2064f51fe0",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:332: skipping postTeardown()
hypershift_framework.go:310: skipping teardown, already called
eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded
util.go:297: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-lq8pb/custom-config-dstn9 in 10m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-lq8pb/custom-config-dstn9 invalid at RV 43098 after 10m0s: expected a kubeconfig reference in status
util.go:297: *v1beta1.HostedCluster e2e-clusters-lq8pb/custom-config-dstn9 conditions:
util.go:297: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
util.go:297: EtcdAvailable=False: StatefulSetNotFound
util.go:297: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
util.go:297: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-dstn9.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
util.go:297: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: f7c1f05d-aea4-4af8-8ee0-58486ed58200 Correlation ID: 28e60993-d2cf-4fb9-8dc2-727694545f89 Timestamp: 2026-04-14 17:13:09Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:09Z",
"trace_id": "f7c1f05d-aea4-4af8-8ee0-58486ed58200",
"correlation_id": "28e60993-d2cf-4fb9-8dc2-727694545f89",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
util.go:297: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured)
util.go:297: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ValidConfiguration=True: AsExpected(Configuration passes validation)
util.go:297: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration)
util.go:297: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured)
util.go:297: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
util.go:297: ReconciliationActive=True: AsExpected(Reconciliation active on resource)
util.go:297: ValidReleaseImage=True: AsExpected(Release image is valid)
util.go:297: Progressing=False: AsExpected(HostedCluster is at expected version)
util.go:297: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found)
util.go:297: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)
util.go:297: ValidAzureKMSConfig=True: AsExpected(All is well)
hypershift_framework.go:513: Successfully created hostedcluster e2e-clusters-zh4r6/node-pool-vv546 in 2m39s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-vv546
util.go:3025: Failed to wait for HostedCluster e2e-clusters-zh4r6/node-pool-vv546 to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-zh4r6/node-pool-vv546 invalid at RV 43805 after 2s:
eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-vv546.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound
eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 099cee9b-139a-4478-9e38-7ad7d9fa2400 Correlation ID: e47ef4a0-7626-466e-9b91-15c51ab4d7ee Timestamp: 2026-04-14 17:13:21Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:21Z",
"trace_id": "099cee9b-139a-4478-9e38-7ad7d9fa2400",
"correlation_id": "e47ef4a0-7626-466e-9b91-15c51ab4d7ee",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:332: skipping postTeardown()
hypershift_framework.go:310: skipping teardown, already called
util.go:297: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-zh4r6/node-pool-vv546 in 10m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-zh4r6/node-pool-vv546 invalid at RV 43649 after 10m0s: expected a kubeconfig reference in status
util.go:297: *v1beta1.HostedCluster e2e-clusters-zh4r6/node-pool-vv546 conditions:
util.go:297: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
util.go:297: EtcdAvailable=False: StatefulSetNotFound
util.go:297: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
util.go:297: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-vv546.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
util.go:297: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: f67d25d5-050a-4265-8469-13aac73cb700 Correlation ID: e3e37f6a-0716-4033-8dd7-c84862673b54 Timestamp: 2026-04-14 17:13:18Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:18Z",
"trace_id": "f67d25d5-050a-4265-8469-13aac73cb700",
"correlation_id": "e3e37f6a-0716-4033-8dd7-c84862673b54",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
util.go:297: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured)
util.go:297: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ValidConfiguration=True: AsExpected(Configuration passes validation)
util.go:297: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration)
util.go:297: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured)
util.go:297: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
util.go:297: ReconciliationActive=True: AsExpected(Reconciliation active on resource)
util.go:297: ValidReleaseImage=True: AsExpected(Release image is valid)
util.go:297: Progressing=False: AsExpected(HostedCluster is at expected version)
util.go:297: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found)
util.go:297: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)
util.go:297: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)
hypershift_framework.go:513: Successfully created hostedcluster e2e-clusters-6q6sv/node-pool-6rrv6 in 2m28s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-6rrv6
util.go:3025: Failed to wait for HostedCluster e2e-clusters-6q6sv/node-pool-6rrv6 to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-6q6sv/node-pool-6rrv6 invalid at RV 43161 after 2s:
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 33ba7788-3df0-4064-9c73-04e35ddb8700 Correlation ID: a8900e5c-ead9-4323-a2e7-652cf3f58c7e Timestamp: 2026-04-14 17:13:10Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:10Z",
"trace_id": "33ba7788-3df0-4064-9c73-04e35ddb8700",
"correlation_id": "a8900e5c-ead9-4323-a2e7-652cf3f58c7e",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-6rrv6.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
hypershift_framework.go:332: skipping postTeardown()
hypershift_framework.go:310: skipping teardown, already called
eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded
util.go:297: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-6q6sv/node-pool-6rrv6 in 10m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-6q6sv/node-pool-6rrv6 invalid at RV 42985 after 10m0s: expected a kubeconfig reference in status
util.go:297: *v1beta1.HostedCluster e2e-clusters-6q6sv/node-pool-6rrv6 conditions:
util.go:297: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
util.go:297: EtcdAvailable=False: StatefulSetNotFound
util.go:297: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
util.go:297: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-6rrv6.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
util.go:297: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 786d5cf3-96b5-479f-9e10-ddba4ce79500 Correlation ID: f9e1d800-2561-48f0-9279-dbcbd2ee5adc Timestamp: 2026-04-14 17:13:07Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:07Z",
"trace_id": "786d5cf3-96b5-479f-9e10-ddba4ce79500",
"correlation_id": "f9e1d800-2561-48f0-9279-dbcbd2ee5adc",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
util.go:297: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured)
util.go:297: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ValidConfiguration=True: AsExpected(Configuration passes validation)
util.go:297: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration)
util.go:297: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured)
util.go:297: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
util.go:297: ReconciliationActive=True: AsExpected(Reconciliation active on resource)
util.go:297: ValidReleaseImage=True: AsExpected(Release image is valid)
util.go:297: Progressing=False: AsExpected(HostedCluster is at expected version)
util.go:297: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found)
util.go:297: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)
util.go:297: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-vp9vwv46/release@sha256:159191da3fdecac850c9e954bddf9b55d33395ca00673a2a18fa06dc20ae169c, toImage: registry.build01.ci.openshift.org/ci-op-vp9vwv46/release@sha256:f8bfa295cc74220b28e0dc30734fc81e2d3933f1c4f48a15b64c781de5f34ae3
hypershift_framework.go:513: Successfully created hostedcluster e2e-clusters-bxrvl/control-plane-upgrade-n54hc in 2m22s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-n54hc
util.go:3025: Failed to wait for HostedCluster e2e-clusters-bxrvl/control-plane-upgrade-n54hc to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-bxrvl/control-plane-upgrade-n54hc invalid at RV 42802 after 2s:
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-n54hc.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted KubeAPIServerAvailable=True, got KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ValidHostedControlPlaneConfiguration=True, got ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: db807226-53d3-4b9d-8262-ad57cc9bd700 Correlation ID: 57bffb3c-5809-446a-8345-bbf57ea632ff Timestamp: 2026-04-14 17:13:04Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:04Z",
"trace_id": "db807226-53d3-4b9d-8262-ad57cc9bd700",
"correlation_id": "57bffb3c-5809-446a-8345-bbf57ea632ff",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
eventually.go:228: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
eventually.go:228: - incorrect condition: wanted InfrastructureReady=True, got InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
eventually.go:228: - incorrect condition: wanted EtcdAvailable=True, got EtcdAvailable=False: StatefulSetNotFound
eventually.go:228: - incorrect condition: wanted ValidReleaseInfo=True, got ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
hypershift_framework.go:332: skipping postTeardown()
hypershift_framework.go:310: skipping teardown, already called
eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded
util.go:297: Failed to wait for kubeconfig to be published for HostedCluster e2e-clusters-bxrvl/control-plane-upgrade-n54hc in 10m0s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-bxrvl/control-plane-upgrade-n54hc invalid at RV 42613 after 10m0s: expected a kubeconfig reference in status
util.go:297: *v1beta1.HostedCluster e2e-clusters-bxrvl/control-plane-upgrade-n54hc conditions:
util.go:297: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.)
util.go:297: Degraded=True: UnavailableReplicas(capi-provider deployment has 1 unavailable replicas)
util.go:297: EtcdAvailable=False: StatefulSetNotFound
util.go:297: KubeAPIServerAvailable=False: NotFound(Kube APIServer deployment not found)
util.go:297: InfrastructureReady=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-n54hc.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host)
util.go:297: ValidHostedControlPlaneConfiguration=False: InsufficientClusterCapabilities(failed to get vnet info to verify its location: failed to get virtual network: ClientCertificateCredential authentication failed.
POST https://login.microsoftonline.com/520cf09d-78ff-44ed-a731-abd623e73b09/oauth2/v2.0/token
RESPONSE 400: 400 Bad Request
{
"error": "unauthorized_client",
"error_description": "AADSTS700016: Application with identifier 'ad276877-160e-403d-afaf-e5970977885f' was not found in the directory 'PnT Cloud Ops Dev/Test'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant. Trace ID: 64b49056-293e-49ce-b18f-73c5f35d0e00 Correlation ID: 705f9412-1649-4140-8a07-52803aa38e73 Timestamp: 2026-04-14 17:13:01Z",
"error_codes": [
700016
],
"timestamp": "2026-04-14 17:13:01Z",
"trace_id": "64b49056-293e-49ce-b18f-73c5f35d0e00",
"correlation_id": "705f9412-1649-4140-8a07-52803aa38e73",
"error_uri": "https://login.microsoftonline.com/error?code=700016"
}
To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-cert)
util.go:297: ValidReleaseInfo=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP)
util.go:297: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured)
util.go:297: Available=False: WaitingOnInfrastructureReady(Cluster infrastructure is still provisioning)
util.go:297: ValidConfiguration=True: AsExpected(Configuration passes validation)
util.go:297: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration)
util.go:297: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured)
util.go:297: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found)
util.go:297: ReconciliationActive=True: AsExpected(Reconciliation active on resource)
util.go:297: ValidReleaseImage=True: AsExpected(Release image is valid)
util.go:297: Progressing=False: AsExpected(HostedCluster is at expected version)
util.go:297: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found)
util.go:297: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.)
util.go:297: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)
util.go:297: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured)