PR #9008 - 07-16 18:56

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

100
Total Tests
58
Passed
17
Failed
25
Skipped

Failed Tests

TestAutoscaling
53m12.69s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-qkngd/autoscaling-f4kqm in 3m14s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-f4kqm util.go:3167: Failed to wait for HostedCluster e2e-clusters-qkngd/autoscaling-f4kqm to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-qkngd/autoscaling-f4kqm invalid at RV 63532 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
38m39.68s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-qkngd/autoscaling-f4kqm in 1m48.05s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-f4kqm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-f4kqm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-f4kqm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 1m12.575s util.go:583: Successfully waited for 1 nodes to become ready in 5m39.025s eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:620: Failed to wait for HostedCluster e2e-clusters-qkngd/autoscaling-f4kqm to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-qkngd/autoscaling-f4kqm invalid at RV 63532 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:620: *v1beta1.HostedCluster e2e-clusters-qkngd/autoscaling-f4kqm conditions: util.go:620: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=True: AsExpected(All is well) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized)
TestAzureScheduler
1h12m48.14s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-ll9s2/azure-scheduler-v4rv6 in 5m0s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster azure-scheduler-v4rv6 util.go:3167: Failed to wait for HostedCluster e2e-clusters-ll9s2/azure-scheduler-v4rv6 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-ll9s2/azure-scheduler-v4rv6 invalid at RV 67219 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
56m1.2s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-ll9s2/azure-scheduler-v4rv6 in 1m21.05s util.go:322: Successfully waited for kubeconfig secret to have data in 200ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-v4rv6.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-v4rv6.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:384: Successfully waited for a successful connection to the guest API server in 21.85s util.go:583: Successfully waited for 2 nodes to become ready in 24m18.075s util.go:620: Failed to wait for HostedCluster e2e-clusters-ll9s2/azure-scheduler-v4rv6 to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-ll9s2/azure-scheduler-v4rv6 invalid at RV 67219 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:620: *v1beta1.HostedCluster e2e-clusters-ll9s2/azure-scheduler-v4rv6 conditions: util.go:620: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=True: AsExpected(All is well) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized)
TestCreateCluster
1h12m21.97s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-lq556/create-cluster-vtj6w in 3m42s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-vtj6w util.go:3167: Failed to wait for HostedCluster e2e-clusters-lq556/create-cluster-vtj6w to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-lq556/create-cluster-vtj6w invalid at RV 67137 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
56m52.64s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-lq556/create-cluster-vtj6w in 1m57.05s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-vtj6w.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-vtj6w.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-vtj6w.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 58.475s util.go:583: Successfully waited for 2 nodes to become ready in 23m57.075s eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:620: Failed to wait for HostedCluster e2e-clusters-lq556/create-cluster-vtj6w to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-lq556/create-cluster-vtj6w invalid at RV 67137 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:620: *v1beta1.HostedCluster e2e-clusters-lq556/create-cluster-vtj6w conditions: util.go:620: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=True: AsExpected(All is well) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized)
TestCreateClusterCustomConfig
1h15m14.12s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-j4q56/custom-config-zm8k4 in 3m12s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-zm8k4 util.go:3167: Failed to wait for HostedCluster e2e-clusters-j4q56/custom-config-zm8k4 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-j4q56/custom-config-zm8k4 invalid at RV 65273 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
1h0m18.09s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-j4q56/custom-config-zm8k4 in 1m18.05s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-zm8k4.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-zm8k4.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-zm8k4.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:384: Successfully waited for a successful connection to the guest API server in 1m56.95s util.go:583: Successfully waited for 2 nodes to become ready in 27m3.05s eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:620: Failed to wait for HostedCluster e2e-clusters-j4q56/custom-config-zm8k4 to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-j4q56/custom-config-zm8k4 invalid at RV 65273 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:620: *v1beta1.HostedCluster e2e-clusters-j4q56/custom-config-zm8k4 conditions: util.go:620: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:620: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=True: AsExpected(All is well) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAzureKMSConfig=True: AsExpected(All is well) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized)
TestCreateClusterHABreakGlassCredentials
38m36.27s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-lbqk4/ha-break-glass-creds-t6tlf in 3m54s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-t6tlf util.go:3167: Failed to wait for HostedCluster e2e-clusters-lbqk4/ha-break-glass-creds-t6tlf to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-lbqk4/ha-break-glass-creds-t6tlf invalid at RV 58411 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: redhat-operators-catalog, redhat-marketplace-catalog, ingress-operator, cluster-network-operator, cluster-node-tuning-operator, certified-operators-catalog, cluster-policy-controller, openshift-route-controller-manager, community-operators-catalog) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([certified-operators-catalog deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-node-tuning-operator deployment has 1 unavailable replicas, cluster-policy-controller deployment has 1 unavailable replicas, community-operators-catalog deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, oauth-openshift deployment has 1 unavailable replicas, openshift-route-controller-manager deployment has 1 unavailable replicas, redhat-marketplace-catalog deployment has 1 unavailable replicas, redhat-operators-catalog deployment has 1 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterHABreakGlassCredentials/ValidateHostedCluster
22m11.41s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-lbqk4/ha-break-glass-creds-t6tlf in 1m51.05s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-t6tlf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 20.175s util.go:583: Successfully waited for 0 nodes to become ready in 100ms util.go:3167: Failed to wait for HostedCluster e2e-clusters-lbqk4/ha-break-glass-creds-t6tlf to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-lbqk4/ha-break-glass-creds-t6tlf invalid at RV 58377 after 20m0s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: redhat-marketplace-catalog, ingress-operator, cluster-network-operator, cluster-node-tuning-operator, certified-operators-catalog, cluster-policy-controller, openshift-route-controller-manager, community-operators-catalog, redhat-operators-catalog) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([certified-operators-catalog deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-node-tuning-operator deployment has 1 unavailable replicas, cluster-policy-controller deployment has 1 unavailable replicas, community-operators-catalog deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, oauth-openshift deployment has 1 unavailable replicas, openshift-route-controller-manager deployment has 1 unavailable replicas, redhat-marketplace-catalog deployment has 1 unavailable replicas, redhat-operators-catalog deployment has 1 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
TestNodePool
0s
TestNodePool/HostedCluster0
37m59.79s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-g7xfs/node-pool-jdvb5 in 3m16s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-jdvb5 util.go:3167: Failed to wait for HostedCluster e2e-clusters-g7xfs/node-pool-jdvb5 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-g7xfs/node-pool-jdvb5 invalid at RV 44687 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
22m32.86s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-g7xfs/node-pool-jdvb5 in 1m42.075s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-jdvb5.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-jdvb5.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 50.55s util.go:583: Successfully waited for 0 nodes to become ready in 150ms eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:3167: Failed to wait for HostedCluster e2e-clusters-g7xfs/node-pool-jdvb5 to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-g7xfs/node-pool-jdvb5 invalid at RV 44687 after 20m0s: eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.)
TestNodePool/HostedCluster2
37m21.72s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-dpxb9/node-pool-cwjzw in 3m32s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-cwjzw util.go:3167: Failed to wait for HostedCluster e2e-clusters-dpxb9/node-pool-cwjzw to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-dpxb9/node-pool-cwjzw invalid at RV 43699 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
22m46.9s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-dpxb9/node-pool-cwjzw in 1m48.075s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-cwjzw.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-cwjzw.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:384: Successfully waited for a successful connection to the guest API server in 58.55s util.go:583: Successfully waited for 0 nodes to become ready in 150ms util.go:3167: Failed to wait for HostedCluster e2e-clusters-dpxb9/node-pool-cwjzw to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-dpxb9/node-pool-cwjzw invalid at RV 43699 after 20m0s: eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ValidHostedClusterStatus=True, got ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.)
TestUpgradeControlPlane
1h31m54.27s
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-1vdcb9x2/release@sha256:a9d15ae23ed23b9f5b242b35049eff2e830d9819d532643a99fa7d3f899b08f1, toImage: registry.build01.ci.openshift.org/ci-op-1vdcb9x2/release@sha256:6e5cc4c13495e784f3db167af690f90abaa1c20aabbf88f131775e5a350960ab hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-px4qr/control-plane-upgrade-h6h6s in 3m30s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-h6h6s upgrade_safe_check.go:87: UpgradeSafeFieldCheck: latch engaged for status.controlPlaneVersion util.go:3167: Failed to wait for HostedCluster e2e-clusters-px4qr/control-plane-upgrade-h6h6s to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-px4qr/control-plane-upgrade-h6h6s invalid at RV 89225 after 2s: incorrect condition: wanted Progressing=False, got Progressing=True: Progressing(HostedCluster is deploying, upgrading, or reconfiguring) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestUpgradeControlPlane/Main
47m40.94s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-px4qr/control-plane-upgrade-h6h6s in 50ms util.go:322: Successfully waited for kubeconfig secret to have data in 25ms util.go:384: Successfully waited for a successful connection to the guest API server in 25ms control_plane_upgrade_test.go:43: Starting version: 5.0.0-0.ci-2026-07-14-070042 control_plane_upgrade_test.go:53: Updating cluster image. Image: registry.build01.ci.openshift.org/ci-op-1vdcb9x2/release@sha256:6e5cc4c13495e784f3db167af690f90abaa1c20aabbf88f131775e5a350960ab eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:620: Failed to wait for HostedCluster e2e-clusters-px4qr/control-plane-upgrade-h6h6s to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-px4qr/control-plane-upgrade-h6h6s invalid at RV 89225 after 30m0s: eventually.go:228: - incorrect condition: wanted Progressing=False, got Progressing=True: Progressing(HostedCluster is deploying, upgrading, or reconfiguring) eventually.go:228: - HostedCluster version history has not been updated yet util.go:620: *v1beta1.HostedCluster e2e-clusters-px4qr/control-plane-upgrade-h6h6s conditions: util.go:620: ClusterVersionProgressing=False: FromClusterVersion(Cluster version is 5.0.0-0.ci-2026-07-14-070042) util.go:620: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="5.0.0-0.ci-2026-07-14-070042" image="registry.build01.ci.openshift.org/ci-op-1vdcb9x2/release@sha256:a9d15ae23ed23b9f5b242b35049eff2e830d9819d532643a99fa7d3f899b08f1" architecture="amd64") util.go:620: ClusterVersionUpgradeable=True: FromClusterVersion(Condition not found in the CVO.) util.go:620: ClusterVersionAvailable=True: FromClusterVersion(Done applying 5.0.0-0.ci-2026-07-14-070042) util.go:620: ClusterVersionSucceeding=True: FromClusterVersion util.go:620: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=True: AsExpected(All is well) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: ValidHostedClusterStatus=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=True: Progressing(HostedCluster is deploying, upgrading, or reconfiguring) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized) util.go:620: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)