PR #8695 - 07-21 16:31

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-xl9lc/autoscaling-vh2c5 in 2m46s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-vh2c5 util.go:3158: Failed to wait for HostedCluster e2e-clusters-xl9lc/autoscaling-vh2c5 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-xl9lc/autoscaling-vh2c5 invalid at RV 87821 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: cluster-version-operator, hosted-cluster-config-operator, cluster-image-registry-operator, packageserver, csi-snapshot-controller-operator, catalog-operator, dns-operator, cluster-storage-operator, cluster-network-operator, ingress-operator, olm-operator) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 2 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-xl9lc/autoscaling-vh2c5 in 2m6.05s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-vh2c5.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 51.325s eventually.go:259: Failed to get **v1.Node: context deadline exceeded util.go:583: Failed to wait for 1 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 1 nodes, got 0

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-mbr6l/azure-scheduler-vxwl9 in 2m49s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster azure-scheduler-vxwl9 util.go:3158: Failed to wait for HostedCluster e2e-clusters-mbr6l/azure-scheduler-vxwl9 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-mbr6l/azure-scheduler-vxwl9 invalid at RV 87602 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: hosted-cluster-config-operator, cluster-image-registry-operator, olm-operator, csi-snapshot-controller-operator, dns-operator, cluster-version-operator, cluster-storage-operator, ingress-operator, catalog-operator, packageserver, cluster-network-operator) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 2 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas]) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-mbr6l/azure-scheduler-vxwl9 in 1m51.075s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-vxwl9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-vxwl9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-vxwl9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-vxwl9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 59.7s util.go:583: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 2 nodes, got 0

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-w7q8l/custom-config-jmf8k in 1m54.075s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-jmf8k.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-jmf8k.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-jmf8k.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:384: Successfully waited for a successful connection to the guest API server in 1m11.775s eventually.go:259: Failed to get **v1.Node: context deadline exceeded util.go:583: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:384: observed invalid **v1.Node state after 45m0s eventually.go:401: - observed **v1.Node collection invalid: expected 2 nodes, got 0

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-78bvg/ha-break-glass-creds-zm2qv in 2m55s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-zm2qv util.go:3158: Failed to wait for HostedCluster e2e-clusters-78bvg/ha-break-glass-creds-zm2qv to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-78bvg/ha-break-glass-creds-zm2qv invalid at RV 57136 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: dns-operator, olm-operator, hosted-cluster-config-operator, csi-snapshot-controller-operator, catalog-operator, packageserver, cluster-storage-operator, cluster-image-registry-operator, cluster-version-operator, cluster-network-operator, ingress-operator) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 3 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-78bvg/ha-break-glass-creds-zm2qv in 2m24.05s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-zm2qv.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 15.275s util.go:583: Successfully waited for 0 nodes to become ready in 125ms eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:3158: Failed to wait for HostedCluster e2e-clusters-78bvg/ha-break-glass-creds-zm2qv to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-78bvg/ha-break-glass-creds-zm2qv invalid at RV 57089 after 20m0s: eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: dns-operator, olm-operator, hosted-cluster-config-operator, csi-snapshot-controller-operator, catalog-operator, packageserver, cluster-storage-operator, cluster-image-registry-operator, cluster-version-operator, cluster-network-operator, ingress-operator) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 3 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-d8dzb/node-pool-vg84p in 2m35s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-vg84p util.go:3158: Failed to wait for HostedCluster e2e-clusters-d8dzb/node-pool-vg84p to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-d8dzb/node-pool-vg84p invalid at RV 56549 after 2s: eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: cluster-version-operator, cluster-network-operator, packageserver, cluster-storage-operator, csi-snapshot-controller-operator, catalog-operator, olm-operator, ingress-operator, cluster-image-registry-operator, dns-operator, hosted-cluster-config-operator) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas]) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-d8dzb/node-pool-vg84p in 1m27.05s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-vg84p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-vg84p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 1m7.175s util.go:583: Successfully waited for 0 nodes to become ready in 150ms util.go:3158: Failed to wait for HostedCluster e2e-clusters-d8dzb/node-pool-vg84p to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-d8dzb/node-pool-vg84p invalid at RV 56494 after 20m0s: eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: ingress-operator, cluster-image-registry-operator, dns-operator, hosted-cluster-config-operator, cluster-version-operator, cluster-network-operator, packageserver, cluster-storage-operator, csi-snapshot-controller-operator, catalog-operator, olm-operator) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-kw8v4/node-pool-wbrp2 in 2m44s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-wbrp2 util.go:3158: Failed to wait for HostedCluster e2e-clusters-kw8v4/node-pool-wbrp2 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-kw8v4/node-pool-wbrp2 invalid at RV 56953 after 2s: eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: olm-operator, packageserver, cluster-version-operator, ingress-operator, catalog-operator, cluster-network-operator, csi-snapshot-controller-operator, hosted-cluster-config-operator, cluster-storage-operator, dns-operator, cluster-image-registry-operator) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas]) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-kw8v4/node-pool-wbrp2 in 1m48.25s util.go:322: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-wbrp2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:384: Successfully waited for a successful connection to the guest API server in 1m0.325s util.go:583: Successfully waited for 0 nodes to become ready in 125ms util.go:3158: Failed to wait for HostedCluster e2e-clusters-kw8v4/node-pool-wbrp2 to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-kw8v4/node-pool-wbrp2 invalid at RV 56953 after 20m0s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: olm-operator, packageserver, cluster-version-operator, ingress-operator, catalog-operator, cluster-network-operator, csi-snapshot-controller-operator, hosted-cluster-config-operator, cluster-storage-operator, dns-operator, cluster-image-registry-operator) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - incorrect condition: wanted ConfigOperatorReconciliationSucceeded=True, got ConfigOperatorReconciliationSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas]) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed

control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-mvth72f4/release@sha256:9e4894529668fec35e364104cdd3346385f0d04f0ee2209bd5b96b5a1910a6e4, toImage: registry.build01.ci.openshift.org/ci-op-mvth72f4/release@sha256:c2c96fd5071c3caf097abdc2dd6fe4d38b1729075ab827ff32450bfed2e83a7f hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd in 2m58s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-p7rmd upgrade_safe_check.go:87: UpgradeSafeFieldCheck: latch engaged for status.controlPlaneVersion util.go:3158: Failed to wait for HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd invalid at RV 73479 after 2s: eventually.go:228: - incorrect condition: wanted Progressing=False, got Progressing=True: Progressing(HostedCluster is deploying, upgrading, or reconfiguring) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(cluster-version-operator deployment has 1 unavailable replicas) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsUpdating(Cluster operators csi-snapshot-controller, dns, image-registry, ingress, network, node-tuning, storage are updating versions) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd in 50ms util.go:322: Successfully waited for kubeconfig secret to have data in 25ms util.go:384: Successfully waited for a successful connection to the guest API server in 25ms control_plane_upgrade_test.go:43: Starting version: 5.0.0-0.ci-2026-07-20-062541 control_plane_upgrade_test.go:53: Updating cluster image. Image: registry.build01.ci.openshift.org/ci-op-mvth72f4/release@sha256:c2c96fd5071c3caf097abdc2dd6fe4d38b1729075ab827ff32450bfed2e83a7f eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:620: Failed to wait for HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd invalid at RV 73479 after 30m0s: eventually.go:228: - incorrect condition: wanted Progressing=False, got Progressing=True: Progressing(HostedCluster is deploying, upgrading, or reconfiguring) eventually.go:228: - HostedCluster version history has not been updated yet util.go:620: *v1beta1.HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd conditions: util.go:620: ClusterVersionSucceeding=False: ClusterOperatorsUpdating(Cluster operators csi-snapshot-controller, dns, image-registry, ingress, network, node-tuning, storage are updating versions) util.go:620: ClusterVersionProgressing=False: ClusterOperatorsUpdating(Error while reconciling 5.0.0-0.ci-2026-07-20-062541: csi-snapshot-controller, dns, image-registry, ingress, network, node-tuning, storage has an unknown error: ClusterOperatorsUpdating) util.go:620: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="5.0.0-0.ci-2026-07-20-062541" image="registry.build01.ci.openshift.org/ci-op-mvth72f4/release@sha256:9e4894529668fec35e364104cdd3346385f0d04f0ee2209bd5b96b5a1910a6e4" architecture="amd64") util.go:620: ClusterVersionUpgradeable=True: FromClusterVersion(Condition not found in the CVO.) util.go:620: ClusterVersionAvailable=True: FromClusterVersion(Done applying 5.0.0-0.ci-2026-07-20-062541) util.go:620: Degraded=True: UnavailableReplicas(cluster-version-operator deployment has 1 unavailable replicas) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=True: AsExpected(All is well) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=True: Progressing(HostedCluster is deploying, upgrading, or reconfiguring) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized) util.go:620: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)

eventually.go:259: Failed to get **v1beta1.ControlPlaneComponent: client rate limiter Wait returned an error: context deadline exceeded util.go:687: Failed to wait for control plane components to complete rollout in 30m0s: context deadline exceeded eventually.go:384: observed invalid **v1beta1.ControlPlaneComponent state after 30m0s eventually.go:401: - observed **v1beta1.ControlPlaneComponent e2e-clusters-gpkbf-control-plane-upgrade-p7rmd/cluster-version-operator invalid: eventually.go:404: - incorrect condition: wanted RolloutComplete=True, got RolloutComplete=False: WaitingForRolloutComplete(Waiting for deployment cluster-version-operator rollout to finish: 1 out of 1 new replicas have been updated) eventually.go:404: - component cluster-version-operator is still on version 5.0.0-0.ci-2026-07-20-062541 util.go:687: *v1beta1.ControlPlaneComponent e2e-clusters-gpkbf-control-plane-upgrade-p7rmd/cluster-version-operator conditions: util.go:687: Available=True: AsExpected(Deployment cluster-version-operator is available) util.go:687: RolloutComplete=False: WaitingForRolloutComplete(Waiting for deployment cluster-version-operator rollout to finish: 1 out of 1 new replicas have been updated)

eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:667: Failed to wait for HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd controlPlaneVersion to complete in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd invalid at RV 73479 after 30m0s: controlPlaneVersion state is Partial, waiting for Completed util.go:667: *v1beta1.HostedCluster e2e-clusters-gpkbf/control-plane-upgrade-p7rmd conditions: util.go:667: ClusterVersionSucceeding=False: ClusterOperatorsUpdating(Cluster operators csi-snapshot-controller, dns, image-registry, ingress, network, node-tuning, storage are updating versions) util.go:667: ClusterVersionProgressing=False: ClusterOperatorsUpdating(Error while reconciling 5.0.0-0.ci-2026-07-20-062541: csi-snapshot-controller, dns, image-registry, ingress, network, node-tuning, storage has an unknown error: ClusterOperatorsUpdating) util.go:667: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="5.0.0-0.ci-2026-07-20-062541" image="registry.build01.ci.openshift.org/ci-op-mvth72f4/release@sha256:9e4894529668fec35e364104cdd3346385f0d04f0ee2209bd5b96b5a1910a6e4" architecture="amd64") util.go:667: ClusterVersionUpgradeable=True: FromClusterVersion(Condition not found in the CVO.) util.go:667: ClusterVersionAvailable=True: FromClusterVersion(Done applying 5.0.0-0.ci-2026-07-20-062541) util.go:667: Degraded=True: UnavailableReplicas(cluster-version-operator deployment has 1 unavailable replicas) util.go:667: EtcdAvailable=True: QuorumAvailable util.go:667: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:667: InfrastructureReady=True: AsExpected(All is well) util.go:667: ExternalDNSReachable=True: AsExpected(All is well) util.go:667: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:667: ValidReleaseInfo=True: AsExpected(All is well) util.go:667: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:667: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:667: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:667: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:667: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:667: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:667: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:667: Available=True: AsExpected(The hosted control plane is available) util.go:667: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:667: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:667: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:667: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:667: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:667: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:667: Progressing=True: Progressing(HostedCluster is deploying, upgrading, or reconfiguring) util.go:667: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:667: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:667: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:667: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:667: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:667: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:667: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized) util.go:667: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)

hypershift_framework.go:576: Failed to destroy cluster, will retry: failed to wait for resource group deletion control-plane-upgrade-p7rmd-vnet-control-plane-upgrade-p7rmd: context canceled hypershift_framework.go:589: Failed to destroy cluster: context canceled util.go:213: Failed to delete namespace: e2e-clusters-gpkbf, will retry: client rate limiter Wait returned an error: context canceled hypershift_framework.go:605: Failed to delete test namespace: failed to delete namespace: context canceled hypershift_framework.go:546: archiving /logs/artifacts/TestUpgradeControlPlane/hostedcluster-control-plane-upgrade-p7rmd to /logs/artifacts/TestUpgradeControlPlane/hostedcluster.tar.gz