PR #7795 - 02-25 09:32

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

78
Total Tests
44
Passed
17
Failed
17
Skipped

Failed Tests

TestAutoscaling
1h1m37.94s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-tb4fb/autoscaling-5d267 in 2m35s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster autoscaling-5d267 util.go:2974: Failed to wait for HostedCluster e2e-clusters-tb4fb/autoscaling-5d267 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-tb4fb/autoscaling-5d267 invalid at RV 62272 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-094356-test-ci-op-ktjpmbtb-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
47m42.62s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tb4fb/autoscaling-5d267 in 1m42.075s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-5d267.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 1m0.5s eventually.go:258: Failed to get **v1.Node: context deadline exceeded util.go:565: Failed to wait for 1 nodes to become ready in 45m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestAzureScheduler
1h2m0.53s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-jx82l/azure-scheduler-s6pkm in 2m31s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster azure-scheduler-s6pkm util.go:2974: Failed to wait for HostedCluster e2e-clusters-jx82l/azure-scheduler-s6pkm to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-jx82l/azure-scheduler-s6pkm invalid at RV 68643 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-094356-test-ci-op-ktjpmbtb-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
47m40.97s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-jx82l/azure-scheduler-s6pkm in 1m42.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 58.7s eventually.go:258: Failed to get **v1.Node: Get "https://api-azure-scheduler-s6pkm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": context deadline exceeded util.go:565: Failed to wait for 2 nodes to become ready in 45m0.15s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0.175s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestCreateCluster
1h0m21.24s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-9xnsg/create-cluster-s7vrq in 2m35s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster create-cluster-s7vrq util.go:2974: Failed to wait for HostedCluster e2e-clusters-9xnsg/create-cluster-s7vrq to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-9xnsg/create-cluster-s7vrq invalid at RV 62010 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-094356-test-ci-op-ktjpmbtb-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
47m40.72s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-9xnsg/create-cluster-s7vrq in 1m33.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-s7vrq.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 1m7.625s util.go:565: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestCreateClusterCustomConfig
1h1m10.19s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-kjhl2/custom-config-85nn9 in 2m37s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster custom-config-85nn9 util.go:2974: Failed to wait for HostedCluster e2e-clusters-kjhl2/custom-config-85nn9 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-kjhl2/custom-config-85nn9 invalid at RV 62657 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-094356-test-ci-op-ktjpmbtb-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
47m38.71s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-kjhl2/custom-config-85nn9 in 1m36.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-85nn9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-85nn9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-85nn9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 1m2.625s util.go:565: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestNodePool
0s
TestNodePool/HostedCluster0
36m7.47s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-kn8r9/node-pool-hjz7m in 2m31s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster node-pool-hjz7m util.go:2974: Failed to wait for HostedCluster e2e-clusters-kn8r9/node-pool-hjz7m to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-kn8r9/node-pool-hjz7m invalid at RV 43002 after 2s: eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: machine-approver) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
22m42.97s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-kn8r9/node-pool-hjz7m in 1m36.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hjz7m.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hjz7m.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hjz7m.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hjz7m.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hjz7m.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hjz7m.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 1m6.75s util.go:565: Successfully waited for 0 nodes to become ready in 75ms eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline util.go:2974: Failed to wait for HostedCluster e2e-clusters-kn8r9/node-pool-hjz7m to have valid conditions in 20m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-kn8r9/node-pool-hjz7m invalid at RV 43002 after 20m0s: eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: machine-approver)
TestNodePool/HostedCluster2
37m9.26s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-78qsq/node-pool-wgfn4 in 2m31s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster node-pool-wgfn4 util.go:2974: Failed to wait for HostedCluster e2e-clusters-78qsq/node-pool-wgfn4 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-78qsq/node-pool-wgfn4 invalid at RV 45197 after 2s: eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: machine-approver) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
22m44.05s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-78qsq/node-pool-wgfn4 in 1m36.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-wgfn4.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-wgfn4.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 1m7.775s util.go:565: Successfully waited for 0 nodes to become ready in 75ms util.go:2974: Failed to wait for HostedCluster e2e-clusters-78qsq/node-pool-wgfn4 to have valid conditions in 20m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-78qsq/node-pool-wgfn4 invalid at RV 45197 after 20m0s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: machine-approver) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas)
TestUpgradeControlPlane
1h6m15.69s
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-ktjpmbtb/release@sha256:8bacab7e1e3dac992c35519ca1f92c971b13b7d0477c895b0b95628cd818b043, toImage: registry.build01.ci.openshift.org/ci-op-ktjpmbtb/release@sha256:e61d4efb5e7febb99bf93058e16149eb0f60c342a4ce21179128e724b1de386b hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-tjf65/control-plane-upgrade-l8sc5 in 2m45s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-l8sc5 util.go:2974: Failed to wait for HostedCluster e2e-clusters-tjf65/control-plane-upgrade-l8sc5 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-tjf65/control-plane-upgrade-l8sc5 invalid at RV 66765 after 2s: incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestUpgradeControlPlane/Main
30m1.7s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tjf65/control-plane-upgrade-l8sc5 in 50ms util.go:308: Successfully waited for kubeconfig secret to have data in 50ms util.go:370: Successfully waited for a successful connection to the guest API server in 50ms control_plane_upgrade_test.go:52: Updating cluster image. Image: registry.build01.ci.openshift.org/ci-op-ktjpmbtb/release@sha256:e61d4efb5e7febb99bf93058e16149eb0f60c342a4ce21179128e724b1de386b util.go:598: Successfully waited for HostedCluster e2e-clusters-tjf65/control-plane-upgrade-l8sc5 to rollout in 50ms
TestUpgradeControlPlane/Main/EnsureNoCrashingPods
160ms
util.go:780: Container machine-approver in pod machine-approver-5f854d4f84-sch7q has a restartCount > 0 (9)
TestUpgradeControlPlane/Main/Wait_for_control_plane_components_to_complete_rollout
30m0s
eventually.go:258: Failed to get **v1beta1.ControlPlaneComponent: client rate limiter Wait returned an error: context deadline exceeded util.go:638: Failed to wait for control plane components to complete rollout in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1beta1.ControlPlaneComponent state after 30m0s eventually.go:400: - observed **v1beta1.ControlPlaneComponent e2e-clusters-tjf65-control-plane-upgrade-l8sc5/machine-approver invalid: incorrect condition: wanted RolloutComplete=True, got RolloutComplete=False: WaitingForRolloutComplete(Waiting for deployment machine-approver rollout to finish: 1 out of 1 new replicas have been updated) util.go:638: *v1beta1.ControlPlaneComponent e2e-clusters-tjf65-control-plane-upgrade-l8sc5/machine-approver conditions: util.go:638: Available=False: WaitingForAvailable(Deployment machine-approver is not available: Deployment does not have minimum availability.) util.go:638: RolloutComplete=False: WaitingForRolloutComplete(Waiting for deployment machine-approver rollout to finish: 1 out of 1 new replicas have been updated)