PR #7309 - 02-25 16:00

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

83
Total Tests
48
Passed
18
Failed
17
Skipped

Failed Tests

TestAutoscaling
1h0m4.29s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-zsk8s/autoscaling-5xvpr in 2m22s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster autoscaling-5xvpr util.go:2974: Failed to wait for HostedCluster e2e-clusters-zsk8s/autoscaling-5xvpr to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-zsk8s/autoscaling-5xvpr invalid at RV 70571 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-162157-test-ci-op-478pj8gj-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
47m11.49s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-zsk8s/autoscaling-5xvpr in 1m24.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-5xvpr.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 47.4s util.go:565: Failed to wait for 1 nodes to become ready in 45m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestAzureScheduler
1h0m1.79s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-x5hzt/azure-scheduler-jfp9p in 2m17s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster azure-scheduler-jfp9p util.go:2974: Failed to wait for HostedCluster e2e-clusters-x5hzt/azure-scheduler-jfp9p to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-x5hzt/azure-scheduler-jfp9p invalid at RV 70706 after 2s: eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-162157-test-ci-op-478pj8gj-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
47m15.61s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-x5hzt/azure-scheduler-jfp9p in 1m36.1s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-jfp9p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-jfp9p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-jfp9p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-jfp9p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:370: Successfully waited for a successful connection to the guest API server in 39.475s util.go:565: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestCreateCluster
59m57.67s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-9q25d/create-cluster-hpcqd in 2m23s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster create-cluster-hpcqd util.go:2974: Failed to wait for HostedCluster e2e-clusters-9q25d/create-cluster-hpcqd to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-9q25d/create-cluster-hpcqd invalid at RV 67365 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-162157-test-ci-op-478pj8gj-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
47m54.29s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-9q25d/create-cluster-hpcqd in 1m24.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-hpcqd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-hpcqd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-hpcqd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-hpcqd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-hpcqd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-hpcqd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:370: Successfully waited for a successful connection to the guest API server in 1m30.2s util.go:565: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestCreateClusterCustomConfig
59m27.16s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-92lg9/custom-config-26mlw in 2m25s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster custom-config-26mlw util.go:2974: Failed to wait for HostedCluster e2e-clusters-92lg9/custom-config-26mlw to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-92lg9/custom-config-26mlw invalid at RV 67530 after 2s: eventually.go:227: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.22.0-0.ci-2026-02-25-162157-test-ci-op-478pj8gj-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
47m8.49s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-92lg9/custom-config-26mlw in 1m15.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-26mlw.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-26mlw.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-26mlw.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 53.4s eventually.go:258: Failed to get **v1.Node: context deadline exceeded util.go:565: Failed to wait for 2 nodes to become ready in 45m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 45m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestNodePool
0s
TestNodePool/HostedCluster0
32m5.18s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-9vc82/node-pool-x2gjd in 2m15s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster node-pool-x2gjd util.go:2974: Failed to wait for HostedCluster e2e-clusters-9vc82/node-pool-x2gjd to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-9vc82/node-pool-x2gjd invalid at RV 47212 after 2s: incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
20m13.79s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-9vc82/node-pool-x2gjd in 1m33.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-x2gjd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-x2gjd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-x2gjd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 43.375s util.go:565: Successfully waited for 0 nodes to become ready in 75ms util.go:2974: Successfully waited for HostedCluster e2e-clusters-9vc82/node-pool-x2gjd to have valid conditions in 17m51.075s
TestNodePool/HostedCluster0/ValidateHostedCluster/EnsureNoCrashingPods
170ms
util.go:780: Container machine-approver in pod machine-approver-9b78847-lvkgw has a restartCount > 0 (8)
TestNodePool/HostedCluster2
35m4.94s
hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-ntjzx/node-pool-8w4jf in 2m13s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster node-pool-8w4jf util.go:2974: Failed to wait for HostedCluster e2e-clusters-ntjzx/node-pool-8w4jf to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-ntjzx/node-pool-8w4jf invalid at RV 47503 after 2s: eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: machine-approver) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
22m19.57s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-ntjzx/node-pool-8w4jf in 1m42.05s util.go:308: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-8w4jf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:370: Successfully waited for a successful connection to the guest API server in 37.35s util.go:565: Successfully waited for 0 nodes to become ready in 50ms eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:2974: Failed to wait for HostedCluster e2e-clusters-ntjzx/node-pool-8w4jf to have valid conditions in 20m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-ntjzx/node-pool-8w4jf invalid at RV 47503 after 20m0s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: machine-approver) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas)
TestUpgradeControlPlane
1h4m31.03s
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-478pj8gj/release@sha256:8bacab7e1e3dac992c35519ca1f92c971b13b7d0477c895b0b95628cd818b043, toImage: registry.build01.ci.openshift.org/ci-op-478pj8gj/release@sha256:fa520b1542a49795f4fb53dbdb48eb3d50acf7a119494d358d396eab12262984 hypershift_framework.go:459: Successfully created hostedcluster e2e-clusters-sz5gd/control-plane-upgrade-9kn6n in 2m23s hypershift_framework.go:128: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-9kn6n util.go:2974: Failed to wait for HostedCluster e2e-clusters-sz5gd/control-plane-upgrade-9kn6n to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-sz5gd/control-plane-upgrade-9kn6n invalid at RV 67682 after 2s: incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(machine-approver deployment has 1 unavailable replicas) hypershift_framework.go:278: skipping postTeardown() hypershift_framework.go:256: skipping teardown, already called
TestUpgradeControlPlane/Main
30m2.07s
util.go:291: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-sz5gd/control-plane-upgrade-9kn6n in 50ms util.go:308: Successfully waited for kubeconfig secret to have data in 50ms util.go:370: Successfully waited for a successful connection to the guest API server in 25ms control_plane_upgrade_test.go:52: Updating cluster image. Image: registry.build01.ci.openshift.org/ci-op-478pj8gj/release@sha256:fa520b1542a49795f4fb53dbdb48eb3d50acf7a119494d358d396eab12262984 util.go:598: Successfully waited for HostedCluster e2e-clusters-sz5gd/control-plane-upgrade-9kn6n to rollout in 50ms
TestUpgradeControlPlane/Main/EnsureNoCrashingPods
150ms
util.go:780: Container machine-approver in pod machine-approver-76f5f94455-5fwb8 has a restartCount > 0 (9)
TestUpgradeControlPlane/Main/Wait_for_control_plane_components_to_complete_rollout
30m0s
eventually.go:258: Failed to get **v1beta1.ControlPlaneComponent: client rate limiter Wait returned an error: context deadline exceeded util.go:638: Failed to wait for control plane components to complete rollout in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1beta1.ControlPlaneComponent state after 30m0s eventually.go:400: - observed **v1beta1.ControlPlaneComponent e2e-clusters-sz5gd-control-plane-upgrade-9kn6n/machine-approver invalid: incorrect condition: wanted RolloutComplete=True, got RolloutComplete=False: WaitingForRolloutComplete(Waiting for deployment machine-approver rollout to finish: 1 out of 1 new replicas have been updated) util.go:638: *v1beta1.ControlPlaneComponent e2e-clusters-sz5gd-control-plane-upgrade-9kn6n/machine-approver conditions: util.go:638: Available=False: WaitingForAvailable(Deployment machine-approver is not available: Deployment does not have minimum availability.) util.go:638: RolloutComplete=False: WaitingForRolloutComplete(Waiting for deployment machine-approver rollout to finish: 1 out of 1 new replicas have been updated)