PR #9587 - 09-11 17:26

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

92
Total Tests
49
Passed
17
Failed
26
Skipped

Failed Tests

TestAutoscaling
26m34.22s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-fhw7s/autoscaling-xkfkv in 3m6s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-xkfkv util.go:3236: Failed to wait for HostedCluster e2e-clusters-fhw7s/autoscaling-xkfkv to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-fhw7s/autoscaling-xkfkv invalid at RV 39352 after 2s: incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available); incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion; incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available); incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity); incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-11-174958-test-ci-op-0bfcwxq5-latest: some cluster operators are not available); incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-xkfkv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-autoscaling-xkfkv.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-autoscaling-xkfkv.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-autoscaling-xkfkv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
11m33.15s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-fhw7s/autoscaling-xkfkv in 1m33.1s util.go:328: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-xkfkv.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-xkfkv.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestAzureScheduler
26m53.92s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-5x6fw/azure-scheduler-smfq6 in 3m17s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster azure-scheduler-smfq6 util.go:3236: Failed to wait for HostedCluster e2e-clusters-5x6fw/azure-scheduler-smfq6 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-5x6fw/azure-scheduler-smfq6 invalid at RV 37786 after 2s: incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-azure-scheduler-smfq6.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-azure-scheduler-smfq6.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-azure-scheduler-smfq6.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-azure-scheduler-smfq6.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion; incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available); incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-11-174958-test-ci-op-0bfcwxq5-latest: some cluster operators are not available); incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available); incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
11m21.15s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-5x6fw/azure-scheduler-smfq6 in 1m21.075s util.go:328: Successfully waited for kubeconfig secret to have data in 75ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-smfq6.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-azure-scheduler-smfq6.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateCluster
27m1.11s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-psjkp/create-cluster-tlz4p in 3m10s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-tlz4p util.go:3236: Failed to wait for HostedCluster e2e-clusters-psjkp/create-cluster-tlz4p to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-psjkp/create-cluster-tlz4p invalid at RV 41387 after 2s: incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available); incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available); incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity); incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-11-174958-test-ci-op-0bfcwxq5-latest: some cluster operators are not available); incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-create-cluster-tlz4p.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-create-cluster-tlz4p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-create-cluster-tlz4p.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion; incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-tlz4p.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
11m42.13s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-psjkp/create-cluster-tlz4p in 1m42.075s util.go:328: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-tlz4p.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-tlz4p.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterCustomConfig
27m32.14s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-lbfsv/custom-config-cshw6 in 4m57s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-cshw6 util.go:3236: Failed to wait for HostedCluster e2e-clusters-lbfsv/custom-config-cshw6 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-lbfsv/custom-config-cshw6 invalid at RV 39813 after 2s: incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available); incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion; incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity); incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-11-174958-test-ci-op-0bfcwxq5-latest: some cluster operators are not available); incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-cshw6.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available); incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-custom-config-cshw6.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-custom-config-cshw6.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-custom-config-cshw6.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
11m6.13s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-lbfsv/custom-config-cshw6 in 1m6.075s util.go:328: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-cshw6.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-cshw6.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterHABreakGlassCredentials
27m51.37s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-gtz77/ha-break-glass-creds-5jqjz in 3m20s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-5jqjz util.go:3236: Failed to wait for HostedCluster e2e-clusters-gtz77/ha-break-glass-creds-5jqjz to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-gtz77/ha-break-glass-creds-5jqjz invalid at RV 41269 after 2s: incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-ha-break-glass-creds-5jqjz.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-ha-break-glass-creds-5jqjz.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-ha-break-glass-creds-5jqjz.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-ha-break-glass-creds-5jqjz.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterHABreakGlassCredentials/ValidateHostedCluster
11m42.09s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-gtz77/ha-break-glass-creds-5jqjz in 1m42.05s util.go:328: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-5jqjz.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-ha-break-glass-creds-5jqjz.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster0
26m49.93s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-vr5sw/node-pool-wlzgg in 3m18s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-wlzgg util.go:3236: Failed to wait for HostedCluster e2e-clusters-vr5sw/node-pool-wlzgg to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-vr5sw/node-pool-wlzgg invalid at RV 39099 after 2s: incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-node-pool-wlzgg.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-node-pool-wlzgg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-node-pool-wlzgg.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-wlzgg.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
11m21.14s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-vr5sw/node-pool-wlzgg in 1m21.1s util.go:328: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-wlzgg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-wlzgg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool/HostedCluster2
26m11.43s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-vsrvj/node-pool-kkb2x in 3m8s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-kkb2x util.go:3236: Failed to wait for HostedCluster e2e-clusters-vsrvj/node-pool-kkb2x to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-vsrvj/node-pool-kkb2x invalid at RV 41184 after 2s: incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-kkb2x.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-node-pool-kkb2x.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-node-pool-kkb2x.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-node-pool-kkb2x.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
11m33.12s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-vsrvj/node-pool-kkb2x in 1m33.075s util.go:328: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-kkb2x.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-kkb2x.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestUpgradeControlPlane
28m53.15s
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build09.ci.openshift.org/ci-op-0bfcwxq5/release@sha256:c8384a76629d408988215a758a643305873020b6237a0b7cb46338daf27dd545, toImage: registry.build09.ci.openshift.org/ci-op-0bfcwxq5/release@sha256:070aa0e8d10122a2bf20086fe585ea6313a0f9ef5c2696dee5428733d4ba519a hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-x8hbg/control-plane-upgrade-7ftwl in 4m6s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-7ftwl util.go:3236: Failed to wait for HostedCluster e2e-clusters-x8hbg/control-plane-upgrade-7ftwl to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-x8hbg/control-plane-upgrade-7ftwl invalid at RV 43039 after 2s: incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available); incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available); incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion; incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.1.0-0.ci-2026-09-09-150908: some cluster operators are not available); incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-7ftwl.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host); incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(health check to APIServer endpoint api-control-plane-upgrade-7ftwl.aks-e2e.hypershift.azure.devcluster.openshift.com failed: Get "https://api-control-plane-upgrade-7ftwl.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz?verbose": dial tcp: lookup api-control-plane-upgrade-7ftwl.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
11m48.15s
util.go:311: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-x8hbg/control-plane-upgrade-7ftwl in 1m48.075s util.go:328: Successfully waited for kubeconfig secret to have data in 75ms eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-7ftwl.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-control-plane-upgrade-7ftwl.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:390: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded