PR #6239 - 11-06 11:34

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

70
Total Tests
38
Passed
16
Failed
16
Skipped

Failed Tests

TestAutoscaling
27m16.35s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-lfhl9/autoscaling-q6rxh in 2m37s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster autoscaling-q6rxh util.go:2835: Failed to wait for HostedCluster e2e-clusters-lfhl9/autoscaling-q6rxh to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-lfhl9/autoscaling-q6rxh invalid at RV 33414 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-autoscaling-q6rxh.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-autoscaling-q6rxh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-120126-test-ci-op-n80h1ibs-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-q6rxh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
13m27.1s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-lfhl9/autoscaling-q6rxh in 3m27.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-q6rxh.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-q6rxh.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestAzureScheduler
46m57.86s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-mqr94/azure-scheduler-fd6s9 in 2m24s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster azure-scheduler-fd6s9 util.go:2835: Failed to wait for HostedCluster e2e-clusters-mqr94/azure-scheduler-fd6s9 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-mqr94/azure-scheduler-fd6s9 invalid at RV 35873 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-120126-test-ci-op-n80h1ibs-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
33m52.82s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-mqr94/azure-scheduler-fd6s9 in 3m12.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-fd6s9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-fd6s9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-fd6s9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-fd6s9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:359: Successfully waited for a successful connection to the guest API server in 40.725s util.go:541: Failed to wait for 2 nodes to become ready in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestCreateCluster
26m47.18s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-n2hzd/create-cluster-8qwkl in 2m38s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster create-cluster-8qwkl util.go:2835: Failed to wait for HostedCluster e2e-clusters-n2hzd/create-cluster-8qwkl to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-n2hzd/create-cluster-8qwkl invalid at RV 35604 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-create-cluster-8qwkl.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-create-cluster-8qwkl.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-120126-test-ci-op-n80h1ibs-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-8qwkl.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
13m27.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-n2hzd/create-cluster-8qwkl in 3m27.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-8qwkl.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-8qwkl.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterCustomConfig
24m55.14s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-hwkw6/custom-config-mg7r2 in 2m37s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster custom-config-mg7r2 util.go:2835: Failed to wait for HostedCluster e2e-clusters-hwkw6/custom-config-mg7r2 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-hwkw6/custom-config-mg7r2 invalid at RV 34600 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-custom-config-mg7r2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-custom-config-mg7r2.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-120126-test-ci-op-n80h1ibs-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(redhat-operators-catalog deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-mg7r2.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
12m39.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-hwkw6/custom-config-mg7r2 in 2m39.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-mg7r2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-mg7r2.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster0
25m44.9s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-ls4bx/node-pool-tvsg2 in 2m38s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-tvsg2 util.go:2835: Successfully waited for HostedCluster e2e-clusters-ls4bx/node-pool-tvsg2 to have valid conditions in 50ms hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
12m55.4s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-ls4bx/node-pool-tvsg2 in 3m6.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-tvsg2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-tvsg2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:359: Successfully waited for a successful connection to the guest API server in 24.475s util.go:541: Successfully waited for 0 nodes to become ready in 75ms util.go:2835: Successfully waited for HostedCluster e2e-clusters-ls4bx/node-pool-tvsg2 to have valid conditions in 9m18.05s
TestNodePool/HostedCluster0/ValidateHostedCluster/EnsureNoCrashingPods
210ms
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-ls4bx/node-pool-tvsg2 in 50ms util.go:297: Successfully waited for kubeconfig secret to have data in 50ms util.go:758: Container webhook in pod network-node-identity-68d554b54b-rzb9p has a restartCount > 0 (1)
TestNodePool/HostedCluster2
26m4.21s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-czh85/node-pool-xdr94 in 2m46s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-xdr94 util.go:2835: Failed to wait for HostedCluster e2e-clusters-czh85/node-pool-xdr94 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-czh85/node-pool-xdr94 invalid at RV 33415 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-node-pool-xdr94.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-node-pool-xdr94.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-xdr94.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
13m15.13s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-czh85/node-pool-xdr94 in 3m15.075s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-xdr94.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-xdr94.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestUpgradeControlPlane
26m34.79s
control_plane_upgrade_test.go:26: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-n80h1ibs/release@sha256:806106e231f7ef70bf59e02d318b05f90c79ea53c2d3425560845b64e61b03a0, toImage: registry.build01.ci.openshift.org/ci-op-n80h1ibs/release@sha256:817c01693eeb0ab9788bcf85d2bb9e56e400512a1d039c2ba7f758e78da33266 hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-tjnjj/control-plane-upgrade-zkm5w in 2m23s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-zkm5w util.go:2835: Failed to wait for HostedCluster e2e-clusters-tjnjj/control-plane-upgrade-zkm5w to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-tjnjj/control-plane-upgrade-zkm5w invalid at RV 35868 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-012216: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-zkm5w.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-control-plane-upgrade-zkm5w.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-control-plane-upgrade-zkm5w.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
13m45.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tjnjj/control-plane-upgrade-zkm5w in 3m45.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-zkm5w.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-control-plane-upgrade-zkm5w.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded