PR #7137 - 11-04 11:01

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

90
Total Tests
40
Passed
25
Failed
25
Skipped

Failed Tests

TestAutoscaling
24m40.07s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-vf875/autoscaling-nxckb in 2m34s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster autoscaling-nxckb util.go:2835: Failed to wait for HostedCluster e2e-clusters-vf875/autoscaling-nxckb to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-vf875/autoscaling-nxckb invalid at RV 34397 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-autoscaling-nxckb.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-autoscaling-nxckb.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-113819-test-ci-op-nhqbyfzw-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-nxckb.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
12m24.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-vf875/autoscaling-nxckb in 2m24.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-nxckb.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-nxckb.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestAzureScheduler
45m55.97s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-4txkn/azure-scheduler-v78xn in 2m29s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster azure-scheduler-v78xn util.go:2835: Failed to wait for HostedCluster e2e-clusters-4txkn/azure-scheduler-v78xn to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-4txkn/azure-scheduler-v78xn invalid at RV 34141 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-113819-test-ci-op-nhqbyfzw-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
33m0.52s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-4txkn/azure-scheduler-v78xn in 2m30.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-v78xn.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-azure-scheduler-v78xn.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-v78xn.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:359: Successfully waited for a successful connection to the guest API server in 30.425s util.go:541: Failed to wait for 2 nodes to become ready in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestCreateCluster
25m18.21s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-nf8x2/create-cluster-jx478 in 2m29s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster create-cluster-jx478 util.go:2835: Failed to wait for HostedCluster e2e-clusters-nf8x2/create-cluster-jx478 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-nf8x2/create-cluster-jx478 invalid at RV 34305 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-jx478.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-create-cluster-jx478.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-create-cluster-jx478.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-113819-test-ci-op-nhqbyfzw-latest: some cluster operators are not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
12m42.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-nf8x2/create-cluster-jx478 in 2m42.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-jx478.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-jx478.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterCustomConfig
24m17.49s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-7wqlx/custom-config-hv6pg in 2m21s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster custom-config-hv6pg util.go:2835: Failed to wait for HostedCluster e2e-clusters-7wqlx/custom-config-hv6pg to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-7wqlx/custom-config-hv6pg invalid at RV 34122 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-custom-config-hv6pg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-custom-config-hv6pg.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-113819-test-ci-op-nhqbyfzw-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-hv6pg.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
12m30.08s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-7wqlx/custom-config-hv6pg in 2m30.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-hv6pg.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-hv6pg.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster0
53m48.39s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-8g7h2/node-pool-tczgw in 2m45s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-tczgw util.go:2835: Successfully waited for HostedCluster e2e-clusters-8g7h2/node-pool-tczgw to have valid conditions in 75ms hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster0/Main
160ms
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-8g7h2/node-pool-tczgw in 50ms util.go:297: Successfully waited for kubeconfig secret to have data in 50ms util.go:359: Successfully waited for a successful connection to the guest API server in 25ms
TestNodePool/HostedCluster0/Main/TestMirrorConfigs
30m0.07s
nodepool_mirrorconfigs_test.go:61: Starting test MirrorConfigsTest eventually.go:258: Failed to get **v1.Node: Get "https://api-node-pool-tczgw.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes?labelSelector=hypershift.openshift.io%2FnodePool%3Dnode-pool-tczgw-test-mirrorconfigs": context deadline exceeded util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-mirrorconfigs in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNTOMachineConfigAppliedInPlace
30m0.07s
nodepool_nto_machineconfig_test.go:68: Starting test NTOMachineConfigRolloutTest util.go:541: Failed to wait for 2 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-ntomachineconfig-inplace in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNTOMachineConfigGetsRolledOut
30m0.07s
nodepool_nto_machineconfig_test.go:68: Starting test NTOMachineConfigRolloutTest util.go:541: Failed to wait for 2 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-ntomachineconfig-replace in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNTOPerformanceProfile
30m0.07s
nodepool_nto_performanceprofile_test.go:60: Starting test NTOPerformanceProfileTest util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-ntoperformanceprofile in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNodePoolInPlaceUpgrade
30m0.04s
nodepool_upgrade_test.go:100: starting test NodePoolUpgradeTest util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-inplaceupgrade in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNodePoolPrevReleaseN1
30m0.04s
nodepool_prev_release_test.go:31: Starting NodePoolPrevReleaseCreateTest. eventually.go:258: Failed to get **v1.Node: context deadline exceeded util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-n2zpq in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNodePoolPrevReleaseN2
30m0.07s
nodepool_prev_release_test.go:31: Starting NodePoolPrevReleaseCreateTest. eventually.go:258: Failed to get **v1.Node: Get "https://api-node-pool-tczgw.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes?labelSelector=hypershift.openshift.io%2FnodePool%3Dnode-pool-tczgw-8xk4l": context deadline exceeded util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-8xk4l in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNodePoolReplaceUpgrade
30m0.07s
nodepool_upgrade_test.go:100: starting test NodePoolUpgradeTest util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-replaceupgrade in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestNodePool/HostedCluster0/Main/TestNodepoolMachineconfigGetsRolledout
30m0.04s
nodepool_machineconfig_test.go:55: Starting test NodePoolMachineconfigRolloutTest util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-machineconfig in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestNodePool/HostedCluster0/Main/TestRollingUpgrade
30m0.07s
util.go:541: Failed to wait for 2 nodes to become ready for NodePool e2e-clusters-8g7h2/node-pool-tczgw-test-rolling-upgrade in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestNodePool/HostedCluster2
25m14.18s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-wzkdf/node-pool-9kr6t in 2m31s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-9kr6t util.go:2835: Failed to wait for HostedCluster e2e-clusters-wzkdf/node-pool-9kr6t to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-wzkdf/node-pool-9kr6t invalid at RV 34280 after 2s: eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-9kr6t.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-node-pool-9kr6t.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-node-pool-9kr6t.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
12m27.08s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-wzkdf/node-pool-9kr6t in 2m27.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-9kr6t.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-9kr6t.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestUpgradeControlPlane
47m9.09s
control_plane_upgrade_test.go:26: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-nhqbyfzw/release@sha256:f63b524ddbfbb11c174cd808f85caad71ec1258f79d8d02fb614852e37f6fba0, toImage: registry.build01.ci.openshift.org/ci-op-nhqbyfzw/release@sha256:d6dfbf388d5329576bb08c6072aedf3cbfacf93405f4fe971785ae1cbeea0fa4 hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-gwqtm/control-plane-upgrade-jj84z in 2m23s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-jj84z util.go:2835: Failed to wait for HostedCluster e2e-clusters-gwqtm/control-plane-upgrade-jj84z to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-gwqtm/control-plane-upgrade-jj84z invalid at RV 29671 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-052427: some cluster operators are not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
33m54.98s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-gwqtm/control-plane-upgrade-jj84z in 3m24.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-jj84z.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-jj84z.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-jj84z.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:359: Successfully waited for a successful connection to the guest API server in 30.9s util.go:541: Failed to wait for 2 nodes to become ready in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0