PR #7024 - 11-06 10:51

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

72
Total Tests
40
Passed
16
Failed
16
Skipped

Failed Tests

TestAutoscaling
25m23.11s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-5v7w7/autoscaling-zj275 in 2m26s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster autoscaling-zj275 util.go:2835: Failed to wait for HostedCluster e2e-clusters-5v7w7/autoscaling-zj275 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-5v7w7/autoscaling-zj275 invalid at RV 27848 after 2s: eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-zj275.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, csi-snapshot-controller, dns, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-111744-test-ci-op-2gn2cb93-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-autoscaling-zj275.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-autoscaling-zj275.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([certified-operators-catalog deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, community-operators-catalog deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, oauth-openshift deployment has 1 unavailable replicas, openshift-oauth-apiserver deployment has 1 unavailable replicas, openshift-route-controller-manager deployment has 1 unavailable replicas, redhat-marketplace-catalog deployment has 1 unavailable replicas, redhat-operators-catalog deployment has 1 unavailable replicas]) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
13m3.08s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-5v7w7/autoscaling-zj275 in 3m3.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-zj275.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-zj275.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestAzureScheduler
26m38.18s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-2g5x9/azure-scheduler-s8cwv in 2m14s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster azure-scheduler-s8cwv util.go:2835: Failed to wait for HostedCluster e2e-clusters-2g5x9/azure-scheduler-s8cwv to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-2g5x9/azure-scheduler-s8cwv invalid at RV 28136 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([certified-operators-catalog deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-node-tuning-operator deployment has 1 unavailable replicas, cluster-policy-controller deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, community-operators-catalog deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, openshift-oauth-apiserver deployment has 1 unavailable replicas, openshift-route-controller-manager deployment has 1 unavailable replicas, redhat-marketplace-catalog deployment has 1 unavailable replicas, redhat-operators-catalog deployment has 1 unavailable replicas]) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-azure-scheduler-s8cwv.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-azure-scheduler-s8cwv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-azure-scheduler-s8cwv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
13m15.1s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-2g5x9/azure-scheduler-s8cwv in 3m15.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-s8cwv.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-azure-scheduler-s8cwv.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateCluster
46m42.55s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-jqgkp/create-cluster-2c8p8 in 2m23s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster create-cluster-2c8p8 util.go:2835: Failed to wait for HostedCluster e2e-clusters-jqgkp/create-cluster-2c8p8 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-jqgkp/create-cluster-2c8p8 invalid at RV 37752 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-111744-test-ci-op-2gn2cb93-latest: some cluster operators are not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
33m41.54s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-jqgkp/create-cluster-2c8p8 in 3m12.075s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-2c8p8.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-2c8p8.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:359: Successfully waited for a successful connection to the guest API server in 29.425s eventually.go:258: Failed to get **v1.Node: Get "https://api-create-cluster-2c8p8.aks-e2e.hypershift.azure.devcluster.openshift.com:443/api/v1/nodes": stream error: stream ID 303; INTERNAL_ERROR; received from peer eventually.go:258: Failed to get **v1.Node: context deadline exceeded util.go:541: Failed to wait for 2 nodes to become ready in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0
TestCreateClusterCustomConfig
27m21.4s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-jlgwn/custom-config-zcscq in 2m18s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster custom-config-zcscq util.go:2835: Failed to wait for HostedCluster e2e-clusters-jlgwn/custom-config-zcscq to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-jlgwn/custom-config-zcscq invalid at RV 28322 after 2s: eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-zcscq.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-custom-config-zcscq.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-custom-config-zcscq.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, certified-operators-catalog deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-policy-controller deployment has 1 unavailable replicas, community-operators-catalog deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas, redhat-marketplace-catalog deployment has 1 unavailable replicas, redhat-operators-catalog deployment has 1 unavailable replicas]) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
13m12.11s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-jlgwn/custom-config-zcscq in 3m12.075s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-zcscq.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-zcscq.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster0
27m22.88s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-rj6wb/node-pool-d747d in 2m13s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-d747d util.go:2835: Failed to wait for HostedCluster e2e-clusters-rj6wb/node-pool-d747d to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-rj6wb/node-pool-d747d invalid at RV 27834 after 2s: eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([certified-operators-catalog deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, community-operators-catalog deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, oauth-openshift deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas, redhat-marketplace-catalog deployment has 1 unavailable replicas, redhat-operators-catalog deployment has 1 unavailable replicas]) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-d747d.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-node-pool-d747d.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-node-pool-d747d.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
13m39.08s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-rj6wb/node-pool-d747d in 3m39.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-d747d.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-d747d.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool/HostedCluster2
1h2m16.34s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-vmqw8/node-pool-2h4xk in 2m12s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-2h4xk util.go:2835: Successfully waited for HostedCluster e2e-clusters-vmqw8/node-pool-2h4xk to have valid conditions in 100ms hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster2/Main
360ms
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-vmqw8/node-pool-2h4xk in 50ms util.go:297: Successfully waited for kubeconfig secret to have data in 25ms util.go:359: Successfully waited for a successful connection to the guest API server in 250ms
TestNodePool/HostedCluster2/Main/TestAdditionalTrustBundlePropagation
30m0.04s
nodepool_additionalTrustBundlePropagation_test.go:39: Starting AdditionalTrustBundlePropagationTest. eventually.go:258: Failed to get **v1.Node: context deadline exceeded util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-vmqw8/node-pool-2h4xk-test-additional-trust-bundle-propagation in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestUpgradeControlPlane
34m48.43s
control_plane_upgrade_test.go:26: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-2gn2cb93/release@sha256:806106e231f7ef70bf59e02d318b05f90c79ea53c2d3425560845b64e61b03a0, toImage: registry.build01.ci.openshift.org/ci-op-2gn2cb93/release@sha256:58392c3e79c993703dac53799d9cc6529535692e53a192cd2ba74b03a7d2d5cc hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-4tltc/control-plane-upgrade-tsqtf in 2m20s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-tsqtf util.go:2835: Failed to wait for HostedCluster e2e-clusters-4tltc/control-plane-upgrade-tsqtf to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-4tltc/control-plane-upgrade-tsqtf invalid at RV 27744 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ignition-server deployment has 1 unavailable replicas, konnectivity-agent deployment has 1 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, openshift-apiserver deployment has 1 unavailable replicas, packageserver deployment has 3 unavailable replicas]) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-tsqtf.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-control-plane-upgrade-tsqtf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-control-plane-upgrade-tsqtf.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted IgnitionEndpointAvailable=True, got IgnitionEndpointAvailable=False: WaitingForAvailable(Ignition server deployment is not yet available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
14m0.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-4tltc/control-plane-upgrade-tsqtf in 4m0.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-tsqtf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-control-plane-upgrade-tsqtf.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded