PR #7084 - 11-06 10:26

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

65
Total Tests
34
Passed
15
Failed
16
Skipped

Failed Tests

TestAutoscaling
46m25.6s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-bshzg/autoscaling-gdn48 in 2m13s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster autoscaling-gdn48 util.go:2835: Failed to wait for HostedCluster e2e-clusters-bshzg/autoscaling-gdn48 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-bshzg/autoscaling-gdn48 invalid at RV 42925 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-104649-test-ci-op-dkfp82wp-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
33m25.74s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-bshzg/autoscaling-gdn48 in 3m0.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-gdn48.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:359: Successfully waited for a successful connection to the guest API server in 25.65s eventually.go:258: Failed to get **v1.Node: context deadline exceeded util.go:541: Failed to wait for 1 nodes to become ready in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestAzureScheduler
25m58.84s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-rtsrc/azure-scheduler-8v8xd in 2m19s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster azure-scheduler-8v8xd util.go:2835: Failed to wait for HostedCluster e2e-clusters-rtsrc/azure-scheduler-8v8xd to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-rtsrc/azure-scheduler-8v8xd invalid at RV 33330 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-azure-scheduler-8v8xd.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-104649-test-ci-op-dkfp82wp-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-azure-scheduler-8v8xd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-azure-scheduler-8v8xd.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
12m39.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-rtsrc/azure-scheduler-8v8xd in 2m39.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-8v8xd.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-azure-scheduler-8v8xd.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateCluster
25m20.13s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-94qmp/create-cluster-d5kzb in 2m24s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster create-cluster-d5kzb util.go:2835: Failed to wait for HostedCluster e2e-clusters-94qmp/create-cluster-d5kzb to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-94qmp/create-cluster-d5kzb invalid at RV 33430 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-104649-test-ci-op-dkfp82wp-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-d5kzb.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-create-cluster-d5kzb.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-create-cluster-d5kzb.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
12m30.1s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-94qmp/create-cluster-d5kzb in 2m30.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-d5kzb.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-d5kzb.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterCustomConfig
25m7.37s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-pkqlg/custom-config-mngdv in 2m19s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster custom-config-mngdv util.go:2835: Failed to wait for HostedCluster e2e-clusters-pkqlg/custom-config-mngdv to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-pkqlg/custom-config-mngdv invalid at RV 33632 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-custom-config-mngdv.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-custom-config-mngdv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-104649-test-ci-op-dkfp82wp-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-mngdv.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
12m36.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-pkqlg/custom-config-mngdv in 2m36.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-mngdv.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-mngdv.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster0
25m12.3s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-j2pff/node-pool-w2qq9 in 2m24s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-w2qq9 util.go:2835: Failed to wait for HostedCluster e2e-clusters-j2pff/node-pool-w2qq9 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-j2pff/node-pool-w2qq9 invalid at RV 33940 after 2s: eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-w2qq9.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-node-pool-w2qq9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-node-pool-w2qq9.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
12m30.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-j2pff/node-pool-w2qq9 in 2m30.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-w2qq9.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-w2qq9.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool/HostedCluster2
25m3.24s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-nb4bn/node-pool-n47zh in 2m10s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-n47zh util.go:2835: Failed to wait for HostedCluster e2e-clusters-nb4bn/node-pool-n47zh to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-nb4bn/node-pool-n47zh invalid at RV 33470 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-node-pool-n47zh.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-node-pool-n47zh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-n47zh.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
12m57.09s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-nb4bn/node-pool-n47zh in 2m57.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-n47zh.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-n47zh.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestUpgradeControlPlane
56m28.7s
control_plane_upgrade_test.go:26: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-dkfp82wp/release@sha256:806106e231f7ef70bf59e02d318b05f90c79ea53c2d3425560845b64e61b03a0, toImage: registry.build01.ci.openshift.org/ci-op-dkfp82wp/release@sha256:00e47a8dcbd063aee282b93f0f39c0c177d10f8d7acf3d417c28aa96a0905ac1 hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-7zkx5/control-plane-upgrade-bmqqf in 2m23s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-bmqqf util.go:2835: Failed to wait for HostedCluster e2e-clusters-7zkx5/control-plane-upgrade-bmqqf to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-7zkx5/control-plane-upgrade-bmqqf invalid at RV 43411 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-012216: the cluster operator console is not available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
43m31.25s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-7zkx5/control-plane-upgrade-bmqqf in 3m45.05s util.go:297: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-bmqqf.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:359: Successfully waited for a successful connection to the guest API server in 40.075s util.go:541: Successfully waited for 2 nodes to become ready in 9m6.075s eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:574: Failed to wait for HostedCluster e2e-clusters-7zkx5/control-plane-upgrade-bmqqf to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-7zkx5/control-plane-upgrade-bmqqf invalid at RV 43411 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:574: *v1beta1.HostedCluster e2e-clusters-7zkx5/control-plane-upgrade-bmqqf conditions: util.go:574: ClusterVersionUpgradeable=False: UpdateInProgress(An update is already in progress and the details are in the Progressing condition) util.go:574: ClusterVersionAvailable=False: FromClusterVersion util.go:574: ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) util.go:574: ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-06-012216: the cluster operator console is not available) util.go:574: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.21.0-0.ci-2025-11-06-012216" image="registry.build01.ci.openshift.org/ci-op-dkfp82wp/release@sha256:806106e231f7ef70bf59e02d318b05f90c79ea53c2d3425560845b64e61b03a0" architecture="amd64") util.go:574: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:574: EtcdAvailable=True: QuorumAvailable util.go:574: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:574: InfrastructureReady=True: AsExpected(All is well) util.go:574: ExternalDNSReachable=True: AsExpected(All is well) util.go:574: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:574: ValidReleaseInfo=True: AsExpected(All is well) util.go:574: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:574: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:574: Available=True: AsExpected(The hosted control plane is available) util.go:574: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:574: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:574: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:574: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:574: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:574: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:574: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:574: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:574: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:574: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)