PR #5821 - 04-16 21:42

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

207
Total Tests
175
Passed
17
Failed
15
Skipped

Failed Tests

TestAutoscaling
22m44.41s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-mj2nr/autoscaling-k4rms in 39s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster autoscaling-k4rms eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline util.go:2123: Failed to wait for HostedCluster e2e-clusters-mj2nr/autoscaling-k4rms to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-mj2nr/autoscaling-k4rms invalid at RV 50630 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, image-registry, monitoring are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.19.0-0.ci-2025-04-16-215229-test-ci-op-63jhkvfg-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-k4rms.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
13m58.01s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-mj2nr/autoscaling-k4rms in 3m58s util.go:235: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-k4rms.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-k4rms.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:281: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterCustomConfig
40m6.07s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-ljddg/custom-config-fmv5q in 23m17s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster custom-config-fmv5q eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:2123: Failed to wait for HostedCluster e2e-clusters-ljddg/custom-config-fmv5q to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-ljddg/custom-config-fmv5q invalid at RV 96910 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, ingress, insights, kube-storage-version-migrator, monitoring, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.19.0-0.ci-2025-04-16-215229-test-ci-op-63jhkvfg-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ValidAWSKMSConfig=True, got ValidAWSKMSConfig=Unknown: StatusUnknown(failed to create token for KMS provider service account: failed to get serviceaccount: Get "https://api-custom-config-fmv5q.service.ci.hypershift.devcluster.openshift.com:443/api/v1/namespaces/kube-system/serviceaccounts/kms-provider": dial tcp: lookup api-custom-config-fmv5q.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-fmv5q.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
10m50.01s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-ljddg/custom-config-fmv5q in 50s util.go:235: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-fmv5q.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-fmv5q.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:281: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterPrivateWithRouteKAS
51m9.68s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-5t789/private-b8lr8 in 23s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster private-b8lr8 util.go:2123: Failed to wait for HostedCluster e2e-clusters-5t789/private-b8lr8 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-5t789/private-b8lr8 invalid at RV 98087 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.19.0-0.ci-2025-04-16-215229-test-ci-op-63jhkvfg-latest: the cluster operator console is not available) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestCreateClusterPrivateWithRouteKAS/ValidateHostedCluster
43m11.01s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-5t789/private-b8lr8 in 1m14s util.go:235: Successfully waited for kubeconfig secret to have data in 0s util.go:557: Successfully waited for NodePools for HostedCluster e2e-clusters-5t789/private-b8lr8 to have all of their desired nodes in 11m57s util.go:494: Failed to wait for HostedCluster e2e-clusters-5t789/private-b8lr8 to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-5t789/private-b8lr8 invalid at RV 98087 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:494: *v1beta1.HostedCluster e2e-clusters-5t789/private-b8lr8 conditions: util.go:494: ValidAWSIdentityProvider=True: AsExpected(All is well) util.go:494: ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) util.go:494: ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.19.0-0.ci-2025-04-16-215229-test-ci-op-63jhkvfg-latest: the cluster operator console is not available) util.go:494: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.19.0-0.ci-2025-04-16-215229-test-ci-op-63jhkvfg-latest" image="registry.build01.ci.openshift.org/ci-op-63jhkvfg/release@sha256:15529d8dd4d09a1e841ec1577513e5b202767b9ea577cd9c4373f2e212f3acbb" architecture="amd64") util.go:494: ClusterVersionUpgradeable=False: UpdateInProgress(An update is already in progress and the details are in the Progressing condition) util.go:494: ClusterVersionAvailable=False: FromClusterVersion util.go:494: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:494: EtcdAvailable=True: QuorumAvailable util.go:494: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:494: InfrastructureReady=True: AsExpected(All is well) util.go:494: ExternalDNSReachable=Unknown: StatusUnknown(External DNS is not configured) util.go:494: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:494: ValidReleaseInfo=True: AsExpected(All is well) util.go:494: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:494: Available=True: AsExpected(The hosted control plane is available) util.go:494: AWSEndpointAvailable=True: AWSSuccess(All is well) util.go:494: AWSEndpointServiceAvailable=True: AWSSuccess(All is well) util.go:494: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:494: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:494: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:494: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:494: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:494: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:494: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:494: ValidOIDCConfiguration=True: AsExpected(OIDC configuration is valid) util.go:494: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:494: ValidAWSKMSConfig=Unknown: StatusUnknown(AWS KMS is not configured) util.go:494: AWSDefaultSecurityGroupCreated=True: AsExpected(All is well) util.go:494: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)
TestCreateClusterProxy
23m14.17s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-tfrl2/proxy-zfrt4 in 34s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster proxy-zfrt4 util.go:2123: Failed to wait for HostedCluster e2e-clusters-tfrl2/proxy-zfrt4 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-tfrl2/proxy-zfrt4 invalid at RV 46528 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.19.0-0.ci-2025-04-16-215229-test-ci-op-63jhkvfg-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, openshift-samples, service-ca are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-proxy-zfrt4.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestCreateClusterProxy/ValidateHostedCluster
11m0.01s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tfrl2/proxy-zfrt4 in 1m0s util.go:235: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-proxy-zfrt4.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-proxy-zfrt4.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:281: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterV2
24m5.01s
create_cluster_test.go:1241: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-bz6rs/create-cluster-v2-j77px in 1m31s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster create-cluster-v2-j77px eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:2123: Failed to wait for HostedCluster e2e-clusters-bz6rs/create-cluster-v2-j77px to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-bz6rs/create-cluster-v2-j77px invalid at RV 48610 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.19.0-0.ci-2025-04-16-215229-test-ci-op-63jhkvfg-latest: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(ignition-server-proxy deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-v2-j77px.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestCreateClusterV2/ValidateHostedCluster
12m7.01s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-bz6rs/create-cluster-v2-j77px in 2m7s util.go:235: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-v2-j77px.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-v2-j77px.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:281: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster0
43m37.35s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-q52fx/node-pool-28pg6 in 1m12s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster node-pool-28pg6 eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:2123: Failed to wait for HostedCluster e2e-clusters-q52fx/node-pool-28pg6 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-q52fx/node-pool-28pg6 invalid at RV 48655 after 2s: eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-28pg6.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted AWSEndpointAvailable=True, got AWSEndpointAvailable=False: AWSError(Throttling: Rate exceeded status code: 400, request id: d2726876-db07-4a84-ad2f-e2d12a710367) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
11m54.01s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-q52fx/node-pool-28pg6 in 1m54s util.go:235: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-28pg6.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-28pg6.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:281: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool/HostedCluster2
22m12.46s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-wkwt4/node-pool-z6c7q in 26s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster node-pool-z6c7q util.go:2123: Failed to wait for HostedCluster e2e-clusters-wkwt4/node-pool-z6c7q to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-wkwt4/node-pool-z6c7q invalid at RV 44153 after 2s: incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-z6c7q.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
10m57.02s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-wkwt4/node-pool-z6c7q in 57s util.go:235: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-z6c7q.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-z6c7q.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:281: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestUpgradeControlPlane
41m59.9s
control_plane_upgrade_test.go:23: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-63jhkvfg/release@sha256:df4da7ff30e4d78c9bee39f38cf41bc0b78e044e52f373eec4c1bbcc308aaa5e, toImage: registry.build01.ci.openshift.org/ci-op-63jhkvfg/release@sha256:15529d8dd4d09a1e841ec1577513e5b202767b9ea577cd9c4373f2e212f3acbb hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-6vdhj/control-plane-upgrade-94chl in 24m10s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-94chl eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:2123: Failed to wait for HostedCluster e2e-clusters-6vdhj/control-plane-upgrade-94chl to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-6vdhj/control-plane-upgrade-94chl invalid at RV 97984 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.19.0-0.ci-2025-04-15-045130: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, monitoring, openshift-samples are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(openshift-apiserver deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-control-plane-upgrade-94chl.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
11m2.01s
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-6vdhj/control-plane-upgrade-94chl in 1m2s util.go:235: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-94chl.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-control-plane-upgrade-94chl.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:281: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded