PR #8249 - 07-15 11:01

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

248
Total Tests
215
Passed
12
Failed
21
Skipped

Failed Tests

TestAutoscaling
42m31.16s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: operation error Route 53: ListResourceRecordSets, exceeded maximum number of attempts, 21, https response error StatusCode: 400, RequestID: 5432e917-087b-48fb-8160-35933b88928a, api error Throttling: Rate exceeded fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "autoscaling-xh7wx" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-782xz, name: autoscaling-xh7wx
TestCreateCluster
29m12.18s
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 21, https response error StatusCode: 400, RequestID: 1922afe8-a733-4275-a048-e1df45abe625, api error Throttling: Rate exceeded fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "create-cluster-pwpjc" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-k9g6l, name: create-cluster-pwpjc
TestCreateClusterCustomConfig
18m44.23s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: cannot create VPC S3 endpoint: operation error EC2: CreateVpcEndpoint, exceeded maximum number of attempts, 11, https response error StatusCode: 503, RequestID: 0eccf529-e8af-4730-a90e-8ddb54d1b63e, api error RequestLimitExceeded: Request limit exceeded. Account 820196288204 has been throttled on ec2:CreateVpcEndpoint because it exceeded its request rate limit. fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "custom-config-dwtdt" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-v8tq2, name: custom-config-dwtdt
TestCreateClusterHABreakGlassCredentials
3m10.1s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: cannot create VPC S3 endpoint: operation error EC2: CreateVpcEndpoint, exceeded maximum number of attempts, 11, https response error StatusCode: 503, RequestID: 14aac58b-7b60-429d-8d8d-aa0d53a8f1bd, api error RequestLimitExceeded: Request limit exceeded. Account 820196288204 has been throttled on ec2:CreateVpcEndpoint because it exceeded its request rate limit. fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "ha-break-glass-creds-jsrzm" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-m95ph, name: ha-break-glass-creds-jsrzm
TestCreateClusterProxy
36m17.86s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: operation error Route 53: ListResourceRecordSets, exceeded maximum number of attempts, 21, https response error StatusCode: 400, RequestID: 0123aa7b-8ad1-4c09-aaf9-8433679f739f, api error Throttling: Rate exceeded fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "proxy-s7fww" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-tlp4g, name: proxy-s7fww
TestCreateClusterRequestServingIsolation
42m44.1s
requestserving.go:105: Created request serving nodepool clusters/88e00c0821-mgmt-reqserving-x7mh6 requestserving.go:105: Created request serving nodepool clusters/88e00c0821-mgmt-reqserving-qqhh8 requestserving.go:113: Created non request serving nodepool clusters/88e00c0821-mgmt-non-reqserving-lp2d4 requestserving.go:113: Created non request serving nodepool clusters/88e00c0821-mgmt-non-reqserving-r9jq5 requestserving.go:113: Created non request serving nodepool clusters/88e00c0821-mgmt-non-reqserving-rpqxj util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/88e00c0821-mgmt-reqserving-x7mh6 in 3m54s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/88e00c0821-mgmt-reqserving-qqhh8 in 12s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/88e00c0821-mgmt-non-reqserving-lp2d4 in 6s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/88e00c0821-mgmt-non-reqserving-r9jq5 in 9s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/88e00c0821-mgmt-non-reqserving-rpqxj in 36s create_cluster_test.go:299: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: operation error Route 53: ListResourceRecordSets, https response error StatusCode: 400, RequestID: e748f13f-0263-4aab-bb17-95db5607ce08, api error Throttling: Rate exceeded failed to get rate limit token, retry quota exceeded, 2 available, 5 requested requestserving.go:132: Tearing down custom nodepool clusters/88e00c0821-mgmt-reqserving-x7mh6 requestserving.go:132: Tearing down custom nodepool clusters/88e00c0821-mgmt-reqserving-qqhh8 requestserving.go:132: Tearing down custom nodepool clusters/88e00c0821-mgmt-non-reqserving-lp2d4 requestserving.go:132: Tearing down custom nodepool clusters/88e00c0821-mgmt-non-reqserving-r9jq5 requestserving.go:132: Tearing down custom nodepool clusters/88e00c0821-mgmt-non-reqserving-rpqxj fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "request-serving-isolation-jd4g9" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-9l57z, name: request-serving-isolation-jd4g9
TestKarpenter
32m7.63s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: cannot create VPC S3 endpoint: operation error EC2: CreateVpcEndpoint, exceeded maximum number of attempts, 11, https response error StatusCode: 503, RequestID: ce89f744-5381-447c-b34e-abcbb2a0c27c, api error RequestLimitExceeded: Request limit exceeded. Account 820196288204 has been throttled on ec2:CreateVpcEndpoint because it exceeded its request rate limit. fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "karpenter-vpvxk" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-szqth, name: karpenter-vpvxk
TestKarpenterUpgradeControlPlane
1h59m58.59s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: failed to tag hosted zone: operation error Route 53: ChangeTagsForResource, exceeded maximum number of attempts, 21, https response error StatusCode: 400, RequestID: c70dfdb2-4389-4e83-a4d0-82b9155f53ba, api error Throttling: Rate exceeded
TestKarpenterUpgradeControlPlane/Teardown
1h41m20.3s
fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "karpenter-upgrade-control-plane-r9z6g" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:576: Failed to destroy cluster, will retry: failed to destroy IAM: context canceled fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: client rate limiter Wait returned an error: context canceled fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:589: Failed to destroy cluster: context canceled util.go:213: Failed to delete namespace: e2e-clusters-kmtss, will retry: client rate limiter Wait returned an error: context canceled hypershift_framework.go:605: Failed to delete test namespace: failed to delete namespace: context canceled fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: client rate limiter Wait returned an error: context canceled fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals
TestNodePool
0s
TestNodePool/HostedCluster0
35m15.65s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-hk658/node-pool-hr987 in 12m39s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-hr987 util.go:3158: Failed to wait for HostedCluster e2e-clusters-hk658/node-pool-hr987 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-hk658/node-pool-hr987 invalid at RV 41114 after 2s: incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-hr987.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
10m54.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-hk658/node-pool-hr987 in 54s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hr987.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-hr987.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded