PR #8938 - 07-14 14:18

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-tbvzc/autoscaling-qgqds in 23s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-qgqds util.go:3158: Successfully waited for HostedCluster e2e-clusters-tbvzc/autoscaling-qgqds to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tbvzc/autoscaling-qgqds in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s util.go:3158: Successfully waited for HostedCluster e2e-clusters-tbvzc/autoscaling-qgqds to have valid conditions in 0s

util.go:1214: failed to list routes: the server is currently unable to handle the request (get routes.route.openshift.io)

journals.go:305: Successfully copied machine journals to /logs/artifacts/TestAutoscaling/machine-journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-tbvzc, name: autoscaling-qgqds hypershift_framework.go:613: Failed to dump cluster: failed to dump hosted cluster: failed to dump cluster: the server is currently unable to handle the request

create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-c6gsj/create-cluster-m94tz in 1m54s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-m94tz util.go:3158: Successfully waited for HostedCluster e2e-clusters-c6gsj/create-cluster-m94tz to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-c6gsj/create-cluster-m94tz in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s create_cluster_test.go:87: fetching mgmt kubeconfig util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-c6gsj/create-cluster-m94tz in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-c6gsj/create-cluster-m94tz in 25ms util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s util.go:2004: NodePool replicas: 1 util.go:2175: Waiting for nodes to stabilize after pull secret update util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-c6gsj/create-cluster-m94tz-us-east-1a in 0s util.go:2207: Deleting the additional-pull-secret secret in the DataPlane util.go:2226: Waiting for nodes to stabilize after pull secret deletion util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-c6gsj/create-cluster-m94tz-us-east-1a in 25ms

globalps.go:209: Creating kubelet config verifier DaemonSet globalps.go:211: failed to create kubelet config verifier DaemonSet Unexpected error: <*errors.StatusError | 0xc005bd6500>: daemonsets.apps "kubelet-config-verifier" already exists { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "daemonsets.apps \"kubelet-config-verifier\" already exists", Reason: "AlreadyExists", Details: { Name: "kubelet-config-verifier", Group: "apps", Kind: "daemonsets", UID: "", Causes: nil, RetryAfterSeconds: 0, }, Code: 409, }, } occurred

util.go:2021: Reading management-cluster pull secret e2e-clusters-c6gsj/create-cluster-m94tz-pull-secret util.go:2057: Patching management-cluster pull secret with dummy auth entry util.go:2062: Waiting for openshift-config/pull-secret to update in guest cluster util.go:2072: Waiting for kube-system/original-pull-secret to update in guest cluster util.go:2082: Verifying no NodePool rollout was triggered globalps.go:209: Creating kubelet config verifier DaemonSet globalps.go:214: Waiting for OVN, GlobalPullSecret, Konnectivity and kubelet config verifier DaemonSets to be ready util.go:2264: Waiting for ovnkube-node DaemonSet to be ready (min expected: 1) util.go:2294: DaemonSet ovnkube-node ready: 3/3 pods util.go:2302: ✓ ovnkube-node DaemonSet is ready util.go:2264: Waiting for global-pull-secret-syncer DaemonSet to be ready (min expected: 1) util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready util.go:2294: DaemonSet global-pull-secret-syncer ready: 3/3 pods util.go:2302: ✓ global-pull-secret-syncer DaemonSet is ready util.go:2264: Waiting for konnectivity-agent DaemonSet to be ready (min expected: 1) util.go:2294: DaemonSet konnectivity-agent ready: 3/3 pods util.go:2302: ✓ konnectivity-agent DaemonSet is ready util.go:2264: Waiting for kubelet-config-verifier DaemonSet to be ready (min expected: 1) util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready util.go:2290: DaemonSet kubelet-config-verifier not ready: 2/3 pods ready globalps.go:220: Expected success, but got an error: <*fmt.wrapError | 0xc00a591de0>: failed to wait for DaemonSet kubelet-config-verifier to be ready: context deadline exceeded { msg: "failed to wait for DaemonSet kubelet-config-verifier to be ready: context deadline exceeded", err: <context.deadlineExceededError>{}, } util.go:2032: Restoring original management-cluster pull secret data

journals.go:305: Successfully copied machine journals to /logs/artifacts/TestCreateCluster/machine-journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-c6gsj, name: create-cluster-m94tz hypershift_framework.go:613: Failed to dump cluster: failed to dump hosted cluster: failed to dump cluster: the server is currently unable to handle the request

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-rr25g/karpenter-upgrade-control-plane-qghbv in 43s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-qghbv upgrade_safe_check.go:87: UpgradeSafeFieldCheck: latch engaged for status.controlPlaneVersion util.go:3158: Successfully waited for HostedCluster e2e-clusters-rr25g/karpenter-upgrade-control-plane-qghbv to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-rr25g/karpenter-upgrade-control-plane-qghbv in 0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:384: Successfully waited for a successful connection to the guest API server in 0s upgrade_safe_check.go:87: UpgradeSafeFieldCheck: latch engaged for status.controlPlaneVersion util.go:3158: Successfully waited for HostedCluster e2e-clusters-rr25g/karpenter-upgrade-control-plane-qghbv to have valid conditions in 0s

util.go:1214: failed to list routes: the server is currently unable to handle the request (get routes.route.openshift.io)

fixture.go:417: Failed to dump machine journals; this is nonfatal: failed to ensure bastion keypair: failed to import keypair: operation error EC2: ImportKeyPair, https response error StatusCode: 400, RequestID: 78031bce-39c7-46e1-98da-c491120692cb, api error KeyPairLimitExceeded: Maximum of 5000 keypairs reached. hypershift_framework.go:576: Failed to destroy cluster, will retry: hostedcluster wasn't finalized, aborting delete: context deadline exceeded fixture.go:417: Failed to dump machine journals; this is nonfatal: failed to ensure bastion keypair: failed to import keypair: operation error EC2: ImportKeyPair, https response error StatusCode: 400, RequestID: ddb206c7-f47f-44ef-9235-ff41c07061d4, api error KeyPairLimitExceeded: Maximum of 5000 keypairs reached. hypershift_framework.go:581: Failed to dump cluster during destroy; this is nonfatal: failed to dump hosted cluster: failed to dump cluster: the server is currently unable to handle the request hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-rr25g, name: karpenter-upgrade-control-plane-qghbv hypershift_framework.go:613: Failed to dump cluster: failed to dump hosted cluster: failed to dump cluster: stream error when reading response body, may be caused by closed connection. Please retry. Original error: stream error: stream ID 32297; INTERNAL_ERROR; received from peer

hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-b48mp/node-pool-w9j2h in 29s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called

journals.go:305: Successfully copied machine journals to /logs/artifacts/TestNodePool_HostedCluster2/machine-journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-b48mp, name: node-pool-w9j2h hypershift_framework.go:605: Failed to delete test namespace: namespace still exists after deletion timeout: context deadline exceeded fixture.go:409: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "node-pool-w9j2h" not found fixture.go:417: Failed to dump machine journals; this is nonfatal: secrets "node-pool-w9j2h-ssh-key" not found hypershift_framework.go:546: archiving /logs/artifacts/TestNodePool_HostedCluster2/hostedcluster-node-pool-w9j2h to /logs/artifacts/TestNodePool_HostedCluster2/hostedcluster.tar.gz