Failed Tests
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-k82g9/create-cluster-zc5nh in 1m26s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-zc5nh
util.go:3158: Successfully waited for HostedCluster e2e-clusters-k82g9/create-cluster-zc5nh to have valid conditions in 0s
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-k82g9/create-cluster-zc5nh in 0s
util.go:322: Successfully waited for kubeconfig secret to have data in 0s
util.go:384: Successfully waited for a successful connection to the guest API server in 0s
create_cluster_test.go:87: fetching mgmt kubeconfig
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-k82g9/create-cluster-zc5nh in 0s
util.go:322: Successfully waited for kubeconfig secret to have data in 0s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-k82g9/create-cluster-zc5nh in 0s
util.go:322: Successfully waited for kubeconfig secret to have data in 0s
util.go:384: Successfully waited for a successful connection to the guest API server in 0s
util.go:2004: NodePool replicas: 1
util.go:2175: Waiting for nodes to stabilize after pull secret update
util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-k82g9/create-cluster-zc5nh-us-east-1a in 0s
util.go:2207: Deleting the additional-pull-secret secret in the DataPlane
util.go:2226: Waiting for nodes to stabilize after pull secret deletion
util.go:583: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-k82g9/create-cluster-zc5nh-us-east-1a in 0s
util.go:2021: Reading management-cluster pull secret e2e-clusters-k82g9/create-cluster-zc5nh-pull-secret
util.go:2057: Patching management-cluster pull secret with dummy auth entry
util.go:2062: Waiting for openshift-config/pull-secret to update in guest cluster
util.go:2072: Waiting for kube-system/original-pull-secret to update in guest cluster
util.go:2082: Verifying no NodePool rollout was triggered
globalps.go:244: Creating kubelet config verifier DaemonSet
globalps.go:249: Waiting for OVN, GlobalPullSecret, Konnectivity and kubelet config verifier DaemonSets to be ready
util.go:2264: Waiting for ovnkube-node DaemonSet to be ready (min expected: 1)
util.go:2294: DaemonSet ovnkube-node ready: 3/3 pods
util.go:2302: ✓ ovnkube-node DaemonSet is ready
util.go:2264: Waiting for global-pull-secret-syncer DaemonSet to be ready (min expected: 1)
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2290: DaemonSet global-pull-secret-syncer not ready: 2/3 pods ready
util.go:2270: Failed to get DaemonSet global-pull-secret-syncer: context deadline exceeded
globalps.go:252:
Expected success, but got an error:
<*fmt.wrapError | 0xc00670ab40>:
failed to wait for DaemonSet global-pull-secret-syncer to be ready: context deadline exceeded
{
msg: "failed to wait for DaemonSet global-pull-secret-syncer to be ready: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
globalps.go:222: Cleaning up kubelet config verifier resources
util.go:2032: Restoring original management-cluster pull secret data
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-jnds8/custom-config-fsqvk in 33s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-fsqvk
util.go:3158: Failed to wait for HostedCluster e2e-clusters-jnds8/custom-config-fsqvk to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-jnds8/custom-config-fsqvk invalid at RV 79846 after 2s:
eventually.go:228: - incorrect condition: wanted ValidAWSKMSConfig=True, got ValidAWSKMSConfig=Unknown: StatusUnknown(failed to create token for KMS provider service account: failed to get serviceaccount: Get "https://api-custom-config-fsqvk.service.ci.hypershift.devcluster.openshift.com:443/api/v1/namespaces/kube-system/serviceaccounts/kms-provider": dial tcp: lookup api-custom-config-fsqvk.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available)
eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-fsqvk.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host)
eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity)
eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available)
eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion
eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-15-124538-test-ci-op-pkj4nfls-latest: some cluster operators are not available)
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-jnds8/custom-config-fsqvk in 54.025s
util.go:322: Successfully waited for kubeconfig secret to have data in 0s
eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-fsqvk.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-fsqvk.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host
eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded
util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-vfhlh/karpenter-upgrade-control-plane-9s65r in 2m42s
hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-9s65r
upgrade_safe_check.go:87: UpgradeSafeFieldCheck: latch engaged for status.controlPlaneVersion
util.go:3158: Failed to wait for HostedCluster e2e-clusters-vfhlh/karpenter-upgrade-control-plane-9s65r to have valid conditions in 2s: context deadline exceeded
eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-vfhlh/karpenter-upgrade-control-plane-9s65r invalid at RV 215574 after 2s: incorrect condition: wanted AWSEndpointAvailable=True, got AWSEndpointAvailable=False: AWSError(operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 3, https response error StatusCode: 400, RequestID: 65dfe7db-a054-418c-83c9-0d769128514b, api error Throttling: Rate exceeded)
hypershift_framework.go:349: skipping postTeardown()
hypershift_framework.go:327: skipping teardown, already called
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-vfhlh/karpenter-upgrade-control-plane-9s65r in 0s
util.go:322: Successfully waited for kubeconfig secret to have data in 0s
util.go:384: Successfully waited for a successful connection to the guest API server in 0s
karpenter_control_plane_upgrade_test.go:57: Starting Karpenter control plane upgrade. FromImage: registry.build01.ci.openshift.org/ci-op-pkj4nfls/release@sha256:622e3aad9f1316badf4e7c2069a15bb6e480d3a5783727abee78031623fec157, toImage: registry.build01.ci.openshift.org/ci-op-pkj4nfls/release@sha256:36cdf28620265a048c6e214cd1fd68ee64b40311b9a688f3d0b19e5605f46cb5
karpenter_control_plane_upgrade_test.go:68: machine-os version(s) in latest release: [9.8.20260713-1 10.2.20260714-0]
karpenter_control_plane_upgrade_test.go:73: Created Karpenter NodePool
karpenter_control_plane_upgrade_test.go:75: Created workloads
util.go:583: Successfully waited for 1 nodes to become ready in 6m39s
karpenter_test.go:1560: Successfully waited for NodeClaims to be ready in 0s
karpenter_test.go:1516: Successfully waited for Pods to be scheduled on provisioned Karpenter nodes in 15s
karpenter_control_plane_upgrade_test.go:82: Pre-upgrade node: ip-10-0-131-17.ec2.internal, OS image: Red Hat Enterprise Linux CoreOS 9.8.20260708-0 (Plow)
karpenter_control_plane_upgrade_test.go:84: Updating cluster image. Image: registry.build01.ci.openshift.org/ci-op-pkj4nfls/release@sha256:36cdf28620265a048c6e214cd1fd68ee64b40311b9a688f3d0b19e5605f46cb5
eventually.go:105: Failed to get *v1.NodeClaim: condition Drifted not found in NodeClaim on-demand-dgw6z
karpenter_test.go:1611: Successfully waited for NodeClaim on-demand-dgw6z to be drifted in 3s
util.go:620: Successfully waited for HostedCluster e2e-clusters-vfhlh/karpenter-upgrade-control-plane-9s65r to rollout in 22m24s
karpenter_control_plane_upgrade_test.go:110: Karpenter Nodes drifted
util.go:583: Failed to wait for 1 nodes to become ready in 45m0s: context deadline exceeded
eventually.go:384: observed invalid **v1.Node state after 45m0s
eventually.go:401: - observed **v1.Node collection invalid: expected 1 nodes, got 2
eventually.go:401: - observed **v1.Node /ip-10-0-131-17.ec2.internal invalid: expected node OS image "Red Hat Enterprise Linux CoreOS 9.8.20260708-0 (Plow)" to contain one of [9.8.20260713-1 10.2.20260714-0]
util.go:583: *v1.Node /ip-10-0-131-17.ec2.internal conditions:
util.go:583: MemoryPressure=False: KubeletHasSufficientMemory(kubelet has sufficient memory available)
util.go:583: DiskPressure=False: KubeletHasNoDiskPressure(kubelet has no disk pressure)
util.go:583: PIDPressure=False: KubeletHasSufficientPID(kubelet has sufficient PID available)
util.go:583: Ready=True: KubeletReady(kubelet is posting ready status)