PR #8941 - 07-09 17:19

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

100
Total Tests
54
Passed
26
Failed
20
Skipped

Failed Tests

TestAutoscaling
34m17.61s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-zxhlh/autoscaling-b9g55 in 1m4s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-b9g55 util.go:3158: Failed to wait for HostedCluster e2e-clusters-zxhlh/autoscaling-b9g55 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-zxhlh/autoscaling-b9g55 invalid at RV 55810 after 2s: eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-autoscaling-b9g55.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: some cluster operators are not available) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
10m57.02s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-zxhlh/autoscaling-b9g55 in 57s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-b9g55.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-b9g55.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateCluster
46m59.81s
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-ldp7s/create-cluster-vdjng in 29m10s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-vdjng util.go:3158: Failed to wait for HostedCluster e2e-clusters-ldp7s/create-cluster-vdjng to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-ldp7s/create-cluster-vdjng invalid at RV 104021 after 2s: eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-create-cluster-vdjng.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:228: - incorrect condition: wanted AWSEndpointAvailable=True, got AWSEndpointAvailable=False: AWSError(operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 3, https response error StatusCode: 400, RequestID: a4083eee-fdd5-45f1-8163-c69b8058e0a1, api error Throttling: Rate exceeded) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: some cluster operators are not available) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
10m36.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-ldp7s/create-cluster-vdjng in 36s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-vdjng.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-vdjng.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterCustomConfig
32m52.95s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-whgsx/custom-config-xkhqt in 1m8s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-xkhqt util.go:3158: Failed to wait for HostedCluster e2e-clusters-whgsx/custom-config-xkhqt to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-whgsx/custom-config-xkhqt invalid at RV 59555 after 2s: eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-xkhqt.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: some cluster operators are not available) eventually.go:228: - incorrect condition: wanted ValidAWSKMSConfig=True, got ValidAWSKMSConfig=Unknown: StatusUnknown(failed to create token for KMS provider service account: failed to get serviceaccount: Get "https://api-custom-config-xkhqt.service.ci.hypershift.devcluster.openshift.com:443/api/v1/namespaces/kube-system/serviceaccounts/kms-provider": dial tcp: lookup api-custom-config-xkhqt.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
10m45.02s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-whgsx/custom-config-xkhqt in 45s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-xkhqt.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-xkhqt.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterHABreakGlassCredentials
29m21.47s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-xdl9k/ha-break-glass-creds-v26t6 in 1m37s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-v26t6 util.go:3158: Failed to wait for HostedCluster e2e-clusters-xdl9k/ha-break-glass-creds-v26t6 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-xdl9k/ha-break-glass-creds-v26t6 invalid at RV 60336 after 2s: eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-ha-break-glass-creds-v26t6.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted AWSEndpointAvailable=True, got AWSEndpointAvailable=False: AWSError(operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 3, https response error StatusCode: 400, RequestID: eb1315be-0b55-4b39-903f-12ed700f65f8, api error Throttling: Rate exceeded) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterHABreakGlassCredentials/ValidateHostedCluster
10m57.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-xdl9k/ha-break-glass-creds-v26t6 in 57s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-v26t6.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-ha-break-glass-creds-v26t6.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterPrivate
17m33.94s
hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: operation error Route 53: ListResourceRecordSets, exceeded maximum number of attempts, 21, https response error StatusCode: 400, RequestID: cb2a3b31-5a13-462b-8d7d-d8e4da89a89e, api error Throttling: Rate exceeded fixture.go:409: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "private-8hzt5" not found fixture.go:417: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-kn27l, name: private-8hzt5
TestCreateClusterPrivateWithRouteKAS
51m40.93s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-rqcv4/private-njh2g in 26s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster private-njh2g util.go:3158: Failed to wait for HostedCluster e2e-clusters-rqcv4/private-njh2g to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-rqcv4/private-njh2g invalid at RV 106147 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: the cluster operator console is not available) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterPrivateWithRouteKAS/ValidateHostedCluster
42m51.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-rqcv4/private-njh2g in 45s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:744: Successfully waited for NodePools for HostedCluster e2e-clusters-rqcv4/private-njh2g to have all of their desired nodes in 12m6s eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:620: Failed to wait for HostedCluster e2e-clusters-rqcv4/private-njh2g to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-rqcv4/private-njh2g invalid at RV 106147 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:620: *v1beta1.HostedCluster e2e-clusters-rqcv4/private-njh2g conditions: util.go:620: ValidAWSIdentityProvider=True: AsExpected(All is well) util.go:620: ClusterVersionAvailable=False: FromClusterVersion util.go:620: ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) util.go:620: ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: the cluster operator console is not available) util.go:620: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest" image="registry.build01.ci.openshift.org/ci-op-0xgltxi5/release@sha256:6814c937c33e744e3caa7759e4f0a7f335313ac0284d09528e953c0bc96ec739" architecture="amd64") util.go:620: ClusterVersionUpgradeable=False: ClusterVersionUpdating(An update is already in progress and the details are in the Progressing condition.) util.go:620: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=Unknown: StatusUnknown(External DNS is not configured) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: AWSEndpointAvailable=True: AWSSuccess(All is well) util.go:620: AWSEndpointServiceAvailable=True: AWSSuccess(All is well) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ValidOIDCConfiguration=True: AsExpected(OIDC configuration is valid) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAWSKMSConfig=Unknown: StatusUnknown(AWS KMS is not configured) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized) util.go:620: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.) util.go:620: AWSDefaultSecurityGroupCreated=True: AsExpected(All is well)
TestCreateClusterProxy
38m1.3s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-5nmcn/proxy-ckjqz in 3m9s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster proxy-ckjqz util.go:3158: Failed to wait for HostedCluster e2e-clusters-5nmcn/proxy-ckjqz to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-5nmcn/proxy-ckjqz invalid at RV 63150 after 2s: eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: some cluster operators are not available) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-proxy-ckjqz.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted AWSEndpointAvailable=True, got AWSEndpointAvailable=False: AWSError(operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 3, https response error StatusCode: 400, RequestID: 0232548a-30cf-48b1-ad7c-c013f23ee8a8, api error Throttling: Rate exceeded) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterProxy/ValidateHostedCluster
10m45.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-5nmcn/proxy-ckjqz in 45s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-proxy-ckjqz.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-proxy-ckjqz.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestCreateClusterRequestServingIsolation
49m34.39s
requestserving.go:105: Created request serving nodepool clusters/06159d32c8-mgmt-reqserving-fzbvg requestserving.go:105: Created request serving nodepool clusters/06159d32c8-mgmt-reqserving-bnvvq requestserving.go:113: Created non request serving nodepool clusters/06159d32c8-mgmt-non-reqserving-vmtnn requestserving.go:113: Created non request serving nodepool clusters/06159d32c8-mgmt-non-reqserving-frmf2 requestserving.go:113: Created non request serving nodepool clusters/06159d32c8-mgmt-non-reqserving-89mnc util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/06159d32c8-mgmt-reqserving-fzbvg in 3m57s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/06159d32c8-mgmt-reqserving-bnvvq in 100ms util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/06159d32c8-mgmt-non-reqserving-vmtnn in 33s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/06159d32c8-mgmt-non-reqserving-frmf2 in 0s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/06159d32c8-mgmt-non-reqserving-89mnc in 36s create_cluster_test.go:299: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: operation error Route 53: ListResourceRecordSets, https response error StatusCode: 400, RequestID: 4b876c07-f05e-48c6-aeda-1ef69e58a3e9, api error Throttling: Rate exceeded failed to get rate limit token, retry quota exceeded, 4 available, 5 requested requestserving.go:132: Tearing down custom nodepool clusters/06159d32c8-mgmt-reqserving-fzbvg requestserving.go:132: Tearing down custom nodepool clusters/06159d32c8-mgmt-reqserving-bnvvq requestserving.go:132: Tearing down custom nodepool clusters/06159d32c8-mgmt-non-reqserving-vmtnn requestserving.go:132: Tearing down custom nodepool clusters/06159d32c8-mgmt-non-reqserving-frmf2 requestserving.go:132: Tearing down custom nodepool clusters/06159d32c8-mgmt-non-reqserving-89mnc fixture.go:409: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "request-serving-isolation-hwhcv" not found fixture.go:417: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-v27rf, name: request-serving-isolation-hwhcv
TestKarpenter
40m21.62s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-28rnd/karpenter-82nc9 in 1m23s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-82nc9 util.go:3158: Failed to wait for HostedCluster e2e-clusters-28rnd/karpenter-82nc9 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-28rnd/karpenter-82nc9 invalid at RV 59542 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: some cluster operators are not available) eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-karpenter-82nc9.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestKarpenter/ValidateHostedCluster
11m0.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-28rnd/karpenter-82nc9 in 1m0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-82nc9.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-karpenter-82nc9.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestKarpenterUpgradeControlPlane
43m55.27s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-5hrsh/karpenter-upgrade-control-plane-hzlmq in 2m14s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-hzlmq util.go:3158: Failed to wait for HostedCluster e2e-clusters-5hrsh/karpenter-upgrade-control-plane-hzlmq to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-5hrsh/karpenter-upgrade-control-plane-hzlmq invalid at RV 64602 after 2s: eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-06-025117: some cluster operators are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, openshift-samples, service-ca are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-karpenter-upgrade-control-plane-hzlmq.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted AWSEndpointAvailable=True, got AWSEndpointAvailable=False: AWSError(operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 3, https response error StatusCode: 400, RequestID: 51e00466-7669-4625-9670-28afe520b604, api error Throttling: Rate exceeded) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestKarpenterUpgradeControlPlane/ValidateHostedCluster
12m21.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-5hrsh/karpenter-upgrade-control-plane-hzlmq in 2m21s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-upgrade-control-plane-hzlmq.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-karpenter-upgrade-control-plane-hzlmq.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster0
30m18.94s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-vx6wx/node-pool-2k4rs in 3m24s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-2k4rs util.go:3158: Failed to wait for HostedCluster e2e-clusters-vx6wx/node-pool-2k4rs to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-vx6wx/node-pool-2k4rs invalid at RV 61334 after 2s: incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-2k4rs.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
10m42.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-vx6wx/node-pool-2k4rs in 42s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-2k4rs.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-2k4rs.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool/HostedCluster2
32m11.93s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-7fpgz/node-pool-c2mlx in 6m5s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-c2mlx util.go:3158: Failed to wait for HostedCluster e2e-clusters-7fpgz/node-pool-c2mlx to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-7fpgz/node-pool-c2mlx invalid at RV 75425 after 2s: eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-c2mlx.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted AWSEndpointAvailable=True, got AWSEndpointAvailable=False: AWSError(operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 3, https response error StatusCode: 400, RequestID: 2719f521-fffb-4a5d-a5ba-2b7ac355976f, api error Throttling: Rate exceeded) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
11m3.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-7fpgz/node-pool-c2mlx in 1m3s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-c2mlx.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-c2mlx.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePoolAutoscalingScaleFromZero
47m17.57s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-xh4tn/scale-from-zero-sbvzv in 15m22s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster scale-from-zero-sbvzv util.go:3158: Failed to wait for HostedCluster e2e-clusters-xh4tn/scale-from-zero-sbvzv to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-xh4tn/scale-from-zero-sbvzv invalid at RV 85621 after 2s: eventually.go:228: - incorrect condition: wanted ControlPlaneConnectionAvailable=True, got ControlPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available to verify control plane connectivity) eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-09-173526-test-ci-op-0xgltxi5-latest: some cluster operators are not available) eventually.go:228: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-scale-from-zero-sbvzv.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted DataPlaneConnectionAvailable=True, got DataPlaneConnectionAvailable=Unknown: NoWorkerNodesAvailable(No worker nodes available) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePoolAutoscalingScaleFromZero/ValidateHostedCluster
10m54.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-xh4tn/scale-from-zero-sbvzv in 54s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-scale-from-zero-sbvzv.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-scale-from-zero-sbvzv.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestUpgradeControlPlane
32m46.66s
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-0xgltxi5/release@sha256:29c8114156366a64189b0fde635aaa8a3dd051672271fbf395a6f5bccc881f8a, toImage: registry.build01.ci.openshift.org/ci-op-0xgltxi5/release@sha256:6814c937c33e744e3caa7759e4f0a7f335313ac0284d09528e953c0bc96ec739 hypershift_framework.go:518: failed to create cluster, tearing down: failed to create infra: operation error Route 53: ChangeResourceRecordSets, exceeded maximum number of attempts, 21, https response error StatusCode: 400, RequestID: 0448db7e-0613-448e-a148-2087d941500f, api error Throttling: Rate exceeded fixture.go:409: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "control-plane-upgrade-ndcng" not found fixture.go:417: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-x7xl8, name: control-plane-upgrade-ndcng