PR #8681 - 07-17 12:02

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

400
Total Tests
361
Passed
15
Failed
24
Skipped

Failed Tests

TestCreateCluster
1h0m3.23s
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-6tdz5/create-cluster-dl9bv in 17m43s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-dl9bv util.go:3158: Successfully waited for HostedCluster e2e-clusters-6tdz5/create-cluster-dl9bv to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
17m54.28s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-6tdz5/create-cluster-dl9bv in 48s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dl9bv.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-dl9bv.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dl9bv.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.214.41.200:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dl9bv.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 44.197.48.91:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 3m19.025s util.go:583: Successfully waited for 3 nodes to become ready in 7m48s util.go:620: Successfully waited for HostedCluster e2e-clusters-6tdz5/create-cluster-dl9bv to rollout in 5m45s util.go:3158: Successfully waited for HostedCluster e2e-clusters-6tdz5/create-cluster-dl9bv to have valid conditions in 9s
TestCreateCluster/ValidateHostedCluster/EnsureNoCrashingPods
40ms
util.go:829: Container manager in pod capi-provider-6f48d85974-wwrzb has a restartCount > 0 (2) util.go:829: Container control-plane-operator in pod control-plane-operator-84f6875dff-dns2l has a restartCount > 0 (4) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-5fc6bd888f-xj6kx has a restartCount > 0 (5)
TestCreateClusterPrivateWithRouteKAS
1h24m21.44s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-wkqxz/private-m4spc in 12m10s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster private-m4spc util.go:3158: Failed to wait for HostedCluster e2e-clusters-wkqxz/private-m4spc to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-wkqxz/private-m4spc invalid at RV 162511 after 2s: eventually.go:228: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) eventually.go:228: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:228: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-17-121639-test-ci-op-37ktfg96-latest: the cluster operator console is not available) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterPrivateWithRouteKAS/ValidateHostedCluster
41m54.02s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-wkqxz/private-m4spc in 39s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:744: Successfully waited for NodePools for HostedCluster e2e-clusters-wkqxz/private-m4spc to have all of their desired nodes in 11m15s eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:620: Failed to wait for HostedCluster e2e-clusters-wkqxz/private-m4spc to rollout in 30m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-wkqxz/private-m4spc invalid at RV 162511 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:620: *v1beta1.HostedCluster e2e-clusters-wkqxz/private-m4spc conditions: util.go:620: ValidAWSIdentityProvider=True: AsExpected(All is well) util.go:620: ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) util.go:620: ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 5.0.0-0.ci-2026-07-17-121639-test-ci-op-37ktfg96-latest: the cluster operator console is not available) util.go:620: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="5.0.0-0.ci-2026-07-17-121639-test-ci-op-37ktfg96-latest" image="registry.build01.ci.openshift.org/ci-op-37ktfg96/release@sha256:725ad403afb86ee888ca6b4c2fc1fe5cad32787a85192631fc01c61183f8a041" architecture="amd64") util.go:620: ClusterVersionUpgradeable=False: ClusterVersionUpdating(An update is already in progress and the details are in the Progressing condition.) util.go:620: ClusterVersionAvailable=False: FromClusterVersion util.go:620: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:620: EtcdAvailable=True: QuorumAvailable util.go:620: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:620: InfrastructureReady=True: AsExpected(All is well) util.go:620: ExternalDNSReachable=Unknown: StatusUnknown(External DNS is not configured) util.go:620: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:620: ValidReleaseInfo=True: AsExpected(All is well) util.go:620: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:620: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: DataPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: ControlPlaneConnectionAvailable=True: AsExpected(All is well) util.go:620: EtcdBackupSucceeded=Unknown: StatusUnknown(Condition not found in the HCP) util.go:620: ConfigOperatorReconciliationSucceeded=True: AsExpected(All is well) util.go:620: AutoNodeEnabled=False: AutoNodeNotConfigured(AutoNode provisioner is not configured) util.go:620: Available=True: AsExpected(The hosted control plane is available) util.go:620: AWSEndpointAvailable=True: AWSSuccess(All is well) util.go:620: AWSEndpointServiceAvailable=True: AWSSuccess(All is well) util.go:620: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:620: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:620: ValidProxyConfiguration=True: AsExpected(No proxy CA bundle configured) util.go:620: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:620: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:620: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:620: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:620: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:620: ValidOIDCConfiguration=True: AsExpected(OIDC configuration is valid) util.go:620: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:620: ValidAWSKMSConfig=Unknown: StatusUnknown(AWS KMS is not configured) util.go:620: EtcdDataEncryptionUpToDate=True: ReEncryptionCompleted(Encryption key initialized) util.go:620: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.) util.go:620: AWSDefaultSecurityGroupCreated=True: AsExpected(All is well)
TestCreateClusterRequestServingIsolation
35m53.71s
requestserving.go:105: Created request serving nodepool clusters/15c3010505-mgmt-reqserving-dc527 requestserving.go:105: Created request serving nodepool clusters/15c3010505-mgmt-reqserving-smc7k requestserving.go:113: Created non request serving nodepool clusters/15c3010505-mgmt-non-reqserving-rhqgl requestserving.go:113: Created non request serving nodepool clusters/15c3010505-mgmt-non-reqserving-slf8t requestserving.go:113: Created non request serving nodepool clusters/15c3010505-mgmt-non-reqserving-vqjg4 util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/15c3010505-mgmt-reqserving-dc527 in 3m39s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/15c3010505-mgmt-reqserving-smc7k in 100ms util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/15c3010505-mgmt-non-reqserving-rhqgl in 27s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/15c3010505-mgmt-non-reqserving-slf8t in 15s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/15c3010505-mgmt-non-reqserving-vqjg4 in 15s create_cluster_test.go:299: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:518: failed to create cluster, tearing down: failed to apply object "/e2e-clusters-7pqbj": Timeout: request did not complete within requested timeout - context deadline exceeded requestserving.go:132: Tearing down custom nodepool clusters/15c3010505-mgmt-reqserving-dc527 requestserving.go:132: Tearing down custom nodepool clusters/15c3010505-mgmt-reqserving-smc7k requestserving.go:132: Tearing down custom nodepool clusters/15c3010505-mgmt-non-reqserving-rhqgl requestserving.go:132: Tearing down custom nodepool clusters/15c3010505-mgmt-non-reqserving-slf8t requestserving.go:132: Tearing down custom nodepool clusters/15c3010505-mgmt-non-reqserving-vqjg4 fixture.go:417: Failed saving machine console logs; this is nonfatal: failed to get machine console logs: failed to get hostedcluster: hostedclusters.hypershift.openshift.io "request-serving-isolation-rj6mk" not found fixture.go:425: Failed to dump machine journals; this is nonfatal: no SSH secret specified for cluster, cannot dump journals hypershift_framework.go:591: Destroyed cluster. Namespace: e2e-clusters-7pqbj, name: request-serving-isolation-rj6mk
TestKarpenterUpgradeControlPlane
1h9m20.56s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-p4zfb/karpenter-upgrade-control-plane-s4tdc in 10m19s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-s4tdc util.go:3158: Successfully waited for HostedCluster e2e-clusters-p4zfb/karpenter-upgrade-control-plane-s4tdc to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestKarpenterUpgradeControlPlane/ValidateHostedCluster
24m56.39s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-p4zfb/karpenter-upgrade-control-plane-s4tdc in 45s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-upgrade-control-plane-s4tdc.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-karpenter-upgrade-control-plane-s4tdc.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-upgrade-control-plane-s4tdc.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 34.225.47.96:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m24.025s util.go:583: Successfully waited for 2 nodes to become ready in 9m12s util.go:620: Successfully waited for HostedCluster e2e-clusters-p4zfb/karpenter-upgrade-control-plane-s4tdc to rollout in 2m39s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://aa43966e1d493483aa911d2252fd9062-3acaa9561e714009.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-p4zfb/hostedclusters/karpenter-upgrade-control-plane-s4tdc?timeout=5m0s": stream error: stream ID 8963; INTERNAL_ERROR; received from peer util.go:3158: Successfully waited for HostedCluster e2e-clusters-p4zfb/karpenter-upgrade-control-plane-s4tdc to have valid conditions in 9m36s
TestKarpenterUpgradeControlPlane/ValidateHostedCluster/EnsureNoCrashingPods
50ms
util.go:829: Container manager in pod capi-provider-7b85f58cdc-6zdgc has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-6f5747779b-w6spp has a restartCount > 0 (5) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-7ffbd54c5d-hlt55 has a restartCount > 0 (5)
TestNodePool
0s
TestNodePool/HostedCluster0
28m29.06s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-szd66/node-pool-kx689 in 11m53s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-kx689 util.go:3158: Failed to wait for HostedCluster e2e-clusters-szd66/node-pool-kx689 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-szd66/node-pool-kx689 invalid at RV 71255 after 2s: incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-node-pool-kx689.service.ci.hypershift.devcluster.openshift.com on 172.29.0.10:53: no such host) hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
10m54.01s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-szd66/node-pool-kx689 in 54s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-kx689.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-kx689.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:384: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool/HostedCluster2
38m50.74s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-66cqr/node-pool-klqcs in 25m45s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-klqcs util.go:3158: Successfully waited for HostedCluster e2e-clusters-66cqr/node-pool-klqcs to have valid conditions in 25ms hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster2/ValidateHostedCluster
8m3.38s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-66cqr/node-pool-klqcs in 39s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-klqcs.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-klqcs.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-klqcs.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.234.26.93:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-klqcs.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.229.152.228:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m21.025s util.go:583: Successfully waited for 0 nodes to become ready in 25ms eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://aa43966e1d493483aa911d2252fd9062-3acaa9561e714009.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-66cqr/hostedclusters/node-pool-klqcs?timeout=5m0s": stream error: stream ID 8959; INTERNAL_ERROR; received from peer util.go:3158: Successfully waited for HostedCluster e2e-clusters-66cqr/node-pool-klqcs to have valid conditions in 4m18s
TestNodePool/HostedCluster2/ValidateHostedCluster/EnsureNoCrashingPods
50ms
util.go:829: Container manager in pod capi-provider-598fb8cdfb-f6pzb has a restartCount > 0 (2) util.go:829: Container control-plane-operator in pod control-plane-operator-6f5495c9bd-8m4bs has a restartCount > 0 (4) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-689c7c4854-ggfjs has a restartCount > 0 (4)