PR #6029 - 04-17 01:32

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

422
Total Tests
391
Passed
11
Failed
20
Skipped

Failed Tests

TestNodePool
0s
TestNodePool/HostedCluster0
44m43.68s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-d8525/node-pool-jghb8 in 36s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster node-pool-jghb8 eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:2123: Failed to wait for HostedCluster e2e-clusters-d8525/node-pool-jghb8 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-d8525/node-pool-jghb8 invalid at RV 114802 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=True: FromClusterVersion(Done applying 4.19.0-0.ci-2025-04-17-013246-test-ci-op-695tyqvk-latest) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=False: FromClusterVersion(Cluster version is 4.19.0-0.ci-2025-04-17-013246-test-ci-op-695tyqvk-latest) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=True: FromClusterVersion hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestNodePool/HostedCluster0/Main
40ms
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-d8525/node-pool-jghb8 in 0s util.go:235: Successfully waited for kubeconfig secret to have data in 0s util.go:281: Successfully waited for a successful connection to the guest API server in 25ms
TestNodePool/HostedCluster0/Main/TestNTOMachineConfigAppliedInPlace
31m39.05s
nodepool_nto_machineconfig_test.go:68: Starting test NTOMachineConfigRolloutTest util.go:462: Successfully waited for 2 nodes to become ready for NodePool e2e-clusters-d8525/node-pool-jghb8-test-ntomachineconfig-inplace in 11m18s nodepool_test.go:350: Successfully waited for NodePool e2e-clusters-d8525/node-pool-jghb8-test-ntomachineconfig-inplace to have correct status in 8s util.go:378: Successfully waited for NodePool e2e-clusters-d8525/node-pool-jghb8-test-ntomachineconfig-inplace to start config update in 13s eventually.go:104: Failed to get *v1beta1.NodePool: client rate limiter Wait returned an error: context deadline exceeded util.go:393: Failed to wait for NodePool e2e-clusters-d8525/node-pool-jghb8-test-ntomachineconfig-inplace to finish config update in 20m0s: context deadline exceeded eventually.go:224: observed *v1beta1.NodePool e2e-clusters-d8525/node-pool-jghb8-test-ntomachineconfig-inplace invalid at RV 96960 after 20m0s: incorrect condition: wanted UpdatingConfig=False, got UpdatingConfig=True: AsExpected(Nodepool update in progress. Target Config version: fb095409. Total Nodes: 2. Upgraded: 1) util.go:393: *v1beta1.NodePool e2e-clusters-d8525/node-pool-jghb8-test-ntomachineconfig-inplace conditions: util.go:393: AutoscalingEnabled=False: AsExpected util.go:393: ValidReleaseImage=True: AsExpected(Using release image: registry.build01.ci.openshift.org/ci-op-695tyqvk/release@sha256:2d0455cf973bb5a25b968fced3bf7eedf19d10cb3d51624519ee05c6255fc6f9) util.go:393: ReconciliationActive=True: ReconciliationActive(Reconciliation active on resource) util.go:393: AllMachinesReady=True: AsExpected(All is well) util.go:393: AllNodesHealthy=True: AsExpected(All is well) util.go:393: ReachedIgnitionEndpoint=True: AsExpected util.go:393: UpdateManagementEnabled=True: AsExpected util.go:393: ValidArchPlatform=True: AsExpected util.go:393: ValidMachineConfig=True: AsExpected util.go:393: UpdatingConfig=True: AsExpected(Nodepool update in progress. Target Config version: fb095409. Total Nodes: 2. Upgraded: 1) util.go:393: UpdatingVersion=False: AsExpected util.go:393: ValidGeneratedPayload=True: AsExpected(Payload generated successfully) util.go:393: ValidPlatformImage=True: AsExpected(Bootstrap AMI is "ami-0b6b825641a2ea530") util.go:393: AWSSecurityGroupAvailable=True: AsExpected(NodePool has a default security group) util.go:393: ValidTuningConfig=True: AsExpected util.go:393: UpdatingPlatformMachineTemplate=False: AsExpected util.go:393: AutorepairEnabled=False: AsExpected util.go:393: Ready=True: AsExpected
TestNodePool/HostedCluster2
1h2m7.5s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-7dd4g/node-pool-7nmv5 in 1m33s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster node-pool-7nmv5 util.go:2123: Failed to wait for HostedCluster e2e-clusters-7dd4g/node-pool-7nmv5 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-7dd4g/node-pool-7nmv5 invalid at RV 143706 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=False, got ClusterVersionSucceeding=True: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=False, got ClusterVersionAvailable=True: FromClusterVersion(Done applying 4.19.0-0.ci-2025-04-17-013246-test-ci-op-695tyqvk-latest) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=True, got ClusterVersionProgressing=False: FromClusterVersion(Cluster version is 4.19.0-0.ci-2025-04-17-013246-test-ci-op-695tyqvk-latest) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestNodePool/HostedCluster2/Main
40ms
util.go:218: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-7dd4g/node-pool-7nmv5 in 0s util.go:235: Successfully waited for kubeconfig secret to have data in 0s util.go:281: Successfully waited for a successful connection to the guest API server in 25ms
TestNodePool/HostedCluster2/Main/TestAdditionalTrustBundlePropagation
36m25.04s
nodepool_additionalTrustBundlePropagation_test.go:36: Starting AdditionalTrustBundlePropagationTest. util.go:462: Successfully waited for 1 nodes to become ready for NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation in 5m54s nodepool_test.go:350: Successfully waited for NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation to have correct status in 11s eventually.go:104: Failed to get *v1beta1.NodePool: client rate limiter Wait returned an error: context deadline exceeded nodepool_test.go:350: Failed to wait for NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation to have correct status in 10m0s: context deadline exceeded eventually.go:224: observed *v1beta1.NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation invalid at RV 123937 after 10m0s: eventually.go:227: - incorrect condition: wanted UpdatingConfig=False, got UpdatingConfig=True: AsExpected(Updating config in progress. Target config: 51729156) eventually.go:227: - incorrect condition: wanted AllMachinesReady=True, got AllMachinesReady=False: Draining(1 of 2 machines are not ready Machine node-pool-7nmv5-test-additional-trust-bundle-propagation-kbtzl6: Draining )
TestNodePool/HostedCluster2/Main/TestAdditionalTrustBundlePropagation/AdditionalTrustBundlePropagationTest
20m20.03s
nodepool_additionalTrustBundlePropagation_test.go:70: Updating hosted cluster with additional trust bundle. Bundle: additional-trust-bundle nodepool_additionalTrustBundlePropagation_test.go:78: Successfully waited for Waiting for NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation to begin updating in 20s eventually.go:104: Failed to get *v1beta1.NodePool: client rate limiter Wait returned an error: context deadline exceeded nodepool_additionalTrustBundlePropagation_test.go:92: Failed to wait for Waiting for NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation to stop updating in 20m0s: context deadline exceeded eventually.go:224: observed *v1beta1.NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation invalid at RV 123937 after 20m0s: incorrect condition: wanted UpdatingConfig=False, got UpdatingConfig=True: AsExpected(Updating config in progress. Target config: 51729156) nodepool_additionalTrustBundlePropagation_test.go:92: *v1beta1.NodePool e2e-clusters-7dd4g/node-pool-7nmv5-test-additional-trust-bundle-propagation conditions: nodepool_additionalTrustBundlePropagation_test.go:92: AllMachinesReady=False: Draining(1 of 2 machines are not ready Machine node-pool-7nmv5-test-additional-trust-bundle-propagation-kbtzl6: Draining ) nodepool_additionalTrustBundlePropagation_test.go:92: AllNodesHealthy=True: AsExpected(All is well) nodepool_additionalTrustBundlePropagation_test.go:92: ValidReleaseImage=True: AsExpected(Using release image: registry.build01.ci.openshift.org/ci-op-695tyqvk/release@sha256:2d0455cf973bb5a25b968fced3bf7eedf19d10cb3d51624519ee05c6255fc6f9) nodepool_additionalTrustBundlePropagation_test.go:92: ReconciliationActive=True: ReconciliationActive(Reconciliation active on resource) nodepool_additionalTrustBundlePropagation_test.go:92: ValidMachineConfig=True: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: UpdatingConfig=True: AsExpected(Updating config in progress. Target config: 51729156) nodepool_additionalTrustBundlePropagation_test.go:92: UpdatingVersion=False: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: AutoscalingEnabled=False: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: UpdateManagementEnabled=True: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: ValidArchPlatform=True: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: ValidGeneratedPayload=True: AsExpected(Payload generated successfully) nodepool_additionalTrustBundlePropagation_test.go:92: ReachedIgnitionEndpoint=True: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: ValidPlatformImage=True: AsExpected(Bootstrap AMI is "ami-0b6b825641a2ea530") nodepool_additionalTrustBundlePropagation_test.go:92: AWSSecurityGroupAvailable=True: AsExpected(NodePool has a default security group) nodepool_additionalTrustBundlePropagation_test.go:92: ValidTuningConfig=True: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: UpdatingPlatformMachineTemplate=False: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: Ready=True: AsExpected nodepool_additionalTrustBundlePropagation_test.go:92: AutorepairEnabled=False: AsExpected
TestNoneCreateCluster
13m21.86s
hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-2tc94/none-9nnw9 in 8s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster none-9nnw9 eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:2123: Failed to wait for HostedCluster e2e-clusters-2tc94/none-9nnw9 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-2tc94/none-9nnw9 invalid at RV 19903 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([catalog-operator deployment has 1 unavailable replicas, certified-operators-catalog deployment has 1 unavailable replicas, cluster-image-registry-operator deployment has 1 unavailable replicas, cluster-network-operator deployment has 1 unavailable replicas, cluster-storage-operator deployment has 1 unavailable replicas, cluster-version-operator deployment has 1 unavailable replicas, community-operators-catalog deployment has 1 unavailable replicas, csi-snapshot-controller-operator deployment has 1 unavailable replicas, dns-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, ignition-server-proxy deployment has 1 unavailable replicas, ingress-operator deployment has 1 unavailable replicas, machine-approver deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, packageserver deployment has 1 unavailable replicas, redhat-marketplace-catalog deployment has 1 unavailable replicas, redhat-operators-catalog deployment has 1 unavailable replicas]) eventually.go:227: - incorrect condition: wanted ClusterVersionReleaseAccepted=True, got ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called
TestNoneCreateCluster/EnsureHostedCluster
15.47s
TestNoneCreateCluster/EnsureHostedCluster/EnsurePayloadArchSetCorrectly
15.31s
util.go:2401: Failed to wait for HostedCluster e2e-clusters-2tc94/none-9nnw9 to have valid Status.Payload in 15s: failed to determine if release image multi-arch: failed to retrieve manifest registry.build01.ci.openshift.org/ci-op-695tyqvk/release@sha256:2d0455cf973bb5a25b968fced3bf7eedf19d10cb3d51624519ee05c6255fc6f9: failed to create repository client for https://registry.build01.ci.openshift.org: Get "https://registry.build01.ci.openshift.org/v2/": context deadline exceeded (Client.Timeout exceeded while awaiting headers) util.go:2401: *v1beta1.HostedCluster e2e-clusters-2tc94/none-9nnw9 conditions: util.go:2401: ClusterVersionSucceeding=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:2401: ClusterVersionProgressing=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:2401: ClusterVersionReleaseAccepted=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:2401: ClusterVersionUpgradeable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:2401: ClusterVersionAvailable=Unknown: StatusUnknown(Condition not found in the CVO.) util.go:2401: Degraded=True: UnavailableReplicas(openshift-apiserver deployment has 1 unavailable replicas) util.go:2401: EtcdAvailable=True: QuorumAvailable util.go:2401: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:2401: InfrastructureReady=True: AsExpected(All is well) util.go:2401: ExternalDNSReachable=Unknown: StatusUnknown(External DNS is not configured) util.go:2401: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:2401: ValidReleaseInfo=True: AsExpected(All is well) util.go:2401: ValidIDPConfiguration=Unknown: StatusUnknown(Condition not found in the HCP) util.go:2401: Available=False: KASLoadBalancerNotReachable(Get "https://ac3f9f7806ed6457ea9b2c6e77945a66-983612162.us-east-1.elb.amazonaws.com:6443/healthz": dial tcp: lookup ac3f9f7806ed6457ea9b2c6e77945a66-983612162.us-east-1.elb.amazonaws.com on 172.29.0.10:53: no such host) util.go:2401: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:2401: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:2401: IgnitionEndpointAvailable=False: NotFound(Ignition server deployment not found) util.go:2401: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:2401: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:2401: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:2401: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:2401: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully)