PR #7143 - 11-04 23:14

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

130
Total Tests
90
Passed
14
Failed
26
Skipped

Failed Tests

TestAutoscaling
1h3m1.75s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-5bk7f/autoscaling-ggszp in 2m51s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster autoscaling-ggszp util.go:2835: Failed to wait for HostedCluster e2e-clusters-5bk7f/autoscaling-ggszp to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-5bk7f/autoscaling-ggszp invalid at RV 47546 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest: the cluster operator console is not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
49m6.25s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-5bk7f/autoscaling-ggszp in 2m36.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-ggszp.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-ggszp.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Successfully waited for a successful connection to the guest API server in 9m15.125s util.go:541: Successfully waited for 1 nodes to become ready in 7m15.05s eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:574: Failed to wait for HostedCluster e2e-clusters-5bk7f/autoscaling-ggszp to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-5bk7f/autoscaling-ggszp invalid at RV 47546 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:574: *v1beta1.HostedCluster e2e-clusters-5bk7f/autoscaling-ggszp conditions: util.go:574: ClusterVersionUpgradeable=False: UpdateInProgress(An update is already in progress and the details are in the Progressing condition) util.go:574: ClusterVersionAvailable=False: FromClusterVersion util.go:574: ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) util.go:574: ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest: the cluster operator console is not available) util.go:574: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest" image="registry.build01.ci.openshift.org/ci-op-prhpjmjr/release@sha256:ff6bbc9f02a9fd0c400ef2819c2ffc25ec70adc77e51cf37f3a0639fab03369c" architecture="amd64") util.go:574: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:574: EtcdAvailable=True: QuorumAvailable util.go:574: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:574: InfrastructureReady=True: AsExpected(All is well) util.go:574: ExternalDNSReachable=True: AsExpected(All is well) util.go:574: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:574: ValidReleaseInfo=True: AsExpected(All is well) util.go:574: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:574: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:574: Available=True: AsExpected(The hosted control plane is available) util.go:574: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:574: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:574: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:574: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:574: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:574: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:574: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:574: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:574: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:574: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)
TestAzureScheduler
1h1m41.12s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-r7jsd/azure-scheduler-c6n8g in 2m40s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster azure-scheduler-c6n8g util.go:2835: Failed to wait for HostedCluster e2e-clusters-r7jsd/azure-scheduler-c6n8g to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-r7jsd/azure-scheduler-c6n8g invalid at RV 48977 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest: the cluster operator console is not available) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestAzureScheduler/ValidateHostedCluster
48m0.27s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-r7jsd/azure-scheduler-c6n8g in 2m24.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-c6n8g.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-azure-scheduler-c6n8g.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Successfully waited for a successful connection to the guest API server in 9m45.125s util.go:541: Successfully waited for 2 nodes to become ready in 5m51.075s eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:574: Failed to wait for HostedCluster e2e-clusters-r7jsd/azure-scheduler-c6n8g to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-r7jsd/azure-scheduler-c6n8g invalid at RV 48977 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:574: *v1beta1.HostedCluster e2e-clusters-r7jsd/azure-scheduler-c6n8g conditions: util.go:574: ClusterVersionSucceeding=False: ClusterOperatorNotAvailable(Cluster operator console is not available) util.go:574: ClusterVersionProgressing=True: ClusterOperatorNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest: the cluster operator console is not available) util.go:574: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest" image="registry.build01.ci.openshift.org/ci-op-prhpjmjr/release@sha256:ff6bbc9f02a9fd0c400ef2819c2ffc25ec70adc77e51cf37f3a0639fab03369c" architecture="amd64") util.go:574: ClusterVersionUpgradeable=False: UpdateInProgress(An update is already in progress and the details are in the Progressing condition) util.go:574: ClusterVersionAvailable=False: FromClusterVersion util.go:574: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:574: EtcdAvailable=True: QuorumAvailable util.go:574: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:574: InfrastructureReady=True: AsExpected(All is well) util.go:574: ExternalDNSReachable=True: AsExpected(All is well) util.go:574: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:574: ValidReleaseInfo=True: AsExpected(All is well) util.go:574: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:574: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:574: Available=True: AsExpected(The hosted control plane is available) util.go:574: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:574: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:574: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:574: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:574: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:574: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:574: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:574: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:574: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:574: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)
TestCreateCluster
1h2m9.72s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-7jdp2/create-cluster-87nt2 in 2m37s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster create-cluster-87nt2 util.go:2835: Failed to wait for HostedCluster e2e-clusters-7jdp2/create-cluster-87nt2 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-7jdp2/create-cluster-87nt2 invalid at RV 52459 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorDegraded(Cluster operator ingress is degraded) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
48m48.31s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-7jdp2/create-cluster-87nt2 in 2m48.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-87nt2.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-87nt2.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Successfully waited for a successful connection to the guest API server in 9m15.15s util.go:541: Successfully waited for 2 nodes to become ready in 6m45.075s util.go:574: Failed to wait for HostedCluster e2e-clusters-7jdp2/create-cluster-87nt2 to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-7jdp2/create-cluster-87nt2 invalid at RV 52459 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:574: *v1beta1.HostedCluster e2e-clusters-7jdp2/create-cluster-87nt2 conditions: util.go:574: ClusterVersionSucceeding=False: ClusterOperatorDegraded(Cluster operator ingress is degraded) util.go:574: ClusterVersionProgressing=False: ClusterOperatorDegraded(Error while reconciling 4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest: the cluster operator ingress is degraded) util.go:574: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest" image="registry.build01.ci.openshift.org/ci-op-prhpjmjr/release@sha256:ff6bbc9f02a9fd0c400ef2819c2ffc25ec70adc77e51cf37f3a0639fab03369c" architecture="amd64") util.go:574: ClusterVersionUpgradeable=True: FromClusterVersion(Condition not found in the CVO.) util.go:574: ClusterVersionAvailable=False: FromClusterVersion util.go:574: Degraded=False: AsExpected(The hosted cluster is not degraded) util.go:574: EtcdAvailable=True: QuorumAvailable util.go:574: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:574: InfrastructureReady=True: AsExpected(All is well) util.go:574: ExternalDNSReachable=True: AsExpected(All is well) util.go:574: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:574: ValidReleaseInfo=True: AsExpected(All is well) util.go:574: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:574: HostedClusterRestoredFromBackup=Unknown: StatusUnknown(Condition not found in the HCP) util.go:574: Available=True: AsExpected(The hosted control plane is available) util.go:574: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:574: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:574: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:574: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:574: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:574: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:574: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:574: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:574: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:574: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:574: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)
TestCreateClusterCustomConfig
24m18.91s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-qz2t9/custom-config-qsd6h in 2m40s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster custom-config-qsd6h util.go:2835: Failed to wait for HostedCluster e2e-clusters-qz2t9/custom-config-qsd6h to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-qz2t9/custom-config-qsd6h invalid at RV 33938 after 2s: eventually.go:227: - incorrect condition: wanted Available=True, got Available=False: KASLoadBalancerNotReachable(Get "https://api-custom-config-qsd6h.aks-e2e.hypershift.azure.devcluster.openshift.com:443/healthz": dial tcp: lookup api-custom-config-qsd6h.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators dns, kube-storage-version-migrator, monitoring, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ExternalDNSReachable=True, got ExternalDNSReachable=False: ExternalDNSHostNotReachable(lookup api-custom-config-qsd6h.aks-e2e.hypershift.azure.devcluster.openshift.com on 10.0.0.10:53: no such host) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-235105-test-ci-op-prhpjmjr-latest: some cluster operators are not available) hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
12m24.08s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-qz2t9/custom-config-qsd6h in 2m24.05s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-qsd6h.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-qsd6h.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:104: Failed to get *v1.SelfSubjectReview: context deadline exceeded util.go:359: Failed to wait for a successful connection to the guest API server in 10m0s: context deadline exceeded
TestNodePool
0s
TestNodePool/HostedCluster2
57m46.56s
hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-ww4hv/node-pool-q4jt7 in 2m48s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster node-pool-q4jt7 util.go:2835: Successfully waited for HostedCluster e2e-clusters-ww4hv/node-pool-q4jt7 to have valid conditions in 25ms hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestNodePool/HostedCluster2/Main
140ms
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-ww4hv/node-pool-q4jt7 in 25ms util.go:297: Successfully waited for kubeconfig secret to have data in 25ms util.go:359: Successfully waited for a successful connection to the guest API server in 25ms
TestNodePool/HostedCluster2/Main/TestAdditionalTrustBundlePropagation
30m0.04s
nodepool_additionalTrustBundlePropagation_test.go:39: Starting AdditionalTrustBundlePropagationTest. util.go:541: Failed to wait for 1 nodes to become ready for NodePool e2e-clusters-ww4hv/node-pool-q4jt7-test-additional-trust-bundle-propagation in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 1 nodes, got 0
TestUpgradeControlPlane
55m14.37s
control_plane_upgrade_test.go:26: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-prhpjmjr/release@sha256:45f373ca100ac2702dfa8bc055c8feff24ade29c339cfe13ac06ab21daec75b1, toImage: registry.build01.ci.openshift.org/ci-op-prhpjmjr/release@sha256:ff6bbc9f02a9fd0c400ef2819c2ffc25ec70adc77e51cf37f3a0639fab03369c hypershift_framework.go:423: Successfully created hostedcluster e2e-clusters-4dc55/control-plane-upgrade-pp5qc in 2m21s hypershift_framework.go:119: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-pp5qc util.go:2835: Failed to wait for HostedCluster e2e-clusters-4dc55/control-plane-upgrade-pp5qc to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-4dc55/control-plane-upgrade-pp5qc invalid at RV 37724 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: ClusterOperatorsNotAvailable(Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, node-tuning, openshift-samples, service-ca, storage are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: ClusterOperatorsNotAvailable(Unable to apply 4.21.0-0.ci-2025-11-04-112427: some cluster operators are not available) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:242: skipping postTeardown() hypershift_framework.go:223: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
42m15.18s
util.go:280: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-4dc55/control-plane-upgrade-pp5qc in 3m24.025s util.go:297: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-pp5qc.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-control-plane-upgrade-pp5qc.aks-e2e.hypershift.azure.devcluster.openshift.com on 172.30.0.10:53: no such host util.go:359: Successfully waited for a successful connection to the guest API server in 8m51.1s eventually.go:258: Failed to get **v1.Node: context deadline exceeded util.go:541: Failed to wait for 2 nodes to become ready in 30m0s: context deadline exceeded eventually.go:383: observed invalid **v1.Node state after 30m0s eventually.go:400: - observed **v1.Node collection invalid: expected 2 nodes, got 0