PR #6002 - 04-13 04:59

hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-fjjpt/azure-scheduler-t9xh6 in 1m47s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster azure-scheduler-t9xh6 eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:1981: Failed to wait for HostedCluster e2e-clusters-fjjpt/azure-scheduler-t9xh6 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-fjjpt/azure-scheduler-t9xh6 invalid at RV 37803 after 2s: eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators ingress, monitoring, openshift-samples are not available * Could not update imagestream "openshift/driver-toolkit" (444 of 618): the server is down or not responding * Could not update oauthclient "console" (375 of 618): the server does not recognize this resource, check extension API servers * Could not update role "openshift-console-operator/prometheus-k8s" (576 of 618): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (580 of 618): resource may have been deleted) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: MultipleErrors(Unable to apply 4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest: an unknown error has occurred: MultipleErrors) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called

util.go:221: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-fjjpt/azure-scheduler-t9xh6 in 1m41.025s util.go:238: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-azure-scheduler-t9xh6.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:284: Successfully waited for a successful connection to the guest API server in 18.325s util.go:465: Successfully waited for 2 nodes to become ready in 11m37.025s eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:497: Failed to wait for HostedCluster e2e-clusters-fjjpt/azure-scheduler-t9xh6 to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-fjjpt/azure-scheduler-t9xh6 invalid at RV 37803 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:497: *v1beta1.HostedCluster e2e-clusters-fjjpt/azure-scheduler-t9xh6 conditions: util.go:497: ClusterVersionUpgradeable=False: UpdateInProgress(An update is already in progress and the details are in the Progressing condition) util.go:497: ClusterVersionAvailable=False: FromClusterVersion util.go:497: ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators ingress, monitoring, openshift-samples are not available * Could not update imagestream "openshift/driver-toolkit" (444 of 618): the server is down or not responding * Could not update oauthclient "console" (375 of 618): the server does not recognize this resource, check extension API servers * Could not update role "openshift-console-operator/prometheus-k8s" (576 of 618): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (580 of 618): resource may have been deleted) util.go:497: ClusterVersionProgressing=True: MultipleErrors(Unable to apply 4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest: an unknown error has occurred: MultipleErrors) util.go:497: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest" image="registry.build01.ci.openshift.org/ci-op-qvyk6zd9/release@sha256:7a2e19b672e886738856bb9ea1bae60b8cdd97a6431a5a49e37ff112e3179e6e" architecture="amd64") util.go:497: Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas) util.go:497: EtcdAvailable=True: QuorumAvailable util.go:497: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:497: InfrastructureReady=True: AsExpected(All is well) util.go:497: ExternalDNSReachable=True: AsExpected(All is well) util.go:497: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:497: ValidReleaseInfo=True: AsExpected(All is well) util.go:497: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:497: Available=True: AsExpected(The hosted control plane is available) util.go:497: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:497: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:497: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:497: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:497: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:497: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:497: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:497: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:497: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:497: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)

hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-psgdg/create-cluster-dzz8r in 1m37s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster create-cluster-dzz8r eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:1981: Failed to wait for HostedCluster e2e-clusters-psgdg/create-cluster-dzz8r to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-psgdg/create-cluster-dzz8r invalid at RV 31224 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: MultipleErrors(Unable to apply 4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest: an unknown error has occurred: MultipleErrors) eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators ingress, monitoring, openshift-samples are not available * Could not update imagestream "openshift/driver-toolkit" (451 of 642): the server is down or not responding * Could not update oauthclient "console" (382 of 642): the server does not recognize this resource, check extension API servers * Could not update role "openshift-console-operator/prometheus-k8s" (600 of 642): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (604 of 642): resource may have been deleted) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called

util.go:221: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-psgdg/create-cluster-dzz8r in 2m5.025s util.go:238: Successfully waited for kubeconfig secret to have data in 25ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dzz8r.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dzz8r.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dzz8r.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dzz8r.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dzz8r.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-dzz8r.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:284: Successfully waited for a successful connection to the guest API server in 1m15.55s util.go:465: Successfully waited for 2 nodes to become ready in 11m53.025s util.go:497: Failed to wait for HostedCluster e2e-clusters-psgdg/create-cluster-dzz8r to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-psgdg/create-cluster-dzz8r invalid at RV 31224 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:497: *v1beta1.HostedCluster e2e-clusters-psgdg/create-cluster-dzz8r conditions: util.go:497: ClusterVersionUpgradeable=False: UpdateInProgress(An update is already in progress and the details are in the Progressing condition) util.go:497: ClusterVersionAvailable=False: FromClusterVersion util.go:497: ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators ingress, monitoring, openshift-samples are not available * Could not update imagestream "openshift/driver-toolkit" (451 of 642): the server is down or not responding * Could not update oauthclient "console" (382 of 642): the server does not recognize this resource, check extension API servers * Could not update role "openshift-console-operator/prometheus-k8s" (600 of 642): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (604 of 642): resource may have been deleted) util.go:497: ClusterVersionProgressing=True: MultipleErrors(Unable to apply 4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest: an unknown error has occurred: MultipleErrors) util.go:497: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest" image="registry.build01.ci.openshift.org/ci-op-qvyk6zd9/release@sha256:7a2e19b672e886738856bb9ea1bae60b8cdd97a6431a5a49e37ff112e3179e6e" architecture="amd64") util.go:497: Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas) util.go:497: EtcdAvailable=True: QuorumAvailable util.go:497: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:497: InfrastructureReady=True: AsExpected(All is well) util.go:497: ExternalDNSReachable=True: AsExpected(All is well) util.go:497: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:497: ValidReleaseInfo=True: AsExpected(All is well) util.go:497: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:497: Available=True: AsExpected(The hosted control plane is available) util.go:497: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:497: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:497: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:497: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:497: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:497: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:497: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:497: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:497: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:497: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)

hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-qjsd4/create-cluster-v2-bbsz4 in 1m50s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster create-cluster-v2-bbsz4 util.go:1981: Failed to wait for HostedCluster e2e-clusters-qjsd4/create-cluster-v2-bbsz4 to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-qjsd4/create-cluster-v2-bbsz4 invalid at RV 29839 after 2s: eventually.go:227: - incorrect condition: wanted ClusterVersionSucceeding=True, got ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators ingress, monitoring, openshift-samples are not available * Could not update imagestream "openshift/driver-toolkit" (451 of 642): the server is down or not responding * Could not update oauthclient "console" (382 of 642): the server does not recognize this resource, check extension API servers * Could not update role "openshift-console-operator/prometheus-k8s" (600 of 642): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (604 of 642): resource may have been deleted) eventually.go:227: - incorrect condition: wanted ClusterVersionProgressing=False, got ClusterVersionProgressing=True: MultipleErrors(Unable to apply 4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest: an unknown error has occurred: MultipleErrors) eventually.go:227: - incorrect condition: wanted ClusterVersionAvailable=True, got ClusterVersionAvailable=False: FromClusterVersion eventually.go:227: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called

util.go:221: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-qjsd4/create-cluster-v2-bbsz4 in 1m44.025s util.go:238: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-v2-bbsz4.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:284: Successfully waited for a successful connection to the guest API server in 16.375s util.go:465: Successfully waited for 2 nodes to become ready in 12m10.025s util.go:497: Failed to wait for HostedCluster e2e-clusters-qjsd4/create-cluster-v2-bbsz4 to rollout in 30m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-qjsd4/create-cluster-v2-bbsz4 invalid at RV 29839 after 30m0s: wanted most recent version history to have state Completed, has state Partial util.go:497: *v1beta1.HostedCluster e2e-clusters-qjsd4/create-cluster-v2-bbsz4 conditions: util.go:497: ClusterVersionSucceeding=False: MultipleErrors(Multiple errors are preventing progress: * Cluster operators ingress, monitoring, openshift-samples are not available * Could not update imagestream "openshift/driver-toolkit" (451 of 642): the server is down or not responding * Could not update oauthclient "console" (382 of 642): the server does not recognize this resource, check extension API servers * Could not update role "openshift-console-operator/prometheus-k8s" (600 of 642): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (604 of 642): resource may have been deleted) util.go:497: ClusterVersionProgressing=True: MultipleErrors(Unable to apply 4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest: an unknown error has occurred: MultipleErrors) util.go:497: ClusterVersionReleaseAccepted=True: PayloadLoaded(Payload loaded version="4.19.0-0.ci-2025-04-13-052643-test-ci-op-qvyk6zd9-latest" image="registry.build01.ci.openshift.org/ci-op-qvyk6zd9/release@sha256:7a2e19b672e886738856bb9ea1bae60b8cdd97a6431a5a49e37ff112e3179e6e" architecture="amd64") util.go:497: ClusterVersionUpgradeable=False: UpdateInProgress(An update is already in progress and the details are in the Progressing condition) util.go:497: ClusterVersionAvailable=False: FromClusterVersion util.go:497: Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas) util.go:497: EtcdAvailable=True: QuorumAvailable util.go:497: KubeAPIServerAvailable=True: AsExpected(Kube APIServer deployment is available) util.go:497: InfrastructureReady=True: AsExpected(All is well) util.go:497: ExternalDNSReachable=True: AsExpected(All is well) util.go:497: ValidHostedControlPlaneConfiguration=True: AsExpected(Configuration passes validation) util.go:497: ValidReleaseInfo=True: AsExpected(All is well) util.go:497: ValidIDPConfiguration=True: IDPConfigurationValid(Identity provider configuration is valid) util.go:497: Available=True: AsExpected(The hosted control plane is available) util.go:497: ValidConfiguration=True: AsExpected(Configuration passes validation) util.go:497: SupportedHostedCluster=True: AsExpected(HostedCluster is supported by operator configuration) util.go:497: IgnitionEndpointAvailable=True: AsExpected(Ignition server deployment is available) util.go:497: ReconciliationActive=True: AsExpected(Reconciliation active on resource) util.go:497: ValidReleaseImage=True: AsExpected(Release image is valid) util.go:497: Progressing=False: AsExpected(HostedCluster is at expected version) util.go:497: PlatformCredentialsFound=True: AsExpected(Required platform credentials are found) util.go:497: ClusterSizeComputed=True: small(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ClusterSizeTransitionPending=False: ClusterSizeTransitioned(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ClusterSizeTransitionRequired=False: AsExpected(The HostedCluster has transitioned to a new t-shirt size.) util.go:497: ReconciliationSucceeded=True: ReconciliatonSucceeded(Reconciliation completed successfully) util.go:497: ValidAzureKMSConfig=Unknown: StatusUnknown(Azure KMS is not configured) util.go:497: ClusterVersionRetrievedUpdates=False: NoChannel(The update channel has not been configured.)

util.go:221: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-fprl7/node-pool-hwzkp in 1m50.025s util.go:238: Successfully waited for kubeconfig secret to have data in 50ms eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-hwzkp.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout util.go:284: Successfully waited for a successful connection to the guest API server in 23.175s util.go:465: Successfully waited for 0 nodes to become ready in 25ms eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:1981: Failed to wait for HostedCluster e2e-clusters-fprl7/node-pool-hwzkp to have valid conditions in 10m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-fprl7/node-pool-hwzkp invalid at RV 21143 after 10m0s: incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas)

hypershift_framework.go:316: Successfully created hostedcluster e2e-clusters-4rj7t/node-pool-v5ffm in 1m51s hypershift_framework.go:115: Summarizing unexpected conditions for HostedCluster node-pool-v5ffm eventually.go:104: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:1981: Failed to wait for HostedCluster e2e-clusters-4rj7t/node-pool-v5ffm to have valid conditions in 2s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-4rj7t/node-pool-v5ffm invalid at RV 21415 after 2s: incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas) hypershift_framework.go:194: skipping postTeardown() hypershift_framework.go:175: skipping teardown, already called

util.go:221: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-4rj7t/node-pool-v5ffm in 2m1.025s util.go:238: Successfully waited for kubeconfig secret to have data in 0s eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-v5ffm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-v5ffm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-v5ffm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": net/http: TLS handshake timeout eventually.go:104: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-v5ffm.aks-e2e.hypershift.azure.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": EOF util.go:284: Successfully waited for a successful connection to the guest API server in 1m6.825s util.go:465: Successfully waited for 0 nodes to become ready in 50ms util.go:1981: Failed to wait for HostedCluster e2e-clusters-4rj7t/node-pool-v5ffm to have valid conditions in 10m0s: context deadline exceeded eventually.go:224: observed *v1beta1.HostedCluster e2e-clusters-4rj7t/node-pool-v5ffm invalid at RV 21415 after 10m0s: incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(ingress-operator deployment has 1 unavailable replicas)