PR #8902 - 07-06 07:58

Job: hypershift
FAILURE
← Back to Test Grid

Test Summary

219
Total Tests
164
Passed
35
Failed
20
Skipped

Failed Tests

TestAutoscaling
34m23.59s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-f56n7/autoscaling-8dm4l in 33s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster autoscaling-8dm4l util.go:3158: Successfully waited for HostedCluster e2e-clusters-f56n7/autoscaling-8dm4l to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestAutoscaling/ValidateHostedCluster
25m50.55s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-f56n7/autoscaling-8dm4l in 2m0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-8dm4l.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-autoscaling-8dm4l.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-8dm4l.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 32.196.82.129:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-autoscaling-8dm4l.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 100.52.132.88:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 1m45.2s util.go:583: Successfully waited for 1 nodes to become ready in 7m3s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f56n7/hostedclusters/autoscaling-8dm4l?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f56n7/hostedclusters/autoscaling-8dm4l?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f56n7/hostedclusters/autoscaling-8dm4l?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f56n7/hostedclusters/autoscaling-8dm4l?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f56n7/hostedclusters/autoscaling-8dm4l?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f56n7/hostedclusters/autoscaling-8dm4l?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-f56n7/hostedclusters/autoscaling-8dm4l?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-f56n7/autoscaling-8dm4l to rollout in 14m57s util.go:3158: Successfully waited for HostedCluster e2e-clusters-f56n7/autoscaling-8dm4l to have valid conditions in 0s
TestAutoscaling/ValidateHostedCluster/EnsureNoCrashingPods
90ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-c7784c4fb-spv82 has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-6f64798f84-mnr8h has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-754966898f-p84nh has a restartCount > 0 (5) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-5dbb8c58f4-t8rrf has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-59dcd554d-vhhwj has a restartCount > 0 (6) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-7567b76bf6-prtwc has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-7b54747c66-dsbbp has a restartCount > 0 (6)
TestCreateCluster
34m1.26s
create_cluster_test.go:47: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-g827c/create-cluster-tjlj5 in 30s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster create-cluster-tjlj5 util.go:3158: Successfully waited for HostedCluster e2e-clusters-g827c/create-cluster-tjlj5 to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateCluster/ValidateHostedCluster
25m14.49s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-g827c/create-cluster-tjlj5 in 1m30s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-tjlj5.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-create-cluster-tjlj5.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-tjlj5.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 34.198.181.91:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-create-cluster-tjlj5.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 75.101.198.110:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m9.15s util.go:583: Successfully waited for 3 nodes to become ready in 11m6s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-g827c/hostedclusters/create-cluster-tjlj5?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-g827c/create-cluster-tjlj5 to rollout in 10m24s util.go:3158: Successfully waited for HostedCluster e2e-clusters-g827c/create-cluster-tjlj5 to have valid conditions in 0s
TestCreateCluster/ValidateHostedCluster/EnsureNoCrashingPods
90ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-58d97d765f-6t7fk has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-68866fd854-99x5g has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-f6ddfccb7-r7zkc has a restartCount > 0 (4) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-58684f4bd6-dkk6s has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-8f4bc4754-hz96z has a restartCount > 0 (6) util.go:826: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-77c84d6f8c-jgw78 util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-bbfddbd9d-qj2hx has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-6bff777b9c-6wm69 has a restartCount > 0 (6)
TestCreateClusterCustomConfig
34m22.48s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-zckk5/custom-config-g8qvs in 17s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster custom-config-g8qvs util.go:3158: Successfully waited for HostedCluster e2e-clusters-zckk5/custom-config-g8qvs to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterCustomConfig/ValidateHostedCluster
25m50.36s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-zckk5/custom-config-g8qvs in 1m0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-g8qvs.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-custom-config-g8qvs.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-g8qvs.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.88.77.94:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-custom-config-g8qvs.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 34.233.106.95:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m3.05s util.go:583: Successfully waited for 2 nodes to become ready in 9m6s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-zckk5/hostedclusters/custom-config-g8qvs?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-zckk5/custom-config-g8qvs to rollout in 13m36s util.go:3158: Successfully waited for HostedCluster e2e-clusters-zckk5/custom-config-g8qvs to have valid conditions in 0s
TestCreateClusterCustomConfig/ValidateHostedCluster/EnsureNoCrashingPods
90ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-75c649b676-rr8l6 has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-67745bdfb5-47c8j has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-78fb998b88-q95c8 has a restartCount > 0 (4) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-5dd8cb9fdd-9l2sb has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-5b6f8c7844-2vv4n has a restartCount > 0 (6) util.go:826: Leader election failure detected in container control-plane-pki-operator in pod control-plane-pki-operator-7f58bf684f-2xprb util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-6655cb478-84nkd has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-6cc855bccf-z6p8s has a restartCount > 0 (6)
TestCreateClusterHABreakGlassCredentials
29m41.1s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-kkpvj/ha-break-glass-creds-8g8vm in 27s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster ha-break-glass-creds-8g8vm util.go:3158: Failed to wait for HostedCluster e2e-clusters-kkpvj/ha-break-glass-creds-8g8vm to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-kkpvj/ha-break-glass-creds-8g8vm invalid at RV 98413 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: redhat-operators-catalog, community-operators-catalog, redhat-marketplace-catalog, certified-operators-catalog) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([certified-operators-catalog deployment has 2 unavailable replicas, community-operators-catalog deployment has 2 unavailable replicas, redhat-marketplace-catalog deployment has 2 unavailable replicas, redhat-operators-catalog deployment has 2 unavailable replicas]) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterHABreakGlassCredentials/ValidateHostedCluster
23m12.09s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-kkpvj/ha-break-glass-creds-8g8vm in 1m21s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-8g8vm.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-ha-break-glass-creds-8g8vm.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-ha-break-glass-creds-8g8vm.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 52.202.231.210:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 1m51.05s util.go:583: Successfully waited for 0 nodes to become ready in 25ms eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-kkpvj/hostedclusters/ha-break-glass-creds-8g8vm?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline util.go:3158: Failed to wait for HostedCluster e2e-clusters-kkpvj/ha-break-glass-creds-8g8vm to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-kkpvj/ha-break-glass-creds-8g8vm invalid at RV 98413 after 20m0s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: redhat-operators-catalog, community-operators-catalog, redhat-marketplace-catalog, certified-operators-catalog) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([certified-operators-catalog deployment has 2 unavailable replicas, community-operators-catalog deployment has 2 unavailable replicas, redhat-marketplace-catalog deployment has 2 unavailable replicas, redhat-operators-catalog deployment has 2 unavailable replicas]) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
TestCreateClusterPrivate
48m45.43s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-z9xqr/private-p8fb4 in 17s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster private-p8fb4 util.go:3158: Successfully waited for HostedCluster e2e-clusters-z9xqr/private-p8fb4 to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterPrivate/ValidateHostedCluster
40m24.22s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-z9xqr/private-p8fb4 in 1m0s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:744: Successfully waited for NodePools for HostedCluster e2e-clusters-z9xqr/private-p8fb4 to have all of their desired nodes in 12m0s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-z9xqr/hostedclusters/private-p8fb4?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout util.go:620: Successfully waited for HostedCluster e2e-clusters-z9xqr/private-p8fb4 to rollout in 22m57s util.go:3158: Successfully waited for HostedCluster e2e-clusters-z9xqr/private-p8fb4 to have valid conditions in 4m27s
TestCreateClusterPrivate/ValidateHostedCluster/EnsureNoCrashingPods
80ms
util.go:829: Container manager in pod capi-provider-c5cbfd555-8f7sh has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-7cb469854d-sjxtg has a restartCount > 0 (4) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-5db7878fc6-rctkc has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-86cb587f96-rd5wp has a restartCount > 0 (6) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-5fdf8ff86b-lcsk4 has a restartCount > 0 (3)
TestCreateClusterPrivateWithRouteKAS
34m3.88s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-86qnn/private-7p7cs in 33s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster private-7p7cs util.go:3158: Successfully waited for HostedCluster e2e-clusters-86qnn/private-7p7cs to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterPrivateWithRouteKAS/ValidateHostedCluster
25m27.22s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-86qnn/private-7p7cs in 1m45s util.go:322: Successfully waited for kubeconfig secret to have data in 0s util.go:744: Successfully waited for NodePools for HostedCluster e2e-clusters-86qnn/private-7p7cs to have all of their desired nodes in 12m45s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-86qnn/hostedclusters/private-7p7cs?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-86qnn/private-7p7cs to rollout in 10m57s util.go:3158: Successfully waited for HostedCluster e2e-clusters-86qnn/private-7p7cs to have valid conditions in 0s
TestCreateClusterPrivateWithRouteKAS/ValidateHostedCluster/EnsureNoCrashingPods
60ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-84b86fc47f-zrg84 has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-5775d8d697-27nqn has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-5bf977fc6b-g59ff has a restartCount > 0 (4) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-75b467d568-7mbhp has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-7bf647d759-8t9wp has a restartCount > 0 (6) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-5cb7585556-vh4rx has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-7c79dbdddd-kscjj has a restartCount > 0 (6)
TestCreateClusterProxy
1h24m54.51s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-jckjn/proxy-ssw4m in 26s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster proxy-ssw4m util.go:3158: Successfully waited for HostedCluster e2e-clusters-jckjn/proxy-ssw4m to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterProxy/ValidateHostedCluster
32m15.42s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-jckjn/proxy-ssw4m in 1m3.025s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-proxy-ssw4m.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-proxy-ssw4m.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-proxy-ssw4m.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 44.206.37.158:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-proxy-ssw4m.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 52.70.144.100:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m28.15s util.go:583: Successfully waited for 2 nodes to become ready in 8m57s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jckjn/hostedclusters/proxy-ssw4m?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jckjn/hostedclusters/proxy-ssw4m?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jckjn/hostedclusters/proxy-ssw4m?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jckjn/hostedclusters/proxy-ssw4m?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jckjn/hostedclusters/proxy-ssw4m?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jckjn/hostedclusters/proxy-ssw4m?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-jckjn/hostedclusters/proxy-ssw4m?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-jckjn/proxy-ssw4m to rollout in 19m42s util.go:3158: Successfully waited for HostedCluster e2e-clusters-jckjn/proxy-ssw4m to have valid conditions in 0s
TestCreateClusterProxy/ValidateHostedCluster/EnsureNoCrashingPods
60ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-67b7778995-gww7x has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-6f8f986c4b-b2f9s has a restartCount > 0 (5) util.go:829: Container manager in pod cluster-api-fd8dfb4fd-8nkgh has a restartCount > 0 (5) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-dcd845f9b-shnc2 has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-5556896dd4-z8jm2 has a restartCount > 0 (6) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-69d566cf84-j9vhm has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-69979dbc9-924dq has a restartCount > 0 (6)
TestCreateClusterRequestServingIsolation
34m43.71s
requestserving.go:105: Created request serving nodepool clusters/4b97394b92-mgmt-reqserving-r55rt requestserving.go:105: Created request serving nodepool clusters/4b97394b92-mgmt-reqserving-zvngs requestserving.go:113: Created non request serving nodepool clusters/4b97394b92-mgmt-non-reqserving-7vhkx requestserving.go:113: Created non request serving nodepool clusters/4b97394b92-mgmt-non-reqserving-9dcnv requestserving.go:113: Created non request serving nodepool clusters/4b97394b92-mgmt-non-reqserving-rbqk7 util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/4b97394b92-mgmt-reqserving-r55rt in 4m18s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/4b97394b92-mgmt-reqserving-zvngs in 6s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/4b97394b92-mgmt-non-reqserving-7vhkx in 39s util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/4b97394b92-mgmt-non-reqserving-9dcnv in 100ms util.go:583: Successfully waited for 1 nodes to become ready for NodePool clusters/4b97394b92-mgmt-non-reqserving-rbqk7 in 24s create_cluster_test.go:299: Sufficient zones available for InfrastructureAvailabilityPolicy HighlyAvailable hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-q8ngs/request-serving-isolation-b29j5 in 13s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster request-serving-isolation-b29j5 util.go:3158: Failed to wait for HostedCluster e2e-clusters-q8ngs/request-serving-isolation-b29j5 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-q8ngs/request-serving-isolation-b29j5 invalid at RV 107405 after 2s: incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas([kube-controller-manager deployment has 1 unavailable replicas, openshift-apiserver deployment has 1 unavailable replicas]) hypershift_framework.go:349: skipping postTeardown() requestserving.go:132: Tearing down custom nodepool clusters/4b97394b92-mgmt-reqserving-r55rt requestserving.go:132: Tearing down custom nodepool clusters/4b97394b92-mgmt-reqserving-zvngs requestserving.go:132: Tearing down custom nodepool clusters/4b97394b92-mgmt-non-reqserving-7vhkx requestserving.go:132: Tearing down custom nodepool clusters/4b97394b92-mgmt-non-reqserving-9dcnv requestserving.go:132: Tearing down custom nodepool clusters/4b97394b92-mgmt-non-reqserving-rbqk7 hypershift_framework.go:327: skipping teardown, already called
TestCreateClusterRequestServingIsolation/ValidateHostedCluster
20m7.31s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-q8ngs/request-serving-isolation-b29j5 in 54s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-request-serving-isolation-b29j5.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-request-serving-isolation-b29j5.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-request-serving-isolation-b29j5.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 32.196.12.85:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m5.025s util.go:583: Successfully waited for 3 nodes to become ready in 9m9s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-q8ngs/hostedclusters/request-serving-isolation-b29j5?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-q8ngs/hostedclusters/request-serving-isolation-b29j5?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-q8ngs/hostedclusters/request-serving-isolation-b29j5?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-q8ngs/hostedclusters/request-serving-isolation-b29j5?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-q8ngs/hostedclusters/request-serving-isolation-b29j5?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-q8ngs/hostedclusters/request-serving-isolation-b29j5?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-q8ngs/hostedclusters/request-serving-isolation-b29j5?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-q8ngs/request-serving-isolation-b29j5 to rollout in 7m51s util.go:3158: Successfully waited for HostedCluster e2e-clusters-q8ngs/request-serving-isolation-b29j5 to have valid conditions in 3s
TestCreateClusterRequestServingIsolation/ValidateHostedCluster/EnsureNoCrashingPods
70ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-7c78dfbd9f-pgk6f has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-5dd79c564f-7hw5w has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-6655c7688d-hkmfj has a restartCount > 0 (5) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-5646db59cc-624bk has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-656dcc5ccd-dxwft has a restartCount > 0 (6) util.go:829: Container control-plane-pki-operator in pod control-plane-pki-operator-6bc9b67997-cbld9 has a restartCount > 0 (3) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-5bc8556bc5-9mvnq has a restartCount > 0 (2) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-55b57cc6fc-hv292 has a restartCount > 0 (6)
TestKarpenter
37m36.36s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-tn7ww/karpenter-rznx2 in 22s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-rznx2 util.go:3158: Successfully waited for HostedCluster e2e-clusters-tn7ww/karpenter-rznx2 to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestKarpenter/ValidateHostedCluster
28m46.38s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tn7ww/karpenter-rznx2 in 57s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-rznx2.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-karpenter-rznx2.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-rznx2.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 54.173.58.218:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-rznx2.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.221.129.168:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m38.05s util.go:583: Successfully waited for 2 nodes to become ready in 10m33.025s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tn7ww/hostedclusters/karpenter-rznx2?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-tn7ww/karpenter-rznx2 to rollout in 14m33s util.go:3158: Successfully waited for HostedCluster e2e-clusters-tn7ww/karpenter-rznx2 to have valid conditions in 0s
TestKarpenter/ValidateHostedCluster/EnsureNoCrashingPods
70ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-6797fddc76-dhflb has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-64df6c47d6-rdjz9 has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-74fcb56479-6ds6l has a restartCount > 0 (4) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-88fbd44d8-bgnrk has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-5977455446-lpq29 has a restartCount > 0 (6) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-84f6bcf78b-bzfq9 has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-587f9cc8f8-j6xww has a restartCount > 0 (6)
TestKarpenterUpgradeControlPlane
41m56.33s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-qc29v/karpenter-upgrade-control-plane-4bvsv in 26s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster karpenter-upgrade-control-plane-4bvsv util.go:3158: Successfully waited for HostedCluster e2e-clusters-qc29v/karpenter-upgrade-control-plane-4bvsv to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestKarpenterUpgradeControlPlane/ValidateHostedCluster
32m21.58s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-qc29v/karpenter-upgrade-control-plane-4bvsv in 1m33s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-upgrade-control-plane-4bvsv.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-karpenter-upgrade-control-plane-4bvsv.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-karpenter-upgrade-control-plane-4bvsv.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.227.69.244:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m1.175s util.go:583: Successfully waited for 2 nodes to become ready in 11m57s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-qc29v/hostedclusters/karpenter-upgrade-control-plane-4bvsv?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused util.go:620: Successfully waited for HostedCluster e2e-clusters-qc29v/karpenter-upgrade-control-plane-4bvsv to rollout in 16m45s util.go:3158: Successfully waited for HostedCluster e2e-clusters-qc29v/karpenter-upgrade-control-plane-4bvsv to have valid conditions in 0s
TestKarpenterUpgradeControlPlane/ValidateHostedCluster/EnsureNoCrashingPods
130ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-7cd59c7d7d-tqtcs has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-5cd4469897-vnqfb has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-56bd9b7c6f-sq7ms has a restartCount > 0 (5) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-67f967d45-kh7b7 has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-c7666454b-7528p has a restartCount > 0 (6) util.go:829: Container control-plane-pki-operator in pod control-plane-pki-operator-5fdbff76d4-5tktr has a restartCount > 0 (3) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-6fd66f8696-4jrpv has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-7ff5b9c664-4xjgv has a restartCount > 0 (6)
TestNodePool
0s
TestNodePool/HostedCluster0
29m44.25s
hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-4k7lv/node-pool-r8rk7 in 49s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster node-pool-r8rk7 util.go:3158: Failed to wait for HostedCluster e2e-clusters-4k7lv/node-pool-r8rk7 to have valid conditions in 2s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-4k7lv/node-pool-r8rk7 invalid at RV 62289 after 2s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: redhat-marketplace-catalog) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(redhat-marketplace-catalog deployment has 2 unavailable replicas) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestNodePool/HostedCluster0/ValidateHostedCluster
23m43.11s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-4k7lv/node-pool-r8rk7 in 1m36s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-r8rk7.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-node-pool-r8rk7.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-r8rk7.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.234.148.10:443: i/o timeout eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-node-pool-r8rk7.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 44.215.0.152:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m7.075s util.go:583: Successfully waited for 0 nodes to become ready in 25ms eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-4k7lv/hostedclusters/node-pool-r8rk7?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: client rate limiter Wait returned an error: context deadline exceeded util.go:3158: Failed to wait for HostedCluster e2e-clusters-4k7lv/node-pool-r8rk7 to have valid conditions in 20m0s: context deadline exceeded eventually.go:225: observed *v1beta1.HostedCluster e2e-clusters-4k7lv/node-pool-r8rk7 invalid at RV 62289 after 20m0s: eventually.go:228: - incorrect condition: wanted Available=True, got Available=False: ComponentsNotAvailable(Waiting for components to be available: redhat-marketplace-catalog) eventually.go:228: - incorrect condition: wanted Degraded=False, got Degraded=True: UnavailableReplicas(redhat-marketplace-catalog deployment has 2 unavailable replicas) eventually.go:228: - controlPlaneVersion state is Partial, expected Completed
TestUpgradeControlPlane
36m52.74s
control_plane_upgrade_test.go:25: Starting control plane upgrade test. FromImage: registry.build01.ci.openshift.org/ci-op-63whq2ky/release@sha256:f21e013ef6155a8bffcc3e012e7b083345e443d26bdfd6df00ef0528c6cb1348, toImage: registry.build01.ci.openshift.org/ci-op-63whq2ky/release@sha256:ec4a9feda161221c15a5cb95ca56179648d25ea33ac0c249b1fd0f7aeb9ca712 hypershift_framework.go:530: Successfully created hostedcluster e2e-clusters-tq5r2/control-plane-upgrade-kt7lj in 14s hypershift_framework.go:179: Summarizing unexpected conditions for HostedCluster control-plane-upgrade-kt7lj util.go:3158: Successfully waited for HostedCluster e2e-clusters-tq5r2/control-plane-upgrade-kt7lj to have valid conditions in 0s hypershift_framework.go:349: skipping postTeardown() hypershift_framework.go:327: skipping teardown, already called
TestUpgradeControlPlane/ValidateHostedCluster
27m54.46s
util.go:305: Successfully waited for kubeconfig to be published for HostedCluster e2e-clusters-tq5r2/control-plane-upgrade-kt7lj in 1m24s util.go:322: Successfully waited for kubeconfig secret to have data in 0s eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-kt7lj.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp: lookup api-control-plane-upgrade-kt7lj.service.ci.hypershift.devcluster.openshift.com on 172.30.0.10:53: no such host eventually.go:105: Failed to get *v1.SelfSubjectReview: Post "https://api-control-plane-upgrade-kt7lj.service.ci.hypershift.devcluster.openshift.com:443/apis/authentication.k8s.io/v1/selfsubjectreviews": dial tcp 3.216.195.122:443: i/o timeout util.go:384: Successfully waited for a successful connection to the guest API server in 2m4.125s util.go:583: Successfully waited for 2 nodes to become ready in 12m9s eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": net/http: TLS handshake timeout - error from a previous attempt: http2: client connection lost eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": net/http: TLS handshake timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": dial tcp 98.82.106.151:6443: connect: connection refused eventually.go:105: Failed to get *v1beta1.HostedCluster: Get "https://adb1369d9dc22485c9158fc019c346b9-3aad56ff18ab82eb.elb.us-east-1.amazonaws.com:6443/apis/hypershift.openshift.io/v1beta1/namespaces/e2e-clusters-tq5r2/hostedclusters/control-plane-upgrade-kt7lj?timeout=5m0s": dial tcp 98.82.106.151:6443: i/o timeout util.go:620: Successfully waited for HostedCluster e2e-clusters-tq5r2/control-plane-upgrade-kt7lj to rollout in 9m57s util.go:3158: Successfully waited for HostedCluster e2e-clusters-tq5r2/control-plane-upgrade-kt7lj to have valid conditions in 2m15s
TestUpgradeControlPlane/ValidateHostedCluster/EnsureNoCrashingPods
110ms
util.go:829: Container aws-ebs-csi-driver-operator in pod aws-ebs-csi-driver-operator-76479c7689-28js4 has a restartCount > 0 (3) util.go:829: Container manager in pod capi-provider-b98b9f788-r9t2l has a restartCount > 0 (6) util.go:829: Container manager in pod cluster-api-cb8bd8f4b-f9d4m has a restartCount > 0 (4) util.go:829: Container cluster-storage-operator in pod cluster-storage-operator-6675876845-pgrwt has a restartCount > 0 (3) util.go:829: Container control-plane-operator in pod control-plane-operator-7744c4ff6d-trk7g has a restartCount > 0 (6) util.go:829: Container control-plane-pki-operator in pod control-plane-pki-operator-5648bdc9cb-lcpvx has a restartCount > 0 (3) util.go:829: Container csi-snapshot-controller-operator in pod csi-snapshot-controller-operator-589b567cfb-kpzgh has a restartCount > 0 (3) util.go:829: Container hosted-cluster-config-operator in pod hosted-cluster-config-operator-77648455fc-sz2hb has a restartCount > 0 (6)