TASK [helm : Install chart ingress-nginx] Sandbox V2

Hi all, I am installing Mosip sandbox v2 in a test environment but I can’t install the Ingress-nginx in the task [helm: Install chart ingress-nginx].

TASK [helm : Install chart ingress-nginx]
fatal: [console.sb]: FAILED! => {“changed”: true, “cmd”: “/home/mosipuser/bin/helm --kubeconfig /home/mosipuser/.kube/mzcluster.config install ingress-nginx /home/mosipuser/mosip-infra/deployment/sandbox-v2/helm/charts/ingress-nginx -f /home/mosipuser/mosip-infra/deployment/sandbox-v2/helm/charts/ingress-nginx/values.yaml -n ingress-nginx --create-namespace --set-string dummy=value, --wait --timeout 20m0s --debug > /home/mosipuser/mosip-infra/deployment/sandbox-v2/tmp/yaml/ingress-nginx.yaml”, “delta”: “0:20:00.486514”, “end”: “2022-11-23 02:35:49.053846”, “msg”: “non-zero return code”, “rc”: 1, “start”: “2022-11-23 02:15:48.567332”, “stderr”: "install.go:159: [debug] Original chart version: ""\ninstall.go:176: [debug] CHART PATH: /home/mosipuser/mosip-infra/deployment/sandbox-v2/helm/charts/ingress-nginx\n\nclient.go:108: [debug] creating 1 resource(s)\nclient.go:108: [debug] creating 10 resource(s)\nwait.go:53: [debug] beginning wait for 10 resources with timeout of 20m0s\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready\nwait.go:225: [debug] Deployment is not ready: ingress-nginx/nginx-ingress-controller. 0 out of 1 expected pods are ready.

here is all information of my cluster:

[mosipuser@console sandbox-v2]$ kubectl get nodes
NAME STATUS ROLES AGE VERSION
mzmaster.sb Ready control-plane 24h v1.25.4
mzworker0.sb Ready 23h v1.25.4
mzworker1.sb Ready 23h v1.25.4
mzworker2.sb Ready 23h v1.25.4

[mosipuser@console sandbox-v2]$ kubectl get pods --all-namespaces
NAMESPACE NAME READY STATUS RESTARTS AGE
default healthcheck-app-78d4f9794c-8mmvm 1/1 Running 0 52m
ingress-nginx nginx-ingress-controller-5d587788c-pk8rh 0/1 CrashLoopBackOff 9 (45s ago) 17m
kube-flannel kube-flannel-ds-jqq55 1/1 Running 4 (47m ago) 23h
kube-flannel kube-flannel-ds-kgzj2 1/1 Running 1 (57m ago) 23h
kube-flannel kube-flannel-ds-kpqlm 1/1 Running 2 (44m ago) 23h
kube-flannel kube-flannel-ds-rz2gj 1/1 Running 1 (96m ago) 24h
kube-system coredns-565d847f94-vrm8z 1/1 Running 1 (96m ago) 24h
kube-system coredns-565d847f94-ws7sr 1/1 Running 1 (96m ago) 24h
kube-system etcd-mzmaster.sb 1/1 Running 1 (96m ago) 24h
kube-system kube-apiserver-mzmaster.sb 1/1 Running 1 (96m ago) 24h
kube-system kube-controller-manager-mzmaster.sb 1/1 Running 1 (96m ago) 24h
kube-system kube-proxy-dsq26 1/1 Running 2 (47m ago) 23h
kube-system kube-proxy-gkc2d 1/1 Running 1 (96m ago) 24h
kube-system kube-proxy-mm8c2 1/1 Running 1 (57m ago) 23h
kube-system kube-proxy-rn2h5 1/1 Running 2 (44m ago) 23h
kube-system kube-scheduler-mzmaster.sb 1/1 Running 1 (96m ago) 24h

[mosipuser@console sandbox-v2]$ kubectl logs nginx-ingress-controller-5d587788c-pk8rh -n ingress-nginx

NGINX Ingress controller
Release: 0.30.0
Build: git-7e65b90c4
Repository: GitHub - kubernetes/ingress-nginx: Ingress-NGINX Controller for Kubernetes
nginx version: nginx/1.17.8


W1124 16:20:24.824656 7 flags.go:260] SSL certificate chain completion is disabled (–enable-ssl-chain-completion=false)
W1124 16:20:24.824721 7 client_config.go:543] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
I1124 16:20:24.824873 7 main.go:193] Creating API client for https://10.96.0.1:443
I1124 16:20:24.830782 7 main.go:237] Running in Kubernetes cluster version v1.25 (v1.25.4) - git (clean) commit 872a965c6c6526caa949f0c6ac028ef7aff3fb78 - platform linux/amd64
I1124 16:20:24.900344 7 main.go:102] SSL fake certificate created /etc/ingress-controller/ssl/default-fake-certificate.pem
I1124 16:20:24.939632 7 nginx.go:263] Starting NGINX Ingress controller
I1124 16:20:24.944030 7 event.go:281] Event(v1.ObjectReference{Kind:“ConfigMap”, Namespace:“ingress-nginx”, Name:“udp-services”, UID:“94d0544c-5fa1-4860-9612-29598a0d3cdd”, APIVersion:“v1”, ResourceVersion:“125182”, FieldPath:“”}): type: ‘Normal’ reason: ‘CREATE’ ConfigMap ingress-nginx/udp-services
I1124 16:20:24.945610 7 event.go:281] Event(v1.ObjectReference{Kind:“ConfigMap”, Namespace:“ingress-nginx”, Name:“nginx-configuration”, UID:“ef19ce9e-0a7c-4980-a084-5f1fa4fe134a”, APIVersion:“v1”, ResourceVersion:“125184”, FieldPath:“”}): type: ‘Normal’ reason: ‘CREATE’ ConfigMap ingress-nginx/nginx-configuration
I1124 16:20:24.948455 7 event.go:281] Event(v1.ObjectReference{Kind:“ConfigMap”, Namespace:“ingress-nginx”, Name:“tcp-services”, UID:“0b9f4a16-f3d6-4dd6-9f52-afe3cc961a20”, APIVersion:“v1”, ResourceVersion:“125183”, FieldPath:“”}): type: ‘Normal’ reason: ‘CREATE’ ConfigMap ingress-nginx/tcp-services
E1124 16:20:26.041613 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:27.043237 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:28.044907 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:29.046336 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:30.047776 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:31.049338 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:32.050961 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:33.052306 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:34.054154 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:35.055863 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:36.057182 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:37.058826 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:38.060101 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:39.061582 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:40.062939 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:41.064337 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:42.065741 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:43.067264 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:44.068553 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:45.070203 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:46.072033 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:47.073427 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:48.074788 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:49.076151 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:50.077558 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:51.079065 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:52.080462 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:53.081914 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
E1124 16:20:54.083691 7 reflector.go:153] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:181: Failed to list *v1beta1.Ingress: the server could not find the requested resource
I1124 16:20:54.643843 7 main.go:152] Received SIGTERM, shutting down
I1124 16:20:54.643888 7 nginx.go:391] Shutting down controller queues
I1124 16:20:54.643930 7 status.go:117] updating status of Ingress rules (remove)
E1124 16:20:54.644272 7 store.go:185] timed out waiting for caches to sync
I1124 16:20:54.644475 7 nginx.go:307] Starting NGINX process
I1124 16:20:54.644618 7 leaderelection.go:242] attempting to acquire leader lease ingress-nginx/ingress-controller-leader-nginx…
E1124 16:20:54.644893 7 queue.go:78] queue has been shutdown, failed to enqueue: &ObjectMeta{Name:initial-sync,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:OwnerReference{},Finalizers:,ClusterName:,ManagedFields:ManagedFieldsEntry{},}
I1124 16:20:54.647415 7 status.go:86] new leader elected: nginx-ingress-controller-5d587788c-r6tww
I1124 16:20:54.649231 7 status.go:136] removing address from ingress status ([10.108.189.202])
I1124 16:20:54.649275 7 nginx.go:407] Stopping NGINX process
2022/11/24 16:20:54 [notice] 42#42: signal process started
2022/11/24 16:20:54 [error] 42#42: open() “/tmp/nginx.pid” failed (2: No such file or directory)
nginx: [error] open() “/tmp/nginx.pid” failed (2: No such file or directory)
I1124 16:20:54.654289 7 main.go:156] Error during shutdown: exit status 1
I1124 16:20:54.654300 7 main.go:160] Handled quit, awaiting Pod deletion
I1124 16:21:04.654490 7 main.go:163] Exiting with 1

[mosipuser@console sandbox-v2]$ nginx -V
nginx version: nginx/1.20.1
built by gcc 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC)
built with OpenSSL 1.1.1k FIPS 25 Mar 2021
TLS SNI support enabled
configure arguments: --prefix=/usr/share/nginx --sbin-path=/usr/sbin/nginx --modules-path=/usr/lib64/nginx/modules --conf-path=/etc/nginx/nginx.conf --error-log-path=/var/log/nginx/error.log --http-log-path=/var/log/nginx/access.log --http-client-body-temp-path=/var/lib/nginx/tmp/client_body --http-proxy-temp-path=/var/lib/nginx/tmp/proxy --http-fastcgi-temp-path=/var/lib/nginx/tmp/fastcgi --http-uwsgi-temp-path=/var/lib/nginx/tmp/uwsgi --http-scgi-temp-path=/var/lib/nginx/tmp/scgi --pid-path=/run/nginx.pid --lock-path=/run/lock/subsys/nginx --user=nginx --group=nginx --with-compat --with-debug --with-file-aio --with-google_perftools_module --with-http_addition_module --with-http_auth_request_module --with-http_dav_module --with-http_degradation_module --with-http_flv_module --with-http_gunzip_module --with-http_gzip_static_module --with-http_image_filter_module=dynamic --with-http_mp4_module --with-http_perl_module=dynamic --with-http_random_index_module --with-http_realip_module --with-http_secure_link_module --with-http_slice_module --with-http_ssl_module --with-http_stub_status_module --with-http_sub_module --with-http_v2_module --with-http_xslt_module=dynamic --with-mail=dynamic --with-mail_ssl_module --with-pcre --with-pcre-jit --with-stream=dynamic --with-stream_ssl_module --with-stream_ssl_preread_module --with-threads --with-cc-opt=‘-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -m64 -mtune=generic’ --with-ld-opt=‘-Wl,-z,relro -specs=/usr/lib/rpm/redhat/redhat-hardened-ld -Wl,-E’

[mosipuser@console sandbox-v2]$ kubectl get nodes -o wide
NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
mzmaster.sb Ready control-plane 24h v1.25.4 10.200.82.147 CentOS Linux 7 (Core) 3.10.0-1160.76.1.el7.x86_64 containerd://1.6.10
mzworker0.sb Ready 23h v1.25.4 10.200.82.172 CentOS Linux 7 (Core) 3.10.0-1160.76.1.el7.x86_64 containerd://1.6.10
mzworker1.sb Ready 23h v1.25.4 10.200.82.137 CentOS Linux 7 (Core) 3.10.0-1160.76.1.el7.x86_64 containerd://1.6.10
mzworker2.sb Ready 23h v1.25.4 10.200.82.159 CentOS Linux 7 (Core) 3.10.0-1160.80.1.el7.x86_64 containerd://1.6.10

[mosipuser@console sandbox-v2]$ kubectl get svc
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
healthcheck-app-service LoadBalancer 10.108.246.142 80:30081/TCP 22h
kubernetes ClusterIP 10.96.0.1 443/TCP 24h

[mosipuser@console sandbox-v2]$ kubectl version
WARNING: This version information is deprecated and will be replaced with the output from kubectl version --short. Use --output=yaml|json to get the full version.
Client Version: version.Info{Major:“1”, Minor:“25”, GitVersion:“v1.25.4”, GitCommit:“872a965c6c6526caa949f0c6ac028ef7aff3fb78”, GitTreeState:“clean”, BuildDate:“2022-11-09T13:36:36Z”, GoVersion:“go1.19.3”, Compiler:“gc”, Platform:“linux/amd64”}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:“1”, Minor:“25”, GitVersion:“v1.25.4”, GitCommit:“872a965c6c6526caa949f0c6ac028ef7aff3fb78”, GitTreeState:“clean”, BuildDate:“2022-11-09T13:29:58Z”, GoVersion:“go1.19.3”, Compiler:“gc”, Platform:“linux/amd64”}

Thanks in advance for support.

1.2.0.1 and v2 will not work directly. Please use v3 installation instructions.