I’m deploying the mosip modules in the following order,
PreReg
during the deployment of “prereg,” the “prereg-application” application throws the following error: “KER-MSD-016 → Valid document not found.”
2023-08-01 10:01:05,059 [main] INFO [i.m.k.l.l.i.Slf4jLoggerImpl].info.32 : sessionId - idType - id - In applicationStartedEvent method of ApplicationEventListerner demographic Service setup() method is called
2023-08-01 10:01:05,089 [main] INFO [i.m.k.l.l.i.Slf4jLoggerImpl].info.57 : getAllDocCategoriesAndTypes url: http://masterdata.kernel/v1/masterdata/validdocuments/all?pageSize=50
2023-08-01 10:01:05,369 [main] INFO [o.s.b.a.l.ConditionEvaluationReportLoggingListener].logAutoConfigurationReport.101 :
Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
2023-08-01 10:01:05,377 [main] ERROR [o.s.b.SpringApplication].reportFailure.842 : Application run failed
io.mosip.preregistration.core.exception.MasterDataNotAvailableException: KER-MSD-016 --> Valid document not found
at io.mosip.preregistration.core.util.ValidationUtil.getAllDocCategoriesAndTypes(ValidationUtil.java:340)
at io.mosip.preregistration.application.service.DocumentService.setup(DocumentService.java:187)
at io.mosip.preregistration.application.service.DocumentService$$FastClassBySpringCGLIB$$22bc9d53.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:684)
at io.mosip.preregistration.application.service.DocumentService$$EnhancerBySpringCGLIB$$6c6dc278.setup(<generated>)
at io.mosip.preregistration.application.config.ApplicationEventListerner.applicationStartedEvent(ApplicationEventListerner.java:36)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.context.event.ApplicationListenerMethodAdapter.doInvoke(ApplicationListenerMethodAdapter.java:261)
at org.springframework.context.event.ApplicationListenerMethodAdapter.processEvent(ApplicationListenerMethodAdapter.java:180)
at org.springframework.context.event.ApplicationListenerMethodAdapter.onApplicationEvent(ApplicationListenerMethodAdapter.java:142)
at org.springframework.context.event.SimpleApplicationEventMulticaster.doInvokeListener(SimpleApplicationEventMulticaster.java:172)
at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:165)
at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:139)
at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:400)
at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:354)
at org.springframework.boot.context.event.EventPublishingRunListener.started(EventPublishingRunListener.java:97)
at org.springframework.boot.SpringApplicationRunListeners.started(SpringApplicationRunListeners.java:72)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:334)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1255)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1243)
at io.mosip.preregistration.application.PreRegistrationApplication.main(PreRegistrationApplication.java:23)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:108)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:58)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:467)
2023-08-01 10:01:05,378 [main] INFO [o.s.c.s.AbstractApplicationContext].doClose.993 : Closing org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext@53cdecf6: startup date [Tue Aug 01 10:00:00 UTC 2023]; parent: org.springframework.context.annotation.AnnotationConfigApplicationContext@1b1cfb87
2023-08-01 10:01:05,393 [main] INFO [o.s.j.e.MBeanExporter].destroy.451 : Unregistering JMX-exposed beans on shutdown
2023-08-01 10:01:05,394 [main] INFO [o.s.j.s.MBeanRegistrationSupport].unregisterBeans.183 : Unregistering JMX-exposed beans
2023-08-01 10:01:05,473 [main] INFO [o.s.o.j.AbstractEntityManagerFactoryBean].destroy.597 : Closing JPA EntityManagerFactory for persistence unit 'hibernate'
2023-08-01 10:01:05,476 [main] INFO [c.z.h.HikariDataSource].close.381 : HikariPool-1 - Shutdown initiated...
2023-08-01 10:01:05,483 [main] INFO [c.z.h.HikariDataSource].close.383 : HikariPool-1 - Shutdown completed.
I found that someone in the community has asked a similar question, and the solution is to enter the “admin module” and add “doctype details.” https://community.mosip.io/t/prereg-application-error-mosip-v1-2-0-1-b1/396
However, according to the recommended deployment sequence, the “admin” module has not been deployed in the cluster yet.
Should I skip the error in “prereg” and continue deploying the subsequent modules until the “admin” module is deployed, or should I prioritize deploying the “admin” module before continuing with the rest?
Admin
Well, I tried deploying the Admin module first, but I encountered an issue. After deploying the admin module, three pods were started, namely admin-proxy, admin-hotlist and admin-service.
Below is the log for admin-service. It seems that there is a password mismatch when connecting to PostgreSQL, and the username is “masteruser.” How can I obtain the password for this user? I checked the secrets in namespace postgres, but it doesn’t seem to be stored there. Should I change the username in the configuration file to “postgres”?
{"@timestamp":"2023-08-01T13:59:25.495Z","@version":"1","message":"SQLException occurred while connecting to postgres-postgresql.postgres:5432","logger_name":"unknown.jul.logger","thread_name":"HikariPool-1 connection adder","level":"WARN","level_value":30000,"stack_trace":"org.postgresql.util.PSQLException: FATAL: password authentication failed for user \"masteruser\"\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:473)\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)\n\tat org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)\n\tat org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)\n\tat org.postgresql.Driver.makeConnection(Driver.java:452)\n\tat org.postgresql.Driver.connect(Driver.java:254)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:117)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:123)\n\tat com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:365)\n\tat com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:194)\n\tat com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:460)\n\tat com.zaxxer.hikari.pool.HikariPool.access$100(HikariPool.java:71)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:699)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:685)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:829)\n","appName":"admin-service"}
{"@timestamp":"2023-08-01T13:59:25.496Z","@version":"1","message":"Connection error: ","logger_name":"org.postgresql.Driver","thread_name":"HikariPool-1 connection adder","level":"ERROR","level_value":40000,"stack_trace":"org.postgresql.util.PSQLException: FATAL: password authentication failed for user \"masteruser\"\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:473)\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)\n\tat org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)\n\tat org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)\n\tat org.postgresql.Driver.makeConnection(Driver.java:452)\n\tat org.postgresql.Driver.connect(Driver.java:254)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:117)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:123)\n\tat com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:365)\n\tat com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:194)\n\tat com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:460)\n\tat com.zaxxer.hikari.pool.HikariPool.access$100(HikariPool.java:71)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:699)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:685)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:829)\n","appName":"admin-service"}
{"@timestamp":"2023-08-01T13:59:25.791Z","@version":"1","message":"SQLException occurred while connecting to postgres-postgresql.postgres:5432","logger_name":"unknown.jul.logger","thread_name":"HikariPool-1 connection adder","level":"WARN","level_value":30000,"stack_trace":"org.postgresql.util.PSQLException: FATAL: password authentication failed for user \"masteruser\"\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:473)\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)\n\tat org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)\n\tat org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)\n\tat org.postgresql.Driver.makeConnection(Driver.java:452)\n\tat org.postgresql.Driver.connect(Driver.java:254)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:117)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:123)\n\tat com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:365)\n\tat com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:194)\n\tat com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:460)\n\tat com.zaxxer.hikari.pool.HikariPool.access$100(HikariPool.java:71)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:699)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:685)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:829)\n","appName":"admin-service"}
{"@timestamp":"2023-08-01T13:59:25.793Z","@version":"1","message":"Connection error: ","logger_name":"org.postgresql.Driver","thread_name":"HikariPool-1 connection adder","level":"ERROR","level_value":40000,"stack_trace":"org.postgresql.util.PSQLException: FATAL: password authentication failed for user \"masteruser\"\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:473)\n\tat org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:205)\n\tat org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)\n\tat org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)\n\tat org.postgresql.Driver.makeConnection(Driver.java:452)\n\tat org.postgresql.Driver.connect(Driver.java:254)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:117)\n\tat com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:123)\n\tat com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:365)\n\tat com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:194)\n\tat com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:460)\n\tat com.zaxxer.hikari.pool.HikariPool.access$100(HikariPool.java:71)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:699)\n\tat com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:685)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:829)\n","appName":"admin-service"}
{"@timestamp":"2023-08-01T13:59:26.406Z","@version":"1","message":"HHH000400: Using dialect: org.hibernate.dialect.PostgreSQL95Dialect","logger_name":"org.hibernate.dialect.Dialect","thread_name":"main","level":"INFO","level_value":20000,"appName":"admin-service"}
{"@timestamp":"2023-08-01T13:59:28.735Z","@version":"1","message":"HHH000421: Disabling contextual LOB creation as hibernate.jdbc.lob.non_contextual_creation is true","logger_name":"org.hibernate.engine.jdbc.env.internal.LobCreatorBuilderImpl","thread_name":"main","level":"INFO","level_value":20000,"appName":"admin-service"}
{"@timestamp":"2023-08-01T13:59:28.801Z","@version":"1","message":"HHH000270: Type registration [java.util.UUID] overrides previous : org.hibernate.type.UUIDBinaryType@6af65f29","logger_name":"org.hibernate.type.BasicTypeRegistry","thread_name":"main","level":"INFO","level_value":20000,"appName":"admin-service"}
{"@timestamp":"2023-08-01T14:00:02.095Z","@version":"1","message":"Initialized JPA EntityManagerFactory for persistence unit 'hibernate'","logger_name":"org.springframework.orm.jpa.LocalContainerEntityManagerFactoryBean","thread_name":"main","level":"INFO","level_value":20000,"appName":"admin-service"}
Below is the log for admin-hotlist.I am not sure if there are any errors affecting the pod, causing it to be abnormal and continuously restarting.
{"@timestamp":"2023-08-01T14:24:33.659Z","@version":"1","message":"Requesting for new Token for the provided OIDC Service: http://keycloak.keycloak/auth/realms/","logger_name":"io.mosip.kernel.auth.defaultadapter.helper.TokenHelper","thread_name":"main","level":"INFO","level_value":20000,"appName":"HOTLIST","traceId":"aa4ebc7712ac7766","spanId":"aa4ebc7712ac7766","spanExportable":"false","X-Span-Export":"false","X-B3-SpanId":"aa4ebc7712ac7766","X-B3-TraceId":"aa4ebc7712ac7766"}
{"@timestamp":"2023-08-01T14:24:37.030Z","@version":"1","message":"Found Token in response body and returning the Token","logger_name":"io.mosip.kernel.auth.defaultadapter.helper.TokenHelper","thread_name":"main","level":"INFO","level_value":20000,"appName":"HOTLIST","traceId":"aa4ebc7712ac7766","spanId":"aa4ebc7712ac7766","spanExportable":"false","X-Span-Export":"false","X-B3-SpanId":"aa4ebc7712ac7766","X-B3-TraceId":"aa4ebc7712ac7766"}
{"@timestamp":"2023-08-01T14:24:37.115Z","@version":"1","message":"Error occured while registering topic to hub :- hub.mode=denied&hub.reason=Topic has already registered with the Hub","logger_name":"io.mosip.kernel.websub.api.client.PublisherClientImpl","thread_name":"main","level":"ERROR","level_value":40000,"appName":"HOTLIST"}
{"@timestamp":"2023-08-01T14:24:37.119Z","@version":"1","message":" - HotlistConfig - registerTopic - IGNORING THIS ERROR AS TOPIC IS ALREADY REGISTERED - KER-WSC-101 --> Error occured while registering topic to hub :- Topic has already registered with the Hub","logger_name":"io.mosip.hotlist.config.HotlistConfig","thread_name":"main","level":"WARN","level_value":30000,"appName":"HOTLIST"}
{"@timestamp":"2023-08-01T14:24:37.658Z","@version":"1","message":"Building JPA container EntityManagerFactory for persistence unit 'default'","logger_name":"org.springframework.orm.jpa.LocalContainerEntityManagerFactoryBean","thread_name":"main","level":"INFO","level_value":20000,"appName":"HOTLIST"}
{"@timestamp":"2023-08-01T14:24:38.765Z","@version":"1","message":"HHH000204: Processing PersistenceUnitInfo [\n\tname: default\n\t...]","logger_name":"org.hibernate.jpa.internal.util.LogHelper","thread_name":"main","level":"INFO","level_value":20000,"appName":"HOTLIST"}
{"@timestamp":"2023-08-01T14:24:40.059Z","@version":"1","message":"HHH000412: Hibernate Core {5.2.17.Final}","logger_name":"org.hibernate.Version","thread_name":"main","level":"INFO","level_value":20000,"appName":"HOTLIST"}
{"@timestamp":"2023-08-01T14:24:40.063Z","@version":"1","message":"HHH000206: hibernate.properties not found","logger_name":"org.hibernate.cfg.Environment","thread_name":"main","level":"INFO","level_value":20000,"appName":"HOTLIST"}
Mock-abis / Mock-mv
The “mock-abis” module starts up normally, but its status remains “not ready.” The logs do not show any errors, but the pod keeps restarting continuously. Do I need to make any configurations to address this issue?
logs：
NOTE: Picked up JDK_JAVA_OPTIONS: -Xms750M -Xmx750M
. ____ _ __ _ _
/\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
' |____| .__|_| |_|_| |_\__, | / / / /
=========|_|==============|___/=/_/_/_/
:: Spring Boot :: (v2.3.4.RELEASE)
11:49:12.632 [main] INFO o.s.c.c.client.ConfigServicePropertySourceLocator - Fetching config from server at : http://config-server.config-server/config
11:49:17.630 [main] INFO o.s.c.c.client.ConfigServicePropertySourceLocator - Located environment: name=mock-abis, profiles=[default], label=1.2.0.1-v3, version=3db97e0692ccb5f75a868b1f6661a822b6f77d2a, state=null
11:49:17.631 [main] INFO o.s.c.b.c.PropertySourceBootstrapConfiguration - Located property source: [BootstrapPropertySource {name='bootstrapProperties-configClient'}, BootstrapPropertySource {name='bootstrapProperties-overrides'}, BootstrapPropertySource {name='bootstrapProperties-http://192.168.5.107:8929/mosip/mosip-config.git/mock-abis-default.properties'}, BootstrapPropertySource {name='bootstrapProperties-http://192.168.5.107:8929/mosip/mosip-config.git/application-default.properties'}]
11:49:22.233 [main] INFO io.mosip.proxy.abis.ProxyAbisApplication - The following profiles are active: default
11:50:09.836 [main] INFO o.s.d.r.config.RepositoryConfigurationDelegate - Bootstrapping Spring Data JPA repositories in DEFAULT mode.
11:50:12.533 [main] INFO o.s.d.r.config.RepositoryConfigurationDelegate - Finished Spring Data repository scanning in 2295ms. Found 2 JPA repository interfaces.
11:50:40.733 [main] INFO o.springframework.cloud.context.scope.GenericScope - BeanFactory id=61c34c3d-3841-392d-bbf6-7b183064fcfd
11:51:18.138 [main] INFO o.s.boot.web.embedded.tomcat.TomcatWebServer - Tomcat initialized with port(s): 8081 (http)
11:51:18.638 [main] INFO org.apache.coyote.http11.Http11NioProtocol - Initializing ProtocolHandler ["http-nio-8081"]
11:51:18.730 [main] INFO org.apache.catalina.core.StandardService - Starting service [Tomcat]
11:51:18.731 [main] INFO org.apache.catalina.core.StandardEngine - Starting Servlet engine: [Apache Tomcat/9.0.38]
11:51:21.831 [main] INFO o.a.c.c.C.[.[localhost].[/v1/mock-abis-service] - Initializing Spring embedded WebApplicationContext
11:51:21.831 [main] INFO o.s.b.w.s.c.ServletWebServerApplicationContext - Root WebApplicationContext: initialization completed in 117497 ms
11:51:50.929 [main] INFO com.zaxxer.hikari.HikariDataSource - HikariPool-1 - Starting...
11:52:02.838 [main] INFO com.zaxxer.hikari.HikariDataSource - HikariPool-1 - Start completed.
11:52:06.233 [main] INFO org.hibernate.jpa.internal.util.LogHelper - HHH000204: Processing PersistenceUnitInfo [name: default]
11:52:08.536 [main] INFO org.hibernate.Version - HHH000412: Hibernate ORM core version 5.4.21.Final
11:52:14.537 [main] INFO org.hibernate.annotations.common.Version - HCANN000001: Hibernate Commons Annotations {5.1.0.Final}
11:52:20.741 [main] INFO org.hibernate.dialect.Dialect - HHH000400: Using dialect: org.hibernate.dialect.H2Dialect
11:52:33.541 [main] INFO org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 6.1.5.Final
mock-abis Events:
The pod of the mock-mv module is also continuously restarting, and there are no error logs as well. Is it because of the “startup probe”?
mock-mv Events:
.