Community
Select to view content in your preferred language

Join Portal 10.6.1

1367
3
09-12-2019 07:14 AM
VireshDharmlal
by
Emerging Contributor
‎09-12-2019 07:14 AM

Try to Join P2 to P1 getting this error below ( HA)

Jonathan Quinn‌

Tags (1)
0 Kudos
3 Replies
JonathanQuinn
by Esri Notable Contributor
Esri Notable Contributor
‎09-12-2019 09:56 AM

You'll need to check the logs to see why it fails. Scrub them and post them here if you'd like.

0 Kudos
VireshDharmlal
by
Emerging Contributor
‎09-16-2019 10:06 AM

<Msg time="2019-09-12T06:18:33,905" type="INFO" code="217039" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log Service started.</Msg>
<Msg time="2019-09-12T06:18:33,905" type="VERBOSE" code="218020" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Get the machine name from the portal-config.properties file: SAPRS01.EBS.LOCAL.</Msg>
<Msg time="2019-09-12T06:18:33,905" type="VERBOSE" code="218021" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Get the fully qualified name for the local host: SAPRS01.EBS.LOCAL.</Msg>
<Msg time="2019-09-12T06:18:33,905" type="INFO" code="217031" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Configuring and initializing data, content and index directories.</Msg>
<Msg time="2019-09-12T06:18:34,842" type="INFO" code="217032" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Replacing base URLs in configuration files.</Msg>
<Msg time="2019-09-12T06:18:34,874" type="INFO" code="217009" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">httpUrl: SAPRS01.EBS.LOCAL:7080.</Msg>
<Msg time="2019-09-12T06:18:34,874" type="INFO" code="217010" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">httpsUrl: SAPRS01.EBS.LOCAL:7443.</Msg>
<Msg time="2019-09-12T06:18:34,874" type="INFO" code="217011" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">baseUrl: SAPRS01.EBS.LOCAL:7080/arcgis.</Msg>
<Msg time="2019-09-12T06:18:34,874" type="INFO" code="217012" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">sbaseUrl: SAPRS01.EBS.LOCAL:7443/arcgis.</Msg>
<Msg time="2019-09-12T09:44:55,435" type="WARNING" code="217014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Error at URL updater. E:\Program Files\ArcGIS\Portal\apps\ImageMask\index.html (The system cannot find the path specified)</Msg>
<Msg time="2019-09-12T09:44:56,186" type="WARNING" code="217014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Error at URL updater. E:\Program Files\ArcGIS\Portal\apps\ImageryViewer\index.html (The system cannot find the path specified)</Msg>
<Msg time="2019-09-12T09:44:58,248" type="INFO" code="217033" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Configuring web server ports.</Msg>
<Msg time="2019-09-12T09:44:58,592" type="INFO" code="217034" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Configuring Proxy Properties</Msg>
<Msg time="2019-09-12T09:44:58,592" type="INFO" code="217035" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Configuring the index service credentials.</Msg>
<Msg time="2019-09-12T09:44:58,592" type="INFO" code="217002" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Portal configuration updated.</Msg>
<Msg time="2019-09-12T09:44:58,607" type="INFO" code="217046" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting process monitor.</Msg>
<Msg time="2019-09-12T09:44:58,607" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T09:44:58,607" type="INFO" code="217055" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting watchdog thread run.</Msg>
<Msg time="2019-09-12T09:44:58,607" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T09:44:58,639" type="INFO" code="217074" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Portal started successfully.</Msg>
<Msg time="2019-09-12T09:44:58,639" type="INFO" code="217044" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Started removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-12T09:44:58,654" type="INFO" code="217045" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Finished removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-12T09:45:00,764" type="WARNING" code="217064" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The web server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T09:45:00,764" type="INFO" code="217053" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting the web server.</Msg>
<Msg time="2019-09-12T09:45:35,816" type="INFO" code="217054" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started web server.</Msg>
<Msg time="2019-09-12T10:34:51,269" type="INFO" code="207037" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T10:34:51,434" type="INFO" code="205013" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T10:34:51,434" type="VERBOSE" code="209030" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Setting log level to VERBOSE before joining site.</Msg>
<Msg time="2019-09-12T10:34:51,435" type="INFO" code="209101" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize join site. </Msg>
<Msg time="2019-09-12T10:34:51,440" type="INFO" code="209080" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating the input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T10:35:03,959" type="INFO" code="209081" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T10:35:03,960" type="INFO" code="209082" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Generating token from primary machine for join site work flow.</Msg>
<Msg time="2019-09-12T10:35:08,337" type="INFO" code="209083" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Generated token from primary machine for join site work flow.</Msg>
<Msg time="2019-09-12T10:35:08,337" type="INFO" code="218019" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Getting machines count from primary portal machine.</Msg>
<Msg time="2019-09-12T10:35:10,251" type="INFO" code="218020" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully obtained machines count from primary portal machine success.</Msg>
<Msg time="2019-09-12T10:35:10,753" type="INFO" code="207037" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T10:35:10,797" type="INFO" code="205013" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T10:35:13,201" type="INFO" code="209085" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining the license info from primary machine.</Msg>
<Msg time="2019-09-12T10:35:13,695" type="INFO" code="209086" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained the license info from primary machine successfully.</Msg>
<Msg time="2019-09-12T10:35:13,696" type="INFO" code="209087" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining the license info from local machine.</Msg>
<Msg time="2019-09-12T10:35:13,697" type="INFO" code="209088" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained the license info from local machine successfully.</Msg>
<Msg time="2019-09-12T10:35:13,697" type="INFO" code="209089" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating licenses of primary machine and machine to be joined. </Msg>
<Msg time="2019-09-12T10:35:13,697" type="INFO" code="209090" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully validated licenses of primary machine and machine to be joined. </Msg>
<Msg time="2019-09-12T10:35:13,697" type="INFO" code="209065" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating ports which are used by a highly available Portal.</Msg>
<Msg time="2019-09-12T10:35:13,750" type="VERBOSE" code="209067" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating hazelcast cluster configuration which are used by a highly available Portal.</Msg>
<Msg time="2019-09-12T10:35:22,292" type="INFO" code="209095" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining config store connnection from primary machine.</Msg>
<Msg time="2019-09-12T10:35:22,741" type="INFO" code="209096" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained config store connnection from primary machine successfully.</Msg>
<Msg time="2019-09-12T10:35:22,925" type="INFO" code="209098" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Registering local portal machine to primary portal machine site.</Msg>
<Msg time="2019-09-12T10:35:22,925" type="INFO" code="209118" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Pausing HA plugin on local machine.</Msg>
<Msg time="2019-09-12T10:35:22,962" type="INFO" code="209119" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Pausing HA plugin on local machine successful.</Msg>
<Msg time="2019-09-12T10:35:22,979" type="INFO" code="219999" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> Checks if a given URL https://nkprs01.ebs.local:7443//arcgis/portaladmin/machines/register is reachable</Msg>
<Msg time="2019-09-12T10:35:23,139" type="INFO" code="219999" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> Sending request to register the portal machine.</Msg>
<Msg time="2019-09-12T10:35:29,723" type="SEVERE" code="218010" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The portal has been initialized and configured but is not accessible. The internal portal database does not appear to be running or accepting connections. Restart the portal machine or machines and if the problem persists, contact Esri technical support (U.S.) or your distributor (customers outside the U.S.).</Msg>
<Msg time="2019-09-12T10:35:36,570" type="INFO" code="217066" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Stopping watchdog thread.</Msg>
<Msg time="2019-09-12T10:35:36,764" type="SEVERE" code="218010" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The portal has been initialized and configured but is not accessible. The internal portal database does not appear to be running or accepting connections. Restart the portal machine or machines and if the problem persists, contact Esri technical support (U.S.) or your distributor (customers outside the U.S.).</Msg>
<Msg time="2019-09-12T10:36:00,203" type="INFO" code="219999" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> The response: {"status":"success"}</Msg>
<Msg time="2019-09-12T10:36:00,203" type="INFO" code="209099" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Registered local portal machine to primary portal machine site.</Msg>
<Msg time="2019-09-12T10:36:00,203" type="INFO" code="209102" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize the machine in standby mode. </Msg>
<Msg time="2019-09-12T10:36:00,296" type="INFO" code="209154" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating Portal Installation. </Msg>
<Msg time="2019-09-12T10:36:00,298" type="INFO" code="209155" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated Portal Installation. </Msg>
<Msg time="2019-09-12T10:36:00,298" type="INFO" code="209154" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating Portal Data. </Msg>
<Msg time="2019-09-12T10:36:00,310" type="INFO" code="209155" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated Portal Data. </Msg>
<Msg time="2019-09-12T10:36:00,310" type="INFO" code="209156" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Creating HA configuration files. </Msg>
<Msg time="2019-09-12T10:36:00,379" type="INFO" code="209157" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">HA configuration files created.</Msg>
<Msg time="2019-09-12T10:36:00,379" type="INFO" code="209160" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Configuring database for HA. </Msg>
<Msg time="2019-09-12T10:41:12,389" type="SEVERE" code="219999" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> java.lang.Exception: Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>
<Msg time="2019-09-12T10:41:12,389" type="SEVERE" code="100" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site initialization failed. Unable to configure local machine in standby mode for high availability.</Msg>
<Msg time="2019-09-12T10:41:12,389" type="INFO" code="205034" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site failed; reverting Join site configuration on local machine.</Msg>
<Msg time="2019-09-12T10:41:12,389" type="INFO" code="209101" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Unable to configure standby machine. Attempting to roll back the high availability configuration on the primary portal machine.</Msg>
<Msg time="2019-09-12T10:41:19,849" type="INFO" code="209102" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully rolled back the high availability configuration on the primary portal machine.</Msg>
<Msg time="2019-09-12T10:41:19,850" type="INFO" code="209074" source="Portal Admin" process="3416" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Connection file deleted from disk.</Msg>
<Msg time="2019-09-12T10:41:25,75" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T10:41:25,85" type="INFO" code="217046" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting process monitor.</Msg>
<Msg time="2019-09-12T10:41:25,86" type="INFO" code="217055" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting watchdog thread run.</Msg>
<Msg time="2019-09-12T10:41:25,86" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T10:42:25,76" type="INFO" code="217056" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing processes marked for termination.</Msg>
<Msg time="2019-09-12T10:42:25,77" type="INFO" code="217057" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing process: tomcat.</Msg>
<Msg time="2019-09-12T10:42:25,103" type="INFO" code="217056" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing processes marked for termination.</Msg>
<Msg time="2019-09-12T10:42:25,103" type="INFO" code="217057" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing process: tomcat.</Msg>
<Msg time="2019-09-12T10:42:25,166" type="INFO" code="217058" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killed all processes marked for termination.</Msg>
<Msg time="2019-09-12T10:42:25,170" type="INFO" code="217058" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killed all processes marked for termination.</Msg>
<Msg time="2019-09-12T10:42:32,174" type="WARNING" code="217064" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The web server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T10:42:32,175" type="INFO" code="217053" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting the web server.</Msg>
<Msg time="2019-09-12T10:43:01,227" type="INFO" code="217054" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started web server.</Msg>
<Msg time="2019-09-12T10:56:52,718" type="INFO" code="207037" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T10:56:52,893" type="INFO" code="205013" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T10:56:52,893" type="VERBOSE" code="209030" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Setting log level to VERBOSE before joining site.</Msg>
<Msg time="2019-09-12T10:56:52,894" type="INFO" code="209101" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize join site. </Msg>
<Msg time="2019-09-12T10:56:52,899" type="INFO" code="209080" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating the input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T10:56:52,911" type="SEVERE" code="100" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site initialization failed. The portal URL is invalid. Check to ensure the URL you specified uses HTTPS and port 7443. </Msg>
<Msg time="2019-09-12T10:56:52,911" type="INFO" code="205034" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site failed; reverting Join site configuration on local machine.</Msg>
<Msg time="2019-09-12T10:56:52,958" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T10:56:52,971" type="INFO" code="217046" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting process monitor.</Msg>
<Msg time="2019-09-12T10:56:52,971" type="INFO" code="217055" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting watchdog thread run.</Msg>
<Msg time="2019-09-12T10:56:52,973" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T10:57:02,856" type="INFO" code="207037" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T10:57:02,979" type="INFO" code="205013" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T10:57:02,979" type="VERBOSE" code="209030" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Setting log level to VERBOSE before joining site.</Msg>
<Msg time="2019-09-12T10:57:02,979" type="INFO" code="209101" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize join site. </Msg>
<Msg time="2019-09-12T10:57:02,979" type="INFO" code="209080" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating the input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T10:57:02,979" type="SEVERE" code="100" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site initialization failed. The portal URL is invalid. Check to ensure the URL you specified uses HTTPS and port 7443. </Msg>
<Msg time="2019-09-12T10:57:02,979" type="INFO" code="205034" source="Portal Admin" process="8332" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site failed; reverting Join site configuration on local machine.</Msg>
<Msg time="2019-09-12T10:57:03,23" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T10:57:03,34" type="INFO" code="217046" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting process monitor.</Msg>
<Msg time="2019-09-12T10:57:03,35" type="INFO" code="217055" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting watchdog thread run.</Msg>
<Msg time="2019-09-12T10:57:03,35" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T10:57:30,194" type="INFO" code="217056" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing processes marked for termination.</Msg>
<Msg time="2019-09-12T10:57:30,195" type="INFO" code="217057" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing process: tomcat.</Msg>
<Msg time="2019-09-12T10:57:30,238" type="INFO" code="217058" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killed all processes marked for termination.</Msg>
<Msg time="2019-09-12T10:57:54,998" type="WARNING" code="217064" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The web server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T10:57:54,999" type="INFO" code="217053" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting the web server.</Msg>
<Msg time="2019-09-12T10:58:21,913" type="INFO" code="217054" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started web server.</Msg>
<Msg time="2019-09-12T10:59:00,813" type="INFO" code="207037" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T10:59:00,970" type="INFO" code="205013" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T10:59:00,970" type="VERBOSE" code="209030" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Setting log level to VERBOSE before joining site.</Msg>
<Msg time="2019-09-12T10:59:00,970" type="INFO" code="209101" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize join site. </Msg>
<Msg time="2019-09-12T10:59:00,976" type="INFO" code="209080" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating the input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T10:59:03,102" type="INFO" code="209081" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T10:59:03,102" type="INFO" code="209082" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Generating token from primary machine for join site work flow.</Msg>
<Msg time="2019-09-12T10:59:03,722" type="INFO" code="209083" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Generated token from primary machine for join site work flow.</Msg>
<Msg time="2019-09-12T10:59:03,722" type="INFO" code="218019" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Getting machines count from primary portal machine.</Msg>
<Msg time="2019-09-12T10:59:05,425" type="INFO" code="218020" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully obtained machines count from primary portal machine success.</Msg>
<Msg time="2019-09-12T10:59:05,928" type="INFO" code="207037" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T10:59:05,970" type="INFO" code="205013" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T10:59:08,405" type="INFO" code="209085" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining the license info from primary machine.</Msg>
<Msg time="2019-09-12T10:59:08,881" type="INFO" code="209086" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained the license info from primary machine successfully.</Msg>
<Msg time="2019-09-12T10:59:08,881" type="INFO" code="209087" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining the license info from local machine.</Msg>
<Msg time="2019-09-12T10:59:08,882" type="INFO" code="209088" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained the license info from local machine successfully.</Msg>
<Msg time="2019-09-12T10:59:08,882" type="INFO" code="209089" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating licenses of primary machine and machine to be joined. </Msg>
<Msg time="2019-09-12T10:59:08,883" type="INFO" code="209090" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully validated licenses of primary machine and machine to be joined. </Msg>
<Msg time="2019-09-12T10:59:08,883" type="INFO" code="209065" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating ports which are used by a highly available Portal.</Msg>
<Msg time="2019-09-12T10:59:08,963" type="VERBOSE" code="209067" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating hazelcast cluster configuration which are used by a highly available Portal.</Msg>
<Msg time="2019-09-12T10:59:17,188" type="INFO" code="209095" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining config store connnection from primary machine.</Msg>
<Msg time="2019-09-12T10:59:17,613" type="INFO" code="209096" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained config store connnection from primary machine successfully.</Msg>
<Msg time="2019-09-12T10:59:17,795" type="INFO" code="209098" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Registering local portal machine to primary portal machine site.</Msg>
<Msg time="2019-09-12T10:59:17,795" type="INFO" code="209118" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Pausing HA plugin on local machine.</Msg>
<Msg time="2019-09-12T10:59:17,829" type="INFO" code="209119" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Pausing HA plugin on local machine successful.</Msg>
<Msg time="2019-09-12T10:59:17,844" type="INFO" code="219999" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> Checks if a given URL https://NKPRS01.EBS.LOCAL:7443//arcgis/portaladmin/machines/register is reachable</Msg>
<Msg time="2019-09-12T10:59:18,8" type="INFO" code="219999" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> Sending request to register the portal machine.</Msg>
<Msg time="2019-09-12T10:59:21,918" type="INFO" code="217066" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Stopping watchdog thread.</Msg>
<Msg time="2019-09-12T10:59:22,16" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T10:59:22,16" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T10:59:22,161" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T10:59:22,161" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T10:59:24,609" type="SEVERE" code="218010" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The portal has been initialized and configured but is not accessible. The internal portal database does not appear to be running or accepting connections. Restart the portal machine or machines and if the problem persists, contact Esri technical support (U.S.) or your distributor (customers outside the U.S.).</Msg>
<Msg time="2019-09-12T10:59:31,646" type="SEVERE" code="218010" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The portal has been initialized and configured but is not accessible. The internal portal database does not appear to be running or accepting connections. Restart the portal machine or machines and if the problem persists, contact Esri technical support (U.S.) or your distributor (customers outside the U.S.).</Msg>
<Msg time="2019-09-12T10:59:55,185" type="INFO" code="219999" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> The response: {"status":"success"}</Msg>
<Msg time="2019-09-12T10:59:55,185" type="INFO" code="209099" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Registered local portal machine to primary portal machine site.</Msg>
<Msg time="2019-09-12T10:59:55,185" type="INFO" code="209102" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize the machine in standby mode. </Msg>
<Msg time="2019-09-12T10:59:55,275" type="INFO" code="209154" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating Portal Installation. </Msg>
<Msg time="2019-09-12T10:59:55,277" type="INFO" code="209155" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated Portal Installation. </Msg>
<Msg time="2019-09-12T10:59:55,277" type="INFO" code="209154" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating Portal Data. </Msg>
<Msg time="2019-09-12T10:59:55,281" type="INFO" code="209155" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated Portal Data. </Msg>
<Msg time="2019-09-12T10:59:55,281" type="INFO" code="209156" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Creating HA configuration files. </Msg>
<Msg time="2019-09-12T10:59:55,347" type="INFO" code="209157" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">HA configuration files created.</Msg>
<Msg time="2019-09-12T10:59:55,347" type="INFO" code="209160" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Configuring database for HA. </Msg>
<Msg time="2019-09-12T11:00:37,275" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T11:00:37,275" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T11:00:37,277" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T11:00:37,277" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T11:00:52,348" type="WARNING" code="217060" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The database server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T11:00:52,351" type="WARNING" code="217060" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The database server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T11:05:06,453" type="SEVERE" code="219999" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> java.lang.Exception: Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>
<Msg time="2019-09-12T11:05:06,454" type="SEVERE" code="100" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site initialization failed. Unable to configure local machine in standby mode for high availability.</Msg>
<Msg time="2019-09-12T11:05:06,454" type="INFO" code="205034" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site failed; reverting Join site configuration on local machine.</Msg>
<Msg time="2019-09-12T11:05:06,454" type="INFO" code="209101" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Unable to configure standby machine. Attempting to roll back the high availability configuration on the primary portal machine.</Msg>
<Msg time="2019-09-12T11:05:14,77" type="INFO" code="209102" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully rolled back the high availability configuration on the primary portal machine.</Msg>
<Msg time="2019-09-12T11:05:14,78" type="INFO" code="209074" source="Portal Admin" process="7544" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Connection file deleted from disk.</Msg>
<Msg time="2019-09-12T11:05:19,317" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T11:05:19,330" type="INFO" code="217046" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting process monitor.</Msg>
<Msg time="2019-09-12T11:05:19,331" type="INFO" code="217055" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting watchdog thread run.</Msg>
<Msg time="2019-09-12T11:05:19,332" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T11:05:52,834" type="WARNING" code="217062" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Error checking status of database. Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>
<Msg time="2019-09-12T11:05:52,835" type="WARNING" code="217062" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Error checking status of database. Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>
<Msg time="2019-09-12T11:05:52,976" type="INFO" code="217056" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing processes marked for termination.</Msg>
<Msg time="2019-09-12T11:05:52,977" type="INFO" code="217057" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing process: tomcat.</Msg>
<Msg time="2019-09-12T11:05:53,17" type="INFO" code="217058" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killed all processes marked for termination.</Msg>
<Msg time="2019-09-12T11:06:21,352" type="WARNING" code="217064" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The web server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T11:06:21,353" type="INFO" code="217053" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting the web server.</Msg>
<Msg time="2019-09-12T11:06:45,950" type="INFO" code="217054" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started web server.</Msg>
<Msg time="2019-09-12T11:41:26,16" type="INFO" code="207037" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T11:41:26,175" type="INFO" code="205013" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T11:41:26,175" type="VERBOSE" code="209030" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Setting log level to VERBOSE before joining site.</Msg>
<Msg time="2019-09-12T11:41:26,176" type="INFO" code="209101" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize join site. </Msg>
<Msg time="2019-09-12T11:41:26,181" type="INFO" code="209080" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating the input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T11:41:28,306" type="INFO" code="209081" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated input parameters for join site work flow.</Msg>
<Msg time="2019-09-12T11:41:28,306" type="INFO" code="209082" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Generating token from primary machine for join site work flow.</Msg>
<Msg time="2019-09-12T11:41:29,54" type="INFO" code="209083" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Generated token from primary machine for join site work flow.</Msg>
<Msg time="2019-09-12T11:41:29,54" type="INFO" code="218019" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Getting machines count from primary portal machine.</Msg>
<Msg time="2019-09-12T11:41:30,833" type="INFO" code="218020" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully obtained machines count from primary portal machine success.</Msg>
<Msg time="2019-09-12T11:41:31,353" type="INFO" code="207037" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log level updated to 'VERBOSE'.</Msg>
<Msg time="2019-09-12T11:41:31,392" type="INFO" code="205013" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log settings updated. [Logs directory = 'E:\arcgisportal\logs\', Log level = VERBOSE, Max age in days = 90]</Msg>
<Msg time="2019-09-12T11:41:33,721" type="INFO" code="209085" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining the license info from primary machine.</Msg>
<Msg time="2019-09-12T11:41:34,197" type="INFO" code="209086" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained the license info from primary machine successfully.</Msg>
<Msg time="2019-09-12T11:41:34,197" type="INFO" code="209087" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining the license info from local machine.</Msg>
<Msg time="2019-09-12T11:41:34,198" type="INFO" code="209088" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained the license info from local machine successfully.</Msg>
<Msg time="2019-09-12T11:41:34,198" type="INFO" code="209089" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating licenses of primary machine and machine to be joined. </Msg>
<Msg time="2019-09-12T11:41:34,199" type="INFO" code="209090" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully validated licenses of primary machine and machine to be joined. </Msg>
<Msg time="2019-09-12T11:41:34,199" type="INFO" code="209065" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating ports which are used by a highly available Portal.</Msg>
<Msg time="2019-09-12T11:41:34,261" type="VERBOSE" code="209067" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating hazelcast cluster configuration which are used by a highly available Portal.</Msg>
<Msg time="2019-09-12T11:41:42,516" type="INFO" code="209095" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtaining config store connnection from primary machine.</Msg>
<Msg time="2019-09-12T11:41:42,952" type="INFO" code="209096" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Obtained config store connnection from primary machine successfully.</Msg>
<Msg time="2019-09-12T11:41:43,138" type="INFO" code="209098" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Registering local portal machine to primary portal machine site.</Msg>
<Msg time="2019-09-12T11:41:43,138" type="INFO" code="209118" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Pausing HA plugin on local machine.</Msg>
<Msg time="2019-09-12T11:41:43,172" type="INFO" code="209119" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Pausing HA plugin on local machine successful.</Msg>
<Msg time="2019-09-12T11:41:43,185" type="INFO" code="219999" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> Checks if a given URL https://NKPRS01.EBS.LOCAL:7443//arcgis/portaladmin/machines/register is reachable</Msg>
<Msg time="2019-09-12T11:41:43,349" type="INFO" code="219999" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> Sending request to register the portal machine.</Msg>
<Msg time="2019-09-12T11:41:46,392" type="INFO" code="217066" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Stopping watchdog thread.</Msg>
<Msg time="2019-09-12T11:41:49,948" type="SEVERE" code="218010" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The portal has been initialized and configured but is not accessible. The internal portal database does not appear to be running or accepting connections. Restart the portal machine or machines and if the problem persists, contact Esri technical support (U.S.) or your distributor (customers outside the U.S.).</Msg>
<Msg time="2019-09-12T11:41:53,258" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T11:41:53,259" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T11:41:53,260" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T11:41:53,260" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T11:41:56,980" type="SEVERE" code="218010" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The portal has been initialized and configured but is not accessible. The internal portal database does not appear to be running or accepting connections. Restart the portal machine or machines and if the problem persists, contact Esri technical support (U.S.) or your distributor (customers outside the U.S.).</Msg>
<Msg time="2019-09-12T11:42:20,599" type="INFO" code="219999" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> The response: {"status":"success"}</Msg>
<Msg time="2019-09-12T11:42:20,599" type="INFO" code="209099" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Registered local portal machine to primary portal machine site.</Msg>
<Msg time="2019-09-12T11:42:20,599" type="INFO" code="209102" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting to initialize the machine in standby mode. </Msg>
<Msg time="2019-09-12T11:42:20,693" type="INFO" code="209154" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating Portal Installation. </Msg>
<Msg time="2019-09-12T11:42:20,696" type="INFO" code="209155" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated Portal Installation. </Msg>
<Msg time="2019-09-12T11:42:20,696" type="INFO" code="209154" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validating Portal Data. </Msg>
<Msg time="2019-09-12T11:42:20,700" type="INFO" code="209155" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Validated Portal Data. </Msg>
<Msg time="2019-09-12T11:42:20,700" type="INFO" code="209156" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Creating HA configuration files. </Msg>
<Msg time="2019-09-12T11:42:20,769" type="INFO" code="209157" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">HA configuration files created.</Msg>
<Msg time="2019-09-12T11:42:20,769" type="INFO" code="209160" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Configuring database for HA. </Msg>
<Msg time="2019-09-12T11:43:08,334" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T11:43:08,335" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T11:43:08,336" type="WARNING" code="218014" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting Index Service.</Msg>
<Msg time="2019-09-12T11:43:08,337" type="WARNING" code="218015" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started Index Service.</Msg>
<Msg time="2019-09-12T11:43:23,399" type="WARNING" code="217060" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The database server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T11:43:23,401" type="WARNING" code="217060" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The database server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T11:47:32,65" type="SEVERE" code="219999" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed=""> java.lang.Exception: Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>
<Msg time="2019-09-12T11:47:32,65" type="SEVERE" code="100" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site initialization failed. Unable to configure local machine in standby mode for high availability.</Msg>
<Msg time="2019-09-12T11:47:32,65" type="INFO" code="205034" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Join site failed; reverting Join site configuration on local machine.</Msg>
<Msg time="2019-09-12T11:47:32,65" type="INFO" code="209101" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Unable to configure standby machine. Attempting to roll back the high availability configuration on the primary portal machine.</Msg>
<Msg time="2019-09-12T11:47:41,472" type="INFO" code="209102" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Successfully rolled back the high availability configuration on the primary portal machine.</Msg>
<Msg time="2019-09-12T11:47:41,473" type="INFO" code="209074" source="Portal Admin" process="8904" thread="16" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Connection file deleted from disk.</Msg>
<Msg time="2019-09-12T11:47:50,394" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T11:47:50,405" type="INFO" code="217046" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting process monitor.</Msg>
<Msg time="2019-09-12T11:47:50,406" type="INFO" code="217055" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting watchdog thread run.</Msg>
<Msg time="2019-09-12T11:47:50,407" type="VERBOSE" code="217063" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The process monitor did not find the connection to the configuration store. The site may not have been initialized. After the site is initialized, the check for database processes will be reattempted.</Msg>
<Msg time="2019-09-12T11:48:23,756" type="WARNING" code="217062" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Error checking status of database. Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>
<Msg time="2019-09-12T11:48:23,756" type="WARNING" code="217062" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Error checking status of database. Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>
<Msg time="2019-09-12T11:48:35,333" type="INFO" code="217056" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing processes marked for termination.</Msg>
<Msg time="2019-09-12T11:48:35,333" type="INFO" code="217057" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killing process: tomcat.</Msg>
<Msg time="2019-09-12T11:48:35,374" type="INFO" code="217058" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Killed all processes marked for termination.</Msg>
<Msg time="2019-09-12T11:48:52,430" type="WARNING" code="217064" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">The web server was found to be stopped. Re-starting it.</Msg>
<Msg time="2019-09-12T11:48:52,431" type="INFO" code="217053" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Starting the web server.</Msg>
<Msg time="2019-09-12T11:49:21,297" type="INFO" code="217054" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Started web server.</Msg>
<Msg time="2019-09-13T09:44:58,770" type="INFO" code="217044" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Started removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-13T09:44:58,772" type="INFO" code="217045" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Finished removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-14T09:44:58,640" type="INFO" code="217044" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Started removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-14T09:44:58,642" type="INFO" code="217045" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Finished removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-15T09:44:59,137" type="INFO" code="217044" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Started removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-15T09:44:59,138" type="INFO" code="217045" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Finished removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-16T09:44:58,641" type="INFO" code="217044" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Started removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>
<Msg time="2019-09-16T09:44:58,643" type="INFO" code="217045" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Log limiter: Finished removing logs older than 90 days in path E:\arcgisportal\logs\SAPRS01.EBS.LOCAL\portal.</Msg>

0 Kudos
JonathanQuinn
by Esri Notable Contributor
Esri Notable Contributor
‎09-18-2019 11:07 AM

Take a look at the Event Viewer for why the database won't start. You can start by tracing back 5 minutes from when this error is written to the logs:

Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log

For example look at what's happening around 11:43:23 in the Event Viewer for PG errors based on this message:

<Msg time="2019-09-12T11:48:23,756" type="WARNING" code="217062" source="Portal" process="1544" thread="1" methodName="" machine="SAPRS01.EBS.LOCAL" user="" elapsed="">Error checking status of database. Failed to start the database server. The startup timed out. Please check the log file at E:\arcgisportal\logs\database\pgsql.log.</Msg>