The machine 'xxxxx' not reachable - ArcGIS Server 10.6.1 Log

[JayateerthDeshpande]

Hi,

I have a ArcGIS Server 10.6.1 setup on Windows server 2012 64 bit. Some times in a day, we gate ARcGIS Server log as "The machine 'xx.xx.xx.xxx' was not reachable while performing this operation. The server machine will be notified of this change when it comes back online. If ArcGIS Server is going to continue to be unavailable, remove the machine from the site."

I am not able to understand what is happening at the Site level.. HAs any one faced same issue? if Solved how?

[StevenRamirez]

Hi Jayateerth, thank you for posting this message to the GeoNet forum. A quick note about log messages. In ESRI Support, log messages are used to diagnose issues and look for direction to investigate with reported behavior of the software. Unfortunately, not vice versa.  With that, can you provide any context of an issue that is occurring at the time this message is being logged? Perhaps some end users are consuming a particular service that is having issues. With more descriptive context we could offer a clarifying response as to what may be happening. 

[JayateerthDeshpande]

Thanks Steven,

you are right, that's the approach we have kept. Reason for looking at this log is intermittent slowness, in the map service performance, the the users experience. There is no web adaptor involved here, instead an load balancer which translates 6443 to 443 port.

[Uday_BhanuBurrey2]

Hi Jayateeth, 

Did you get around to this problem? I also have a similar intermittent issues while publish, consuming the services. 

Thanks,

Uday

[ValerieHanson]

I too have been having this log error.  It has occurred for more than the following reason, but one is while working in Portal trying to set up an edit widget with a feature service using SQL data.  There have been several issues since I upgraded to 10.6.1.  WAB Developer applications will not load, old and new story map applications will not open ... theres been a LOT of intermittence and waiting and fixing . . . very, VERY frustrating.

[ThomasJones1]

Hi Jayateerth Deshpande,

Unfortunately there are numerous reasons why you might see performance issues with a map service. If performance continues to be an issue and you have the option you may want to create a support case.

However I can offer some can offer some clarification on the error message:

"The machine 'xx.xx.xx.xxx' was not reachable while performing this operation. The server machine will be notified of this change when it comes back online. If ArcGIS Server is going to continue to be unavailable, remove the machine from the site."

This error messages usually relates to one ArcGIS Server machine in ArcGIS Server site being unreachable. In a multi machine site ArcGIS Server performs a periodic health check between each machine in the site. If one machine does not respond this error messages is generated. There could be number of reasons why this error message is generated. I've listed some of the most common issues below.

• The ArcGIS Server machine is not resolvable across your internal network.
• The ArcGIS Server windows service is not running.
• The ArcGIS Server machines is offline. 

I would recommend checking the ArcGIS Server logs of the machine reference in the error message (e.g. xx.xx.xx.xxx) I hope I was able to provide some insights into potential causes for the error message.

Thank you.

Thomas. 

[ValerieHanson]

Thanks so much for your help Thomas. I will look further into things. There have been some internet issues as well. I was just telling a friend how nice it would be to have something, some software of sorts, that would pin point exactly where the issue is coming from. I heard ArcGIS Monitor may help with that?

Best regards and THANKS again!

Valerie Hanson, GIS Specialist

ND National Guard, NGND-ENV-GIS

PO Box 5511 Bismarck, ND 58506-5511

Valerie.j.hanson4.nfg@mail.mil 701.333.2072

[ThomasJones1]

Hi Valerie Hanson,

No problem at all happy to help. If you do have a multiple machine site you can always check the status of a machine from ArcGIS Server Manager.

ArcGIS Server Manager > Site > Machine

ArcGIS Server - View machine information in Manager:

http://enterprise.arcgis.com/en/server/latest/administer/windows/viewing-machine-information-in-mana...

Your correct ArcGIS Monitor gives you a lot of different ways to monitor your enterprise deployment. For example you can configure email notifications for ArcGIS Server error message (e.g. SEVERE, WARNING etc.). It also allows to monitor service usage and performance. 

It's definitely pretty powerful especially if you have multiple machines or multiple enterprise deployments.

ArcGIS Monitor - What is ArcGIS Monitor:

http://enterprise.arcgis.com/en/monitor/latest/get-started/what-is-arcgis-monitor.htm

Thanks,

Thomas.

[ValerieHanson]

Hey Thomas,

Yep, we have just one ArcGIS Server machine. We have a separate VM for the SQL databases and another for the Data Store. It’s a pretty simple set up yet we SURE have the ISSUES and need for daily troubleshooting. I'm hoping ArcGIS Monitor would troubleshoot deeper than the Server manager logs. To the point of possibly determining if errors and bogging performance is directly due to a specific security configuration within our own requirements for the National Guard to a label expression in a map service that no longer valid because the field was renamed or deleted.

THANKS AGAIN for all your help and the links!

Valerie Hanson, GIS Specialist

ND National Guard, NGND-ENV-GIS

PO Box 5511 Bismarck, ND 58506-5511

Valerie.j.hanson4.nfg@mail.mil 701.333.2072

[Justin_Greco]

Is your server site federated with Portal?

We are seeing this message in our server logs as well.  What I have been able to figure out is that I see it when Portal validates the federation with the server site.  I have been able to verify this by manually running a validation.  Though we also see this on a 15 minute interval sometimes, which correlates to times when the software must be automatically running this validation.  When I check the Portal logs, we get warnings every time a validation is run since not all of our federated sites are hosting servers and the times correlate to when we get the "machine was not reachable" warning in the Server logs.  Tech support has indicated that there is no 15 minute interval for the validation to run, so I am not sure what could be causing the Portal to validate.  I saw this message while the site was a multi-machine as well, but it was followed by a synchronization, which caused one of the machine to restart all its services.  This synchronization has caused us to temporarily switch to a single machine site to remain stable, however we still see the "machine was not reachable" warning, but it doesn't seem to cause any issues.

If you are using Portal, you may want to manually validate the federation and see if that warning appears in your Server logs.