nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

ArcSOC 10.5.1 are freezing

xavierlhomme

Hi ( Eric Bader)

I'm facing an issue with ArcSOC wich are freezing and occupying their vCPU.
I'm using ArcGIS Entreprise 10.5.1. ArcGIS Server is installed on a windows server 10.5.1
First I've installed ArcGIS Entreprise on my own infrastructure and had no problem with it.
But since I ve installed the same deployement solution on an Infrastructure Provider, I'am having this issue.
I'm investigating this issue since two month now with the Infrastructure provider and ESRI France but we dont find a solution.
I had to install a workaround which kill the ArcSOC process when it detect a failure.

My ArcSOC are connected with a Posgres database on a distante machine. But I have installed a Postgres database on the arcgis server and reproduce the issue.

Has anyone encounter the same issue ?

One solution to find the issue would be to produce a dump file and examine it with PDB.

Where can I find the PDB ?

Can I send the PDB to someone ?

best regards .

xavier lhomme

Find more posts tagged with

Accepted answers

All comments

EricBader

Hello Xavier,

I'm looping in others to see if we can assist you with this.

Thanks,
Eric

JonathanQuinn

Is the service actually crashing? The logs should indicate whether the services is crashing or not. If it is, it'll list the path to the dump file. It should be in the errorreports folder within the logs directory.

Does this happen only when using certain data or when you publish a specific MXD? Here are some simple troubleshooting steps:

1) Add the data to a new, blank map document and publish it. Don't symbolize the data. See if the same thing happens.

2) If you test the service in an application and see the problem, manually browse to the service through the Javascript API at REST or any portal's map viewer.

It's important to identify if this is a map document issue, data issue, symbology issue, or application problem. You can also set the logs to VERBOSE or even DEBUG to determine what request Server is hanging on.

xavierlhomme

Hi and thanks for your answers

The problem can happen on all mapservices. (I did not check on feature service or on hosted services)

ArcSOCs do not crash but are no longer controlled by the arcgisserver process.
arcgisserver spawn a new instance but dont delete the freezing one.

Logs (of the framework or services do not provide information).
I publish my services with ArcGIS Pro, data are referenced on a postgres database.
I also tested the publication in data copy mode, and it was installed locally on the same VM taht the arcgis server.
thoses services have the same behavior. This eliminates a network problem and a postgres problem.
I also have a development environment on my own infrastructure where I have copied the data on a postgres and have published the same services.
On my own, everything works perfectly. I could have some performance issue due to the symbology or lack of indexes, but it would not be the cause of this behavior.

I can ask the infrastructure provider to provide me a centOS virtual machine and try to installe my arcgis site on this OS.
But I would prefere to find the cause (OS patches? GPO?... something else).

best regards

JonathanQuinn

Does this also happen to the SampleWorldCities service?

xavierlhomme

I continued my investigations on this problem.
Indeed, I did not reproduce the problem with the samplewolrdcities, and only on vector services, published with arcgis pro. I have no problem with my basemap services.
But on my own environment I have no problems, which for me exonerates mapservices.

I tried a lot of things: configure the config-store locally, reduce the number of vcpu. I reinstall the arcgis server on centOS: and I reproduce the problem. I detect ghost or zombie arcsoc: for example the max instance of the BUS mapservice is a 2. After a little use then a pause, then again use, I ended up getting 3, 4, 5 ... BUS arcsoc. if I stop the BUS mapservice, only 2 arcsoc are killed. Yet the other arcsoc have a pid father corresponding to arcgisserver.

I checked VMWare: it uses vmware ESXi 5.5, and me too .;
so I have no idea.

xav

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.