topic Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url in Python Questions

Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Tue, 04 Dec 2018 21:12:52 GMT

I would like to find out the Original mxd document path (under the 'General' tab) and map service rest url (under the 'Capabilities' tab) from all services available in ArcGIS Server Manager, rather than using the UI webpage to drill down into each service to find out this info.

This would most likely involve using the ArcGIS Rest API for Server Administration.

So far, I have found the server manifest json file for a specific service using this documentation:

http://gis.esri.com/arcgis/admin/www/doc/index.html#/Service_Manifest/02w000000058000000/

This only lists the mxd path, but not the ms rest url.

In addition, this still only lists that information for one service only.

Ideally, a scripting language would be used to read the information for every service, and print it out to a document, such as a text file.

Any ideas?

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

JakeSkinner — Fri, 10 Dec 2021 21:22:03 GMT

Hi Andres,

Try the following:

import urllib, urllib2, json

# Variables
username = 'siteadmin'
password = 'siteadmin'
server = "gis.esri.com"

tokenURL = 'http://{}:6080/arcgis/tokens/'.format(server)
params = {'f': 'pjson', 'username': username, 'password': password, 'client': 'requestip'}
req = urllib2.Request(tokenURL, urllib.urlencode(params))
response = urllib2.urlopen(req)
data = json.load(response)
token = data['token']


baseUrl = "http://{}:6080/arcgis/admin/services".format(server)

catalog = json.load(urllib2.urlopen(baseUrl + "/" + "?token=" + token + "&f=json"))
print("ROOT")
services = catalog['services']
for service in services:
    if service['type']!= 'StreamServer':
        print("\t" + str(service['serviceName']))
        manifestUrl = baseUrl + "/" + service['serviceName'] + '.' + service['type'] + "/iteminfo/manifest/manifest.json" + "?token=" + token + "&f=json"
        dataSource = json.load(urllib2.urlopen(manifestUrl))
        print("\t\t" + dataSource['resources'][0]['onPremisePath'])

folders = catalog['folders']
for folderName in folders:
    if str(folderName) not in ('System', 'Utilities', 'DataStoreCatalogs'):
        print(str(folderName))
        catalog = json.load(urllib2.urlopen(baseUrl + "/" + folderName + "/" + "?token=" + token + "&f=json"))
        services = catalog['services']
        for service in services:
            print("\t" + str(service['serviceName']))
            manifestUrl = baseUrl + "/" + str(folderName) + '/' + service['serviceName'] + '.' + service['type'] + "/iteminfo/manifest/manifest.json" + "?token=" + token + "&f=json"
            dataSource = json.load(urllib2.urlopen(manifestUrl))
            print("\t\t" + dataSource['resources'][0]['onPremisePath'])
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 17:06:51 GMT

Thank you for your reply Jake,

What API are you using, so I can read documentation regarding this?

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

JakeSkinner — Wed, 05 Dec 2018 17:08:58 GMT

This is using the ArcGIS Rest API for Server Administration API.

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 17:46:21 GMT

I also see this resource:

Example: Write properties of all services to a CSV file

https://enterprise.arcgis.com/en/server/10.4/administer/windows/example-write-properties-of-all-services-to-a-csv-file.htm

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 17:46:44 GMT

I get an error in syntax at line 22.

Can you give me a quick run-down of what this python script does?

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

JakeSkinner — Wed, 05 Dec 2018 17:50:58 GMT

That script won't give you the source of the services. What is the error you are receiving?

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 17:58:51 GMT

When I edit and then run with IDLE, it says:

"There's an error in your program: invalid syntax"

When I edit and then run with IDLE (ArcGIS Pro), it says:

"invalid character in identifier"

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 18:06:56 GMT

I fixed it.

Since I copied and pasted your script to a text file, then saved as "".py, the IDE was having an issue reading the spacing.

So, I fixed the spacing.

Now, I run it, and get this error:

Traceback (most recent call last):
File "C:\Users\acastillo\Desktop\server.py", line 11, in <module>
    response = urllib2.urlopen(req)
File "C:\Python27\ArcGISx6410.4\lib\urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
File "C:\Python27\ArcGISx6410.4\lib\urllib2.py", line 431, in open
    response = self._open(req, data)
File "C:\Python27\ArcGISx6410.4\lib\urllib2.py", line 449, in _open
    '_open', req)
File "C:\Python27\ArcGISx6410.4\lib\urllib2.py", line 409, in _call_chain
    result = func(*args)
File "C:\Python27\ArcGISx6410.4\lib\urllib2.py", line 1227, in http_open
    return self.do_open(httplib.HTTPConnection, req)
File "C:\Python27\ArcGISx6410.4\lib\urllib2.py", line 1197, in do_open
    raise URLError(err)
URLError: <urlopen error [Errno 10061] No connection could be made because the target machine actively refused it>

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

JakeSkinner — Wed, 05 Dec 2018 18:10:11 GMT

Looks like your ArcGIS Server instance is refusing the connection. You may have HTTP disabled, which means you'll need to update HTTP to HTTPS and change the port from 6080 to 6443 in the baseUrl and tokenUrl parameters.

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 18:18:01 GMT

What I just did was change the 'server' variable to the IP address of the server, rather than the domain name, and ran it.

This produced a result, in which service folders and services listed under each folder, and mxd paths are listed.

Then, the last part of the result says:

Traceback (most recent call last):
File "C:\Users\acastillo\Desktop\server.py", line 38, in <module>
print("\t\t" + dataSource['resources'][0]['onPremisePath'])
KeyError: 'resources'

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

JakeSkinner — Wed, 05 Dec 2018 19:47:21 GMT

This would take some trouble shooting. I would recommend using an IDE such as PyScripter. You can execute the script, and then enter in the variable 'dataSource' in the Python Interpreter. This will provide further information. Ex:

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 19:48:41 GMT

With respect to the keyerror, I believe that the script is aborting when it reaches a service that has no original document.

In ArcGIS Server Manager, that service has 'Service does not include path information.

Can you help me bypass this service so that the script continues?

What is the reasoning for lines 20-26?

I do not see any result from that codeblock.

In addition to your awesome code:

I would like to see in the result the urls for the different types of services.

For example:

https://domain:port/arcgis/rest/services/folder/serviceName/ImageServer

https://domain:port/arcgis/rest/services/folder/serviceName/MapServer

https://domain:port/arcgis/rest/services/folder/serviceName/FeatureServer

I also noted that if a service is stopped, the script will not read that service, so no output.

Yet, I would still like to know that information from the stopped services.

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

JakeSkinner — Fri, 10 Dec 2021 21:22:06 GMT

Lines 20-26 read the ROOT directory (not a folder) of ArcGIS Server. The script is working on stopped services and services that do not have an MXD:

ROOT
     Airports
          Untitled
     Monmouth_Parcels_AGS
          C:\TEMP\Python\UserData\Parcels.mxd
     Philadelphia2016
          C:\DATA\RASTER\Philadelphia\MosaicDataset.gdb\Philadelphia2016
Hosted
     Caltrans_Watersheds
          Untitled
     Monmouth_Parcels_HOSTED
          Untitled‍‍‍‍‍‍‍‍‍‍‍‍

To get the URL, you can add a print statement:

print(baseUrl + "/" + service['serviceName'] + '.' + service['type'])‍

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Wed, 05 Dec 2018 20:59:28 GMT

I see now that it is reading the stopped service, sorry

I also agree that it reads services with no original mxd as 'Untitled', so long as it has a machine name.

Yet, in this case, there is no machine name, nor path, for this service.

Machine name: Service does not include machine name information.

Path: Service does not include path information.

Can you help me bypass this service so that the script continues?

I tried stopping the service, doesn't work.

My organization is not yet confident regarding deleting this service without breaking something.

EDIT:

I was able to bypass this service by using a try, except keyerror, continue inside of the 'for service in services:" loop

More important for me though is:

In the ArcGIS Server Administrator Directory, I noticed that Feature Services are not displayed, whereas

in the ArcGIS REST Services Directory, they are.

As a result, the feature service URLs are not being printed out when they exist.

How do I get feature service urls to print as well?

Re: Query Services in ArcGIS Server Manager, then print the Original mxd document path and map service rest url

AndresCastillo — Fri, 10 Dec 2021 21:22:09 GMT

Jake Skinner ,

I've modified your script, starting at line 17 of your script in the 'correct answer.'

This is because the feature service (FS) url's do not seem to show up in the admin rest directory, but I would still like to include them.

See below.

These are the issues I am encountering as of now:

Only when I added the fs portion, the original path for services does not print to the result when its' not an mxd file type (for example, locators (E:\Locators\SiteAddressPoint) or toolboxes (C:\Users\name\AppData\Local\Esri\Desktop10.4\Staging\arcgis on serverDomain(publisher)\sddraftToolboxes\GeocodeAddresses_WorldLocator.tbx))

Without the fs portion on lines 30-39 below, this is no longer an issue.

When the script encounters the keyError, it continues, but prints to the result fs portion first for all fservices, then prints the keyError messages, then continues the remainder of the try statement to print the remainder mapservices and document paths.

I would like to keep the ms and fs urls printed out together.

baseUrl = "http://{}:6080/arcgis/admin/services".format(server)
baseUrl1 = "http://{}:6080/arcgis/rest/services".format(server)

catalog = json.load(urllib2.urlopen(baseUrl + "/" + "?token=" + token + "&f=json"))
catalog1 = json.load(urllib2.urlopen(baseUrl1 + "/" + "?token=" + token + "&f=json"))

print("ROOT")
services = catalog['services']
for service in services:
    if service['type']!= 'SteamServer':
        print("\t" + str(service['serviceName']))
        manifestUrl = baseUrl + "/" + service['serviceName'] + '.' + service['type'] + "/iteminfo/manifest/manifest.json" + "?token=" + token + "&f=json"
        dataSource = json.load(urllib2.urlopen(manifestUrl))
        print("\t\t" + dataSource['resources'][0]['onPremisePath'])
        

folders = catalog['folders']
for folderName in folders:
        if str(folderName) not in ('System', 'Utilities', 'DataStoreCatalogs'):
            print(str(folderName))
            print("________________________________________________________________________________")
            catalog = json.load(urllib2.urlopen(baseUrl + "/" + folderName + "/" + "?token=" + token + "&f=json"))
            services = catalog['services']
            for service in services:
                try:
                    print("\t" + str(service['serviceName']))
                    manifestUrl = baseUrl + "/" + str(folderName) + '/' + service['serviceName'] + '.' + service['type'] + "/iteminfo/manifest/manifest.json" + "?token=" + token + "&f=json"
                    dataSource = json.load(urllib2.urlopen(manifestUrl))
                    print("\t\t" + baseUrl + "/" + service['serviceName'] + '/' + service['type'])
                    folders1 = catalog1['folders']
                    for folderName in folders1:
                            if str(folderName) not in ('System', 'Utilities', 'DataStorecatalogs'):
                                catalog1 = json.load(urllib2.urlopen(baseUrl1 + "/" + folderName + "/" + "?token=" + token + "&f=json"))
                                services1 = catalog1['services']
                                for service in services1:
                                    if service['type'] == "FeatureServer":
                                        print("\t" + str(service['name']))
                                        print("\t\t" + baseUrl1 + "/" + service['name'] + '/' + service['type'])
                                        print("\n\n")
                    print("\t\t" + dataSource['resources'][0]['onPremisePath'])
                    print("\n\n")
                except KeyError:
                    print("KeyError: No original Document information")
                    print("!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!")
                    print("\n\n")
                    continue








#why is there no original path for services when its' not an mxd being printed out when added the fs portion?
#without the fs portion, the original path does print out
#when script encounters the keyError, it continues, but prints the fs portion first for all fservices, then prints the keyError messages, then continues the remainder of the try statement.
                
print("Script Complete")
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍