topic Re: Python Script Using ArcGIS Online Credentials in Python Questions

Python Script Using ArcGIS Online Credentials

ISP_graynic — Tue, 09 Aug 2016 13:41:35 GMT

I have a basic python script that takes a hosted feature service from ArcGIS Online and converts it to an excel (.xls) file. The only problem is, I need to sign-in to ArcGIS Online within ArcMap to get the script to run, since the feature service is only shared with my organization. Is there any way to store my credentials within the script so that it will run on a daily basis without me having to sign-in on ArcMap every time? Any help is greatly appreciated. Thank you!

Re: Python Script Using ArcGIS Online Credentials

JamesCrandall — Tue, 09 Aug 2016 14:09:31 GMT

We are not running in ArcGIS Desktop, but we execute a python script from Windows Task Scheduler that updates a hosted Feature Service on our AGOL org account. I suppose you'd just need to grab the token by making calls against the REST API.

It'd help to see what your script is doing.

We used the majority of this https://blogs.esri.com/esri/arcgis/2014/01/24/updating-your-hosted-feature-service-for-10-2/ article to implement. Again, it's just authenticating directly with the ArcGIS.com REST API.

Re: Python Script Using ArcGIS Online Credentials

JakeSkinner — Sun, 12 Dec 2021 07:46:15 GMT

Hi Nicholas,

You can generate a token using the following script:

import urllib, urllib2, json

username = "abcd"
password = "1234"

tokenURL = 'https://www.arcgis.com/sharing/rest/generateToken'
params = {'f': 'pjson', 'username': username, 'password': password, 'referer': 'http://www.arcgis.com'}
req = urllib2.Request(tokenURL, urllib.urlencode(params))
response = urllib2.urlopen(req)
data = json.load(response)
token = data['token']

You can then append the token onto the feature service URL. Ex:

damageAssessmentURL = 'http://services.arcgis.com/Fz6BBJUji5USDM/arcgis/rest/services/Damage_Assessment/FeatureServer/0/query'
where = "PropertyType = 'Single Dwelling Houses'"
params = {'f': 'pjson', 'where': where, 'returnCountOnly': 'true', 'token': token}
req = urllib2.Request(damageAssessmentURL, urllib.urlencode(params))
response = urllib2.urlopen(req)
data = json.load(response)

Re: Python Script Using ArcGIS Online Credentials

ISP_graynic — Tue, 09 Aug 2016 19:29:01 GMT

Here is the simple code below that I am trying to generate and add the token too.

import arcpy,

SE_Test_xls = "I:\\Documents\\SE_Test.xls"

# Process: Table To Excel

arcpy.TableToExcel_conversion(SpecialEvents, SE_Test_xls, "NAME", "CODE")

Re: Python Script Using ArcGIS Online Credentials

ISP_graynic — Tue, 09 Aug 2016 19:38:12 GMT

Thank you for the help James. My script is a real basic model I exported from Model Builder as a python script.

# Import arcpy module

import arcpy

# Local variables:

SpecialEvents = "SpecialEvents\\SpecialEvents"

SE_Test_xls = "I:\\Documents\\SE_Test.xls"

# Process: Table To Excel

arcpy.TableToExcel_conversion(SpecialEvents, SE_Test_xls, "NAME", "CODE")

I have replied to Jake's response with what I am trying based on his comment, but don't believe I am doing it right.

Re: Python Script Using ArcGIS Online Credentials

JakeSkinner — Tue, 09 Aug 2016 19:58:09 GMT

I don't believe you will be able to export a feature service to an excel table using the Table to Excel tool. What you could do is export the feature service to a local File Geodatabase and then export the feature class to excel. Here is a tool you can use to export the feature service.

Re: Python Script Using ArcGIS Online Credentials

ISP_graynic — Tue, 09 Aug 2016 20:17:33 GMT

Thank you Jake. Is an ArcGIS Standard License needed for this script to run?

Re: Python Script Using ArcGIS Online Credentials

JakeSkinner — Tue, 09 Aug 2016 20:27:17 GMT

Actually, only if you are downloading attachments. I'll need to update this tool to reflect this. You can do this by opening up the .py file and deleting lines 4-9. It should then work as long as you are not extracting attachments.

Re: Python Script Using ArcGIS Online Credentials

ISP_graynic — Tue, 09 Aug 2016 20:44:57 GMT

Awesome. It still said it was successful but was aborting because it wasn't a Standard License. When I took those lines out it works perfectly. Thank you so much for the help. This tool is great!!!

Re: Python Script Using ArcGIS Online Credentials

ISP_graynic — Fri, 12 Aug 2016 16:31:56 GMT

I have one more question for you Jake. I got the script to work without downloading attachments. But when I run it to download attachments, I get the following error. I checked the feature class and the "GlobalID_Str" gets created, but it sounds like it's having trouble finding it.

Traceback (most recent call last):

File "C:\Users\Downloads\TEST Attachments.py", line 194, in <module>

for row in cursor:

RuntimeError: A column was specified that does not exist.

Re: Python Script Using ArcGIS Online Credentials

JakeSkinner — Fri, 12 Aug 2016 16:34:45 GMT

I would have to take a look at the service to see what's going on. If you want, you can share the service to a group in AGOL and invite my user account (jskinner_CountySandbox) to it.

Re: Python Script Using ArcGIS Online Credentials

ISP_graynic — Fri, 12 Aug 2016 16:43:42 GMT

Ok, thanks. I have invited you to a group to check out the service. When I remove the code below from the script, the script will run and it downloads the attachments and puts them in a folder, but the GlobalID_Str field is empty as well as the entire attachment table created is empty.

for key in dict:

with arcpy.da.UpdateCursor(fc, [OID, "GlobalID_Str"], OID + " = " + str(key)) as cursor:

for row in cursor:

row[1] = dict[key]

cursor.updateRow(row)

Re: Python Script Using ArcGIS Online Credentials

JakeSkinner — Fri, 12 Aug 2016 19:16:06 GMT

You OBJECTID field in AGOL is OBJECTID_1, but when you download the data it's converted back to OBJECTID.
You can change the code to fix this. Open the .py file in a text editor and under line 340 add the following:

OID = "OBJECTID"

Ex:

Re: Python Script Using ArcGIS Online Credentials

ISP_graynic — Mon, 15 Aug 2016 21:27:05 GMT

Is there anyway to specify the output name of the file where the attachments are stored? Right now each image is being output as a separate folders using a variation of the GlobalID for a name. I'd like to have it output with just the file name. Thanks!

Re: Python Script Using ArcGIS Online Credentials

JakeSkinner — Tue, 16 Aug 2016 12:40:30 GMT

The folder with the global id name is needed in order to successfully join the attachments to the feature class.