topic Re: ArcGIS Online and Arcpy in Python Questions

ArcGIS Online and Arcpy

CodyPatterson — Thu, 27 Jun 2024 19:15:04 GMT

Hey all,

I was recently given the project to put together a tool that syncs our AGOL environment to our local database and vice versa. This was already created a few years back by another employee but it recent started failing. I found that it was using arcpy.ListFields(SourceLayer) and it now shows that {AGOL_URL} does not exist or is not supported.

I attempted many ideas to get this to continue working with ArcPy, but I've been stuck for a few hours now, and have decided to look back into ArcGIS API for Python to get this completed.

My idea was to bring down the FGDB into a local file, and then use that with ArcPy, but the FGDB is 100+ GB and I cannot do this often. How should I approach this?

Any help is appreciated, thank you!

Cody

Re: ArcGIS Online and Arcpy

CodyPatterson — Thu, 27 Jun 2024 19:22:10 GMT

Code Snippet:

feature_layer_url = "https://services9.arcgis.com/{identifier}/arcgis/rest/services/{Layer}/FeatureServer/{LayerNum}?token={token}" for f in arcpy.ListFields(feature_layer_url): print(f)

Re: ArcGIS Online and Arcpy

JakeSkinner — Mon, 01 Jul 2024 13:45:33 GMT

@CodyPatterson,

Is there a unique field and edit tracking enabled? I would recommend creating a script that:

queries the features that were edited in the last day using the last_edited_date field and download those features using Export Features
create a list of downloaded features using the unique field
delete these features from the local database
append the downloaded features to the local database

Be sure your script uses arcpy.SignIntoPortal and you can access the URL of the service without generating a token.

Re: ArcGIS Online and Arcpy

CodyPatterson — Mon, 01 Jul 2024 13:53:10 GMT

Hey @JakeSkinner

Thank you for the suggestions, unfortunately the issue persists with the Export Features, it still states that it does not exist or is not supported. This is equipped with a unique field along with edit tracking so I'm not entirely sure what the main issue is.

Since this project is somewhat urgent, I ended up just redesigning all the ArcPy functions that were present into ArcGIS API for Python functions, and made this using custom query methods.

If you have any further suggestions I will surely try them, as I enjoy using ArcPy much more than ArcGIS API for Python.

Cody

Re: ArcGIS Online and Arcpy

JakeSkinner — Mon, 01 Jul 2024 13:59:01 GMT

@CodyPatterson did you include arcpy.SignIntoPortal? Ex:

arcpy.SignIntoPortal('https://www.arcgis.com', 'agolAdmin', 'gis12345') feature_layer_url = "https://services9.arcgis.com/{identifier}/arcgis/rest/services/{Layer}/FeatureServer/{LayerNum}" for f in arcpy.ListFields(feature_layer_url): print(f)

Re: ArcGIS Online and Arcpy

CodyPatterson — Mon, 01 Jul 2024 14:40:57 GMT

Hey @JakeSkinner

That was present and I confirmed that the credentials were working for login, that unfortunately did not change the outcome.

Cody

Re: ArcGIS Online and Arcpy

JakeSkinner — Mon, 01 Jul 2024 14:58:00 GMT

Can you share the feature service to an AGOL group and invite my user account (jskinner_rats)? I can take a look.

Re: ArcGIS Online and Arcpy

CodyPatterson — Mon, 01 Jul 2024 20:43:31 GMT

Hey @JakeSkinner

The feature layer I'm working with is proprietary and cannot be shared out to the public unfortunately, I've created a separate feature layer, which experiences the same issue.

Here's what I see:

Cody

Re: ArcGIS Online and Arcpy

JakeSkinner — Mon, 01 Jul 2024 21:01:19 GMT

@CodyPatterson try specifying the index number in the Feature Service URL (i.e. /FeatureServer/0).

Re: ArcGIS Online and Arcpy

CodyPatterson — Tue, 02 Jul 2024 19:06:41 GMT

Hey @JakeSkinner

I came up with the same error, did yours end up going through?

Cody

Re: ArcGIS Online and Arcpy

JakeSkinner — Tue, 02 Jul 2024 19:36:39 GMT

@CodyPatterson,

Yes, this worked for me:

Re: ArcGIS Online and Arcpy

CodyPatterson — Wed, 03 Jul 2024 11:15:01 GMT

Hey @JakeSkinner

That is extremely strange, not entirely sure what I'm doing wrong, but I suppose I'll just make a support ticket regarding it. I log into AGOL with these credentials and I'm responding to you currently with them, there is no reason that it shouldn't work, but for some reason it isn't. Thank you for your continual responses and suggestions, but I'll respond with updates that support hands out!

Edit:

I attempted to copy exactly what you had, I'm not sure where your function came from that had the underscore, mine only worked with the .managment.MakeFeatureLayer(), but I printed the Sign In, and it showed me the token, referrer, and expiry without issue, but still stated it did not exist.

Cody

Re: ArcGIS Online and Arcpy

CodyPatterson — Wed, 10 Jul 2024 12:54:22 GMT

Hey @JakeSkinner

A little update, it seems that this is associated with BUG-000144037 and seems inconsistent, an ESRI tech stated that they were able to replicate the issue and not replicate the issue depending on the day. This seems as if it was classified as a Known Limit, which I assume means it will not be further worked on, but I am confused on how this falls out of ESRI reach as it is ArcPy, an ESRI tool, and ArcGIS API for Python, again an ESRI tool, contacting ArcGIS Online, which is yet again an ESRI tool. I'm asking for clarification within the ticket, but it seems as if this is just something quite strange.

Cody