topic Re: Best approach for a workflow API Python & arcpy? in ArcGIS API for Python Questions

Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Wed, 12 Jun 2019 21:28:50 GMT

I'm trying to update our sde with a hosted feature layer.

What is the best approach for this. I'm aware of the API Python and Arcpy. I'm a little confused on how to start of this script. I have a fair amount of knowledge with arcpy and have created complex scripts with it.

The goal is that this script will run automatically or when ever I want it to. Basically I want to take a hosted feature layer that is a copy of our database and update changes that were captured in the Hosted Feature Layer back to our database.

Do I use the API for Python to connect to the Hosted feature layer or can I use Arcpy for that? Would I use both the arcgis python API and arcpy ?

Any guidance would be appreciated!

Thanks,

Adam

Re: Best approach for a workflow API Python & arcpy?

JakeSkinner — Wed, 12 Jun 2019 23:46:51 GMT

Hi Adam,

ArcGIS Pro's Feature Class to Feature Class tool will download the hosted feature class. You could create a model to download the feature class, truncate the Enterprise Geodatabase feature class, then append the downloaded feature class to the Enterprise Geodatabase feature class.

Also, here is another tool that will download a hosted feature service that works in ArcGIS Pro and ArcGIS Desktop:

https://community.esri.com/docs/DOC-6496-download-arcgis-online-feature-service-or-arcgis-server-featuremap-service

Re: Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Thu, 13 Jun 2019 01:31:19 GMT

Thanks Jake!

So there's no need to use ArcGIS API for python?

What do you mean by turncate what does this do? does this delete everything in the enterprise database? I don't think that I would want to do this, I really just want to update 1 field.

Also i tried the tool and I can't get it to create a token. We use OKTA to login into our ArcGIS online accounts. I think thats where the problem occurs, because if I make it public it works no problem.

Generating Token

URL is incorrect. Or, Service is secure, please enter username and password.

Completed script DownloadService...
Failed to execute (DownloadService).
Failed at Wed Jun 12 21:31:18 2019 (Elapsed Time: 1.12 seconds)

Any ideas ?

Re: Best approach for a workflow API Python & arcpy?

JakeSkinner — Thu, 13 Jun 2019 11:54:12 GMT

Correct, you won't need to use the ArcGIS API for Python.

Yes, a truncate will delete all features in the feature class. If you want to update a field, you could perform a join to the downloaded feature class and then a Field Calculation to calculate the values over.

The tool I shared won't be able to authenticate with Okta. It will be best to connect to ArcGIS Online in Pro and use the Feature Class to Feature Class tool to download the data.

Re: Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Thu, 13 Jun 2019 16:45:28 GMT

Yeah I got it to work that way. So to run this script I would have to log into Pro. I couldn't have this script to run automatically, say over night ?

This tool is amazing by the way!

Thanks for the share.

Re: Best approach for a workflow API Python & arcpy?

JakeSkinner — Thu, 13 Jun 2019 17:22:44 GMT

Yes, could update the #Variables at the beginning of the script. Ex:

You can then use Windows Task Scheduler to execute the script. If you can, I would see if you could create an ArcGIS Online built-in account so that you don't have to share the service with Everyone. Then you can share this service to a Group that user is a member of. That way you use these credentials to create the token and download the service.

Re: Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Fri, 26 Jul 2019 19:34:26 GMT

Jake,

I ran into this error using your tool. I can't find any info on it on. Do you have any idea whats going on ?

LINE: 292
"fs.load(fsURL)": RecordSetObject: Cannot load a table into a FeatureSet.

Re: Best approach for a workflow API Python & arcpy?

JakeSkinner — Mon, 29 Jul 2019 13:44:20 GMT

Adam Arcichowski‌ if you share the service to a Group and then invite my AGOL account (jskinner_CountySandbox) I can take a look to see what's going on.

Re: Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Tue, 30 Jul 2019 14:17:30 GMT

Thanks Jake.

But I found a work around. I just added the data with a path in arcpro

with arcpy.

Re: Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Thu, 01 Aug 2019 18:56:23 GMT

Hey Jake I've been using your tool for lots of data out there.

However I can across this error now. Do you know why? Do some datasets not allow you to download their data?

Specifally this data https://gis.bisclient.com/maps03/rest/services/RedRiverWeb/MapServer/0

Re: Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Thu, 01 Aug 2019 19:35:08 GMT

Its weird because if I type in OBJECTID < 287 it will download. But if i put anything higher than OBJECTID < 287 for example OBJECTID < 288 it will give me that load table error.

I thought this had something to do with the max record counts but when I look at the data it says 1000.

Re: Best approach for a workflow API Python & arcpy?

JakeSkinner — Fri, 02 Aug 2019 15:26:30 GMT

Adam Arcichowski‌ I think something may be corrupt with this service. If you filter the service by OBJECTID = 287, there are 2 features:

Not sure how that is occurring since you cannot have duplicate OBJECTIDs.

Re: Best approach for a workflow API Python & arcpy?

deleted-user-yC5VkbyXzrQR — Fri, 02 Aug 2019 17:26:43 GMT

Hmm weird.

They turned off their service anyways.

Re: Best approach for a workflow API Python & arcpy?

PaulSweeney3 — Fri, 05 Jun 2020 07:58:59 GMT

Hi All

I ran into the same error this morning and my feature would not download

"fs.load(fsURL)": RecordSetObject: Cannot load a table into a FeatureSet

Not sure if this has anything to do with it but the highest Object id was 4002 and the script was showing the message

Copying features with ObjectIDs from 2034 to 3034
Copying features with ObjectIDs from 3034 to 4034

Then it failed

So i used the where clause and specified the Object id to be less then or equal to the Highest object id in the table at the time and it worked as expected. I then appended some information to the table and ran it with out the query and it seems to be working fine again.