topic Re: How to sync a hosted feature layer from ArcMap? in ArcGIS Online Questions

How to sync a hosted feature layer from ArcMap?

MatthewBaker2 — Fri, 13 May 2016 22:17:16 GMT

I'm trying to set up a process to keep hosted feature layers in sync from a FGDB.

I've been going through various documentation, such as this article:

Manage hosted web layers—ArcGIS Online Help | ArcGIS

...but it leaves me at:

It was published from a client other than the ArcGIS Online website. If you published the hosted feature layer from ArcMap, overwrite the service from ArcMap.

So how do you overwrite the service from ArcMap?

I'd like to make the service name remains the same, as it will be in use from a javascript application.

So far I can use the 'upload service definition' tool in ArcGIS Desktop, but I don't see anywhere an option to sync or update the data in a service from an ArcMap tool.

Thanks!

Re: How to sync a hosted feature layer from ArcMap?

PanagiotisPapadopoulos — Sat, 14 May 2016 00:02:18 GMT

from your ArcMap open the mxd with the data from FGDB and publish the service on your Organization account

select overwrite service on the next form

and select the hosted service you want to overwrite

by doing this the FGDB transferred again in order to recreate the hosted service. After then the new data will be available to AGOL.

Re: How to sync a hosted feature layer from ArcMap?

MatthewBaker2 — Mon, 16 May 2016 14:20:32 GMT

Is there any way to do this from either model builder via GP tools, or with Python?

Re: How to sync a hosted feature layer from ArcMap?

BruceHarold — Mon, 16 May 2016 14:34:26 GMT

Yes, but it would be a coding challenge.

I have been using Data Interoperability extension in ArcGIS Pro 1.2 to read and write feature services.

This release has good support for feature services, and you can use the ChangeDetector (for example) to create a delta set of features to overwrite, without any downtime or bulk overwrite, treating your FGDB as the master database.

The fme_db_operation format parameter can be used to control INSERT/UPDATE/DELETE behavior if you have a mixture, or the writer settings.

Re: How to sync a hosted feature layer from ArcMap?

MatthewBaker2 — Tue, 17 May 2016 16:35:17 GMT

Bruce, I think this will be the solution. It is slow (to truncate, especially) but it is what I need.

Thank you!

Re: How to sync a hosted feature layer from ArcMap?

BruceHarold — Tue, 17 May 2016 19:32:34 GMT

Matthew, we'll look into truncate performance, it should be using a delete with where clause OBJECTID > 0.

Re: How to sync a hosted feature layer from ArcMap?

MatthewBaker2 — Tue, 17 May 2016 19:53:30 GMT

Thanks, Bruce! I'd be happy to provide feedback as I build this processes.

I'll be pulling from SQL Server Spatial views and writing them to the staging FGDB before truncating and loading with FME... will be using point and polygon data for this.

-m

Re: How to sync a hosted feature layer from ArcMap?

BruceHarold — Wed, 18 May 2016 20:11:19 GMT

If you're making a FGDB (with Data Interop or FME) it can be a zipfile that is output and if you upload/replace that as a portal item and publish it with overwrite.

I started down the path of this with a Pro script tool (attached) but we'll look into supporting it without coding in Data Interop/FME.

Re: How to sync a hosted feature layer from ArcMap?

MatthewBaker2 — Wed, 18 May 2016 21:54:54 GMT

One thing that's happening is the service I'm trying to publish constantly hangs when uploading it for the first time on the 'Server-side post processing' in ArcCatalog, and the 'Creating Service' spinning icon on AGOL...

The data is <30mb...

Oh scratch that - it just finished... took almost an hour though!

Re: How to sync a hosted feature layer from ArcMap?

BruceHarold — Wed, 18 May 2016 22:11:41 GMT

That is why I publish from an uploaded FGDB item for large datasets. I have published services with millions of features that way; publishing from a map has failed for me on occasion. The asynchronous nature of publication also isn't a good fit inside a desktop application - for big data. I have waited overnight for some to publish, but they always succeeded.

Re: How to sync a hosted feature layer from ArcMap?

MatthewBaker2 — Thu, 19 May 2016 20:36:37 GMT

I've now set up to publish from a FGDB to a new AGOL service, and while it takes ~4min to successfully upload the data, the 'creating service' icon hangs and hangs and hangs on the arcgis.com side of things.

Trying to T&L the data always throws a fit about something, but I'll give it a few more shots before I contact support, etc...

Thanks, Bruce!

Re: How to sync a hosted feature layer from ArcMap?

BruceHarold — Thu, 19 May 2016 22:36:44 GMT

"T&L"? Services can take hours to publish. If you took a look at my tool you'll notice it lets you set the projection and maxRecordCount for the service. If you care about projection properties in your client app do control that. maxRecordCount affects pagination, too big and you can get timeouts, stick with 2000 if you want to be safe.