AnsweredAssumed Answered

How to sync a hosted feature layer from ArcMap?

Question asked by mbakerDPS on May 13, 2016
Latest reply on May 19, 2016 by bharold-esristaff

Like • Show 0 Likes0
Comment • 11

I'm trying to set up a process to keep hosted feature layers in sync from a FGDB.

I've been going through various documentation, such as this article:

Manage hosted web layers—ArcGIS Online Help | ArcGIS

...but it leaves me at:

It was published from a client other than the ArcGIS Online website. If you published the hosted feature layer from ArcMap, overwrite the service from ArcMap.

So how do you overwrite the service from ArcMap?

I'd like to make the service name remains the same, as it will be in use from a javascript application.

So far I can use the 'upload service definition' tool in ArcGIS Desktop, but I don't see anywhere an option to sync or update the data in a service from an ArcMap tool.

Thanks!

bharold-esristaff

May 16, 2016 7:35 AM

Correct Answer

Yes, but it would be a coding challenge.

I have been using Data Interoperability extension in ArcGIS Pro 1.2 to read and write feature services.

This release has good support for feature services, and you can use the ChangeDetector (for example) to create a delta set of features to overwrite, without any downtime or bulk overwrite, treating your FGDB as the master database.

The fme_db_operation format parameter can be used to control INSERT/UPDATE/DELETE behavior if you have a mixture, or the writer settings.

See the reply in context

No one else had this question

Outcomes

ppapadopoulosmarathondata-gr-esridist

May 13, 2016 5:06 PM

from your ArcMap open the mxd with the data from FGDB and publish the service on your Organization account

select overwrite service on the next form

and select the hosted service you want to overwrite

by doing this the FGDB transferred again in order to recreate the hosted service. After then the new data will be available to AGOL.

3 people found this helpful

Actions

mbakerDPS @ ppapadopoulosmarathondata-gr-esridist on May 16, 2016 7:20 AM

Is there any way to do this from either model builder via GP tools, or with Python?

Actions

bharold-esristaff

@ mbakerDPS on May 16, 2016 7:35 AM

Yes, but it would be a coding challenge.

I have been using Data Interoperability extension in ArcGIS Pro 1.2 to read and write feature services.

The fme_db_operation format parameter can be used to control INSERT/UPDATE/DELETE behavior if you have a mixture, or the writer settings.

Actions

mbakerDPS @ bharold-esristaff on May 17, 2016 9:35 AM

Bruce, I think this will be the solution. It is slow (to truncate, especially) but it is what I need.

Thank you!

Actions

bharold-esristaff

@ mbakerDPS on May 17, 2016 12:32 PM

Matthew, we'll look into truncate performance, it should be using a delete with where clause OBJECTID > 0.

Actions

mbakerDPS @ bharold-esristaff on May 17, 2016 12:53 PM

Thanks, Bruce! I'd be happy to provide feedback as I build this processes.

I'll be pulling from SQL Server Spatial views and writing them to the staging FGDB before truncating and loading with FME... will be using point and polygon data for this.

-m

Actions

bharold-esristaff

May 18, 2016 1:11 PM

If you're making a FGDB (with Data Interop or FME) it can be a zipfile that is output and if you upload/replace that as a portal item and publish it with overwrite.

I started down the path of this with a Pro script tool (attached) but we'll look into supporting it without coding in Data Interop/FME.

Attachments

PublishFeatureLayer.zip6.2 KB

Actions

mbakerDPS @ bharold-esristaff on May 18, 2016 2:57 PM

One thing that's happening is the service I'm trying to publish constantly hangs when uploading it for the first time on the 'Server-side post processing' in ArcCatalog, and the 'Creating Service' spinning icon on AGOL...

The data is <30mb...

Oh scratch that - it just finished... took almost an hour though!

Actions

bharold-esristaff

May 18, 2016 3:23 PM

That is why I publish from an uploaded FGDB item for large datasets. I have published services with millions of features that way; publishing from a map has failed for me on occasion. The asynchronous nature of publication also isn't a good fit inside a desktop application - for big data. I have waited overnight for some to publish, but they always succeeded.

Actions

mbakerDPS @ bharold-esristaff on May 19, 2016 1:36 PM

I've now set up to publish from a FGDB to a new AGOL service, and while it takes ~4min to successfully upload the data, the 'creating service' icon hangs and hangs and hangs on the arcgis.com side of things.

Trying to T&L the data always throws a fit about something, but I'll give it a few more shots before I contact support, etc...

Thanks, Bruce!

Actions

bharold-esristaff

May 19, 2016 3:36 PM

"T&L"? Services can take hours to publish. If you took a look at my tool you'll notice it lets you set the projection and maxRecordCount for the service. If you care about projection properties in your client app do control that. maxRecordCount affects pagination, too big and you can get timeouts, stick with 2000 if you want to be safe.

Actions

11 Replies

ppapadopoulosmarathondata-gr-esridist May 13, 2016 5:06 PM
Mark Correct
Correct Answer
from your ArcMap open the mxd with the data from FGDB and publish the service on your Organization account

select overwrite service on the next form
and select the hosted service you want to overwrite

by doing this the FGDB transferred again in order to recreate the hosted service. After then the new data will be available to AGOL.
3 people found this helpful
Like • Show 0 Likes0
Actions
- mbakerDPS @ ppapadopoulosmarathondata-gr-esridist on May 16, 2016 7:20 AM
  Mark Correct
  Correct Answer
  Is there any way to do this from either model builder via GP tools, or with Python?
  Like • Show 0 Likes0
  Actions
  - bharold-esristaff @ mbakerDPS on May 16, 2016 7:35 AM
    Unmark Correct
    Correct Answer
    Yes, but it would be a coding challenge.
    I have been using Data Interoperability extension in ArcGIS Pro 1.2 to read and write feature services.
    This release has good support for feature services, and you can use the ChangeDetector (for example) to create a delta set of features to overwrite, without any downtime or bulk overwrite, treating your FGDB as the master database.
    The fme_db_operation format parameter can be used to control INSERT/UPDATE/DELETE behavior if you have a mixture, or the writer settings.
    Like • Show 0 Likes0
    Actions
    - mbakerDPS @ bharold-esristaff on May 17, 2016 9:35 AM
      Mark Correct
      Correct Answer
      Bruce, I think this will be the solution. It is slow (to truncate, especially) but it is what I need.
      
      Thank you!
      Like • Show 0 Likes0
      Actions
      - bharold-esristaff @ mbakerDPS on May 17, 2016 12:32 PM
        Mark Correct
        Correct Answer
        Matthew, we'll look into truncate performance, it should be using a delete with where clause OBJECTID > 0.
        Like • Show 0 Likes0
        Actions
        mbakerDPS @ bharold-esristaff on May 17, 2016 12:53 PM
        Mark Correct
        Correct Answer
        Thanks, Bruce! I'd be happy to provide feedback as I build this processes.
        
        I'll be pulling from SQL Server Spatial views and writing them to the staging FGDB before truncating and loading with FME... will be using point and polygon data for this.
        
        -m
        Like • Show 0 Likes0
        Actions
bharold-esristaff May 18, 2016 1:11 PM
Mark Correct
Correct Answer
Hi

If you're making a FGDB (with Data Interop or FME) it can be a zipfile that is output and if you upload/replace that as a portal item and publish it with overwrite.
I started down the path of this with a Pro script tool (attached) but we'll look into supporting it without coding in Data Interop/FME.
Attachments
- PublishFeatureLayer.zip6.2 KB
Like • Show 0 Likes0
Actions
- mbakerDPS @ bharold-esristaff on May 18, 2016 2:57 PM
  Mark Correct
  Correct Answer
  One thing that's happening is the service I'm trying to publish constantly hangs when uploading it for the first time on the 'Server-side post processing' in ArcCatalog, and the 'Creating Service' spinning icon on AGOL...
  
  The data is <30mb...
  
  Oh scratch that - it just finished... took almost an hour though!
  Like • Show 0 Likes0
  Actions
bharold-esristaff May 18, 2016 3:23 PM
Mark Correct
Correct Answer
That is why I publish from an uploaded FGDB item for large datasets. I have published services with millions of features that way; publishing from a map has failed for me on occasion. The asynchronous nature of publication also isn't a good fit inside a desktop application - for big data. I have waited overnight for some to publish, but they always succeeded.
Like • Show 0 Likes0
Actions
- mbakerDPS @ bharold-esristaff on May 19, 2016 1:36 PM
  Mark Correct
  Correct Answer
  I've now set up to publish from a FGDB to a new AGOL service, and while it takes ~4min to successfully upload the data, the 'creating service' icon hangs and hangs and hangs on the arcgis.com side of things.
  
  Trying to T&L the data always throws a fit about something, but I'll give it a few more shots before I contact support, etc...
  
  Thanks, Bruce!
  Like • Show 0 Likes0
  Actions
bharold-esristaff May 19, 2016 3:36 PM
Mark Correct
Correct Answer
"T&L"? Services can take hours to publish. If you took a look at my tool you'll notice it lets you set the projection and maxRecordCount for the service. If you care about projection properties in your client app do control that. maxRecordCount affects pagination, too big and you can get timeouts, stick with 2000 if you want to be safe.
Like • Show 0 Likes0
Actions

GeoNet

The Esri Community

How to sync a hosted feature layer from ArcMap?

Outcomes

Attachments

Related Content

Recommended Content