Updating a Feature Service with Data available via URL with Truncate and Append

[Stephanie_Shaw]

Previously I used model builder (ran in ArcGIS Pro not on AGOL) to replace the content of several feature services using truncate and append w/ update geometry. However, every version change of ArcGIS Pro would break my tool. Sometimes even after repairing the model the update geometry toggle box would not be present. I was told to check out pipeline however the truncate and append tools are not available. The steps I would like to perform are as follows: 

1) download data as a zip file from source https://gis.xyzxyzxy.com/Downloads/data/GDB/xxxxx_Export.zip 

The source contains a gdb with 5 feature classes inside, I call this NEW DATA (Addresses, Parcels, Lots, Blocks, Subdivisions)

2) Unzip the new data

3) Input existing addresses (stored on my AGOL account)

4) Compare the existing addresses schema to the new addresses schema and repair if needed.

5) Tools: Truncate the existing addresses feature service (so only schema is saved) and append (with data from the downloaded gdb)

6) Output is the existing addresses feature service with both attributes and geometry updated from the new feature class from the gdb.

7) Repeat steps for updating the other 4 feature services.

[BethanyScott]

Hi @Stephanie_Shaw, thank you for reaching out.

I believe this workflow should be possible in ArcGIS Data Pipelines. To be sure, I have some clarifying notes regarding your workflow:

1. Data Pipelines does not support zip files from URLs. It sounds like you're already doing it, but to be clear, you will need to manually download the GDB and upload it to your content. 
   
   
2. Data Pipelines supports truncate and append using the Replace output method available in the output Feature layer tool. The Replace output method will:
   • Maintain the schema of the layer you are updating. Replace does not add, remove, or modify fields for an existing feature layer.
   • Remove all existing records, including both attributes and geometries (this is the truncate).
   • Add all records from your new dataset (this is the append).
     
     
3. For step 3:
   • If you need to update the schema of an existing feature layer, the only way to do that using Data Pipelines is to use the Overwrite output method. This will completely delete the existing layer, create a new one with the schema of the new dataset, and then load in the new records (attributes and geometries).
   • Alternatively, if you just need to quickly update the field names or types of the new dataset to match that of the old layer you want to update, you can use the Map fields tool.

Please let me know if you have any other questions or if I've missed something regarding your workflow.

Thanks again,

Bethany