topic Batch Export ALL Data From Organization on ArcGIS Online in ArcGIS Online Questions

Batch Export ALL Data From Organization on ArcGIS Online

DanielYaw_Jr__GISP — Mon, 12 Feb 2018 20:43:34 GMT

Most of my organizations data now resides on ArcGIS Online. I am looking for a way to batch download all of that data (or even a batch of selected datasets) all at once as file geodatabases or into a single file geodatabase.

I want to try to do this on a regular basis to have a backup of our data.

Does anyone know how to accomplish this or if I could use modelbuilder to do this?

Thanks!#

Re: Batch Export ALL Data From Organization on ArcGIS Online

Lake_Worth_BeachAdmin — Tue, 13 Feb 2018 18:15:25 GMT

without diving too deep into the analysis... pretty sure this can be done with the Python API

Re: Batch Export ALL Data From Organization on ArcGIS Online

KellyGerrow — Wed, 21 Feb 2018 00:07:57 GMT

HI Daniel,

Are you looking to keep updated local copies of each feature service as a pure back up or are you looking to keep updated datasets both in ArcGIS Online and in your local system.

You can definitely look into scripting a daily back up of all of your features, using the python API or rest API calls:

Create Replica—ArcGIS REST API: Services Directory | ArcGIS for Developers

Export Item—ArcGIS REST API: Users, groups, and content | ArcGIS for Developers

If you are looking to keep up to date datasets in both ArcGIS Online and ArcGIS Enterprise, I would suggest looking into the collaboration functionality that is currently available through the Early Adopters Community. This is an automated way to maintain copies of datasets across different WebGIS infrastructure:

Distributed collaboration—ArcGIS Online Help | ArcGIS

-Kelly

Re: Batch Export ALL Data From Organization on ArcGIS Online

DanielYaw_Jr__GISP — Wed, 21 Feb 2018 21:54:28 GMT

Thanks Kelly- we're looking to bulk export all items, doing a regular backup.
I do see that that can be done for individual datasets, but is there a way to do it with all datasets?

Thanks!

Re: Batch Export ALL Data From Organization on ArcGIS Online

KellyGerrow — Thu, 22 Feb 2018 23:18:58 GMT

Hi Daniel,

You would need to write a script to export all of your items or look into collaboration.

-Kelly

Re: Batch Export ALL Data From Organization on ArcGIS Online

DavidRunneals2 — Fri, 07 Jun 2019 15:31:09 GMT

In regards to applications, I think I've figured out that I can just export these 2 jsons: https://ORG.maps.arcgis.com/sharing/rest/content/items/ITEMID and https://ORG.maps.arcgis.com/sharing/rest/content/items/ITEMID/data to get most of the configuration data for each item. The big question I have for you Kelly Gerrow, is there a way to reimport the jsons relatively easily? I suppose we'd have to re-attach map ids and maybe reconfigure the maps, but the configurations of the maps/apps/services should be relatively good.

Re: Batch Export ALL Data From Organization on ArcGIS Online

LynnOvertree — Thu, 19 Sep 2019 00:08:52 GMT

I found a workaround that will help me download a batch of feature layers to a geodatabase. It is not exactly what you are trying to do, but might be useful in some cases, especially if you are not a developer. Basically, it entails bringing your online files into a map in an ArcGIS Project, then importing them into the project geodatabase. Now you have your feature layers on your computer. Here are the more detailed steps and options:

Create a new ArcGIS Pro Project
Create a new Map within the Project
Go to Catalog window
Choose Portal at top
Bring into your map all the ArcGIS Online feature layers that you want to download
Go to the Catalog window again
Choose Project at top
Go to Databases folder and click arrow to open it
Create a geodatabase saved to the offline location where you want to download the feature layers (or use the geodatabase that is automatically created in the project)
Right click on the geodatabase
Select "Import"
Select "Feature Classes"
Pull down arrow from first entry box and choose a feature layer from your map that you want to download
Pull down arrow from second entry box and choose the second feature layer you want to download
Continue for as many as you want to download at one time into your geodatabase
Select "Run"

Note, for more structure, you can create Feature Datasets within your Geodatabase before you start importing feature classes and this will allow you to import your feature layers into logical sets.

This is much faster than converting one feature layer at a time to a shapefile, downloading it, unzipping it, and importing it into the geodatabase. Hope it is helpful to others.

Lynn

Re: Batch Export ALL Data From Organization on ArcGIS Online

Anonymous User — Mon, 09 Dec 2019 15:14:27 GMT

THANKS! This probably just saved me 30 minutes per week. I just created a "Backup" ArcGIS Pro Project and inserted all of the web-based feature layers I need to back up into one map. A couple clicks later, I had all of my data backed up. I had been exporting each feature layer individually.