Exporting multiple Web Feature Layers as Geodatabase

ScottWagoner — Fri, 10 Dec 2021 21:12:29 GMT

I have been working on this python script and I cannot figure out why it is not working. I have about 15 Web Feature Layers I want to regularly export to individual geodatabases then download them using the script. If I try to just download them it returns a 1kb zip file. So after looking online for a solution a ran across this one:Download feature service as file geodatabase

It worked great for 1 file, but like I said, I have 15 I would like to regularly download. so I spent some time tweaking that and come up with this code:

import time
import os
import zipfile
import arcgis.gis
from zipfile import ZipFile

# *** modify these four lines ***
outputFolder = r"OUTPUT"  # where the GDB will be extracted to
gis = arcgis.GIS("URL",
                 "USER", "PASS")  # replace these with your credentials
item_id = ["ID1", "ID2", ......]
GDBname = ["MULTIPLE_NAMES"]
for i in range(len(item_id)):
    AGOLitem = gis.content.get(item_id)

    print("Exporting Hosted Feature Layer...")
    AGOLitem.export(GDBname, 'File Geodatabase', parameters=None, wait='True')
    time.sleep(10)  # add 10 seconds delay to allow export to complete

    search_fgb = gis.content.search(query="title:{}*".format(GDBname))  # find the newly created file geodatabase in ArcGIS online
    fgb_item_id = search_fgb[0].id
    fgb = gis.content.get(fgb_item_id)
    fgb.download(save_path=outputFolder)  # download file gdb from ArcGIS Online to your computer
    print("Zipping exported geodatabase for download...")

    '''while statement runs until a valid zipped file is created'''
    # randomly the output is a 1 KB file that is not a valid zipped file.
    # The while statement forces a valid zipped file to be created.
    zipfullpath = os.path.join(outputFolder, GDBname + ".zip")  # full path to the zipped file once it is downloaded to your computer
    while zipfile.is_zipfile(zipfullpath) is False:
        fgb.download(save_path=outputFolder)
    zf = ZipFile(os.path.join(outputFolder, GDBname + ".zip"))

    '''deleting hosted File Geodatabase'''
    # NOTE: This will delete the temporary File Geodatabase in ArcGIS Online
    print("Deleting "+fgb.title+"("+fgb.type+")"+" from ArcGIS Online...")
    fgb.delete()


print("Done!")

When I run this it gets to zipping exported geodatabase then it gets hung up. In the folder it is supposed to save to, I have either a service definition or just a file with the original file name (So if the name online is "Features_for_you" but GDBname should have been "New_Features" I will get a file with the name: "Features_for_you".

Things I have tried:

I thought maybe I wasn't waiting long enough for the export, so I extended the sleep to 200 seconds just to test. Same result
I have 2 text files, one with the id and one with the GDBname. Instead of a long list I had:
- item_id=open("id.text").read().splitlines()
- GDBname=open("id.text").read().splitlines()

I do have another log-in that I use. I upload some smaller test data and ran the exact same script with only 3 Feature Layers and it worked just fine.

The only difference between the live data and the test data is the live data has a ton of information: I believe each Feature layer has 4 - 10 layers and each individual layer has 40 -70 fields with domains all over the place.

Any reason my script isn't work properly?

Re: Exporting multiple Web Feature Layers as Geodatabase

spenniken — Tue, 04 Apr 2023 08:22:59 GMT

I've had to do the same thing, and had success with the following script. Hope it at least points you in the right direction.

from arcgis.gis import GIS portal_url = r"https://www.arcgis.com/" gis = GIS(portal_url,'username', 'password') print("Connected to AGOL & Authenticated") #Add the list of item IDs separated with a comma featureService_ID = ['0bb9e555d84d4dafbb0a1c04f80e3f7b', 'fc22d7ee7dd1555eab5d7886f9381807', '782f2c16c6555de0a2dfb7ba13f79c97', '76e065a555dd427ea63d8646d4f53567'] download_folder = r"C:\Users\user\path" title = 'FLBackup' unsuccessful = 0 for i in featureService_ID: try: item = gis.content.get(i) exportedData = item.export(title+'_'+i,export_format="File Geodatabase") exportedData.download(download_folder) exportedData.delete() print(f'Downloaded {item.title} ({i}) successfully, and fgdb deleted in AGOL') except: unsuccessful += 1 print(f'Item {item.title} ({i}) failed to export') print(f'\n{len(featureService_ID)-unsuccessful} items were successfully downloaded to fgdbs.\nUnsuccessful: {unsuccessful}.')

topic Exporting multiple Web Feature Layers as Geodatabase in Python Questions

Exporting multiple Web Feature Layers as Geodatabase

Re: Exporting multiple Web Feature Layers as Geodatabase