topic Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form? in ArcGIS Online Questions

How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Mon, 20 Jul 2020 20:13:55 GMT

Hello,

I have seen some work on this question on GeoNet before, but I absolutely can't get my attachments from a hosted feature layer downloaded. I have a Survey123 feature layer with a photo repeat that I have tried exporting to a file geodatabase without success. All I get is the standard 1KB file that will not unzip. I tried creating a replica without success as well; I keep getting error messages. I also tried using a notebook with script I've found on this site, but I am so new to Python, that I have not been able to get it to work. Please help!

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

Katie_Clark — Mon, 20 Jul 2020 20:36:08 GMT

To confirm, you followed this workflow to try to download the fgdb? This is the only one that's always worked for me...

How To: Download attachments from a hosted feature service

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

JakeSkinner — Tue, 21 Jul 2020 00:14:54 GMT

Hi Kaitlyn Abrahamson‌,

You can use the Feature Class to Feature Class tool in ArcGIS Pro to do this.

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Tue, 21 Jul 2020 13:03:58 GMT

This is what I followed, but I can never get a final link for download. I always run into errors like the one below.

"Error in creating runtime geodatabase."

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Tue, 21 Jul 2020 13:04:37 GMT

I can retrieve attachments stored online through my Arc Pro? How so?

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

JakeSkinner — Tue, 21 Jul 2020 14:22:18 GMT

In ArcGIS Pro, connect to your ArcGIS Online organization
Execute the Feature Class to Feature Class tool, specifying the hosted feature service as the input. You can browse to the hosted feature service. By default, Maintain Attachments is enabled in the Environments:

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Tue, 21 Jul 2020 18:15:14 GMT

Where do the attachments save? I have many photos attached to each entry.

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

JakeSkinner — Sun, 12 Dec 2021 06:29:20 GMT

The attachments will be saved to a table within a geodatabase. If you need to export the attachments to disk, you can do this using python:

import os, arcpy
tbl = r"C:\Temp\Python\Test.gdb\Graffiti__ATTACH"
fldBLOB = 'DATA'
fldAttName = 'ATT_NAME'
outFolder = r"C:\Temp\Python\Attachments"

with arcpy.da.SearchCursor(tbl,[fldBLOB,fldAttName]) as cursor:
   for row in cursor:
      binaryRep = row[0]
      fileName = row[1]
      # save to disk
      open(outFolder + os.sep + fileName, 'wb').write(binaryRep.tobytes())

print('Finished')‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Wed, 22 Jul 2020 21:50:37 GMT

Please forgive my novice, but do you do this in ArcGIS Pro, in the feature class to feature class tool? As in a new SQL expression? I really am not sure how to apply this script.

Do I need to replace these? "fldBLOB,fldAttName" What do they stand for?

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

JakeSkinner — Sun, 12 Dec 2021 06:29:22 GMT

1. You can execute the Feature Class to Feature Class by specifying the hosted feature service as your input:

2. This will create a feature class and attachment table in your geodatabase:

3. Select the __ATTACH table in the Contents pane and under the Map tab in ArcGIS Pro, select the option Copy Path:

4. Update the tbl in the python script with this path in a text editor (i.e. Notepad, Notepad++). Also, update the outFolder variable with the path to where you would like to store the attachments:

import os, arcpy
tbl = r"C:\Temp\Default.gdb\PropertyDamage__ATTACH"
fldBLOB = 'DATA'
fldAttName = 'ATT_NAME'
outFolder = r"C:\Temp\Python\Attachments"

with arcpy.da.SearchCursor(tbl,[fldBLOB,fldAttName]) as cursor:
   for row in cursor:
      binaryRep = row[0]
      fileName = row[1]
      # save to disk
      open(outFolder + os.sep + fileName, 'wb').write(binaryRep.tobytes())

print('Finished')‍‍‍‍‍‍‍‍‍‍‍‍‍‍

5. In ArcGIS Pro, select the Analysis tab and click Python:

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Thu, 23 Jul 2020 14:19:45 GMT

Thank you for such a detailed guide. Do you have to run it? I'm not sure how. I thought you just had to hit enter, but nothing shows up in my output folder. Will this automatically update if I add records?

Once again, thank you for putting up with my naivety with Python.

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

JakeSkinner — Fri, 24 Jul 2020 11:22:55 GMT

Somehow my additional steps were cutoff. After you open the Python window in ArcGIS Pro, you can copy/paste the updated code with your directory paths into the section Enter python code here. Click Enter a couple times and it should execute the code.

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

RachelGugler — Mon, 28 Sep 2020 19:18:48 GMT

I successfully retrieved photos using this script, but they don't appear to be georeferenced. We are trying to decipher if that is because of the security software on the iPad used to collect the data prevented this from being captured, it isn't collected as exif photo data by QuickCapture (the program we used for this collection), or if it gets stripped away during the downloading process. All the other exif data appeared to be intact. Is it possible to get georeferenced photos from AGOL?

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Tue, 29 Sep 2020 17:34:59 GMT

I was able to create a replica, but I'm not sure where the photos are actually saved, let alone the sketches from our Survey123 crew in the field are. How do I access the actual photos and know which points they belong to?

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

Katie_Clark — Tue, 29 Sep 2020 20:00:12 GMT

So do you have the data within a file geodatabase? If so, there should be an attachments table that will contain the photo data.

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Tue, 29 Sep 2020 21:54:46 GMT

These is an attachments table, but I want to see the actual photos and the exif data. How do I see those?

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Fri, 16 Oct 2020 13:36:05 GMT

Is there a way to actually save jpg files that I can open and see the photo? That's really what I need.

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

JakeSkinner — Sun, 12 Dec 2021 06:29:25 GMT

Kaitlyn Abrahamson‌ you can use the following code to export the images:

import os, arcpy

# Variables
tbl = r"C:\Temp\Python\Test.gdb\Graffiti__ATTACH"       # Path to attachment table
fldBLOB = 'DATA'                                        # Field name of Blob data type field in attachment table
fldAttName = 'ATT_NAME'                                 # Field name in attachment table that contains attachment name
outFolder = r"C:\Temp\Python\Attachments"               # Output folder to export attachments to

with arcpy.da.SearchCursor(tbl,[fldBLOB,fldAttName]) as cursor:
   for row in cursor:
      binaryRep = row[0]
      fileName = row[1]
      # save to disk
      open(outFolder + os.sep + fileName, 'wb').write(binaryRep.tobytes())

print('Finished')‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Tue, 27 Oct 2020 14:36:26 GMT

Yes! I finally got it to work! Thank you so much for your help. It was invaluable.

Re: How do I download all ArcGIS Online attachments from a hosted feature layer made from a Survey123 form?

KaitlynAbrahamson — Thu, 24 Dec 2020 13:43:18 GMT

Is it then possible to edit the layer (split it by attributes, edit attribute data) and re-publish to arcgis online with the respective attachments. For some reason, I cannot get them to show up.