Slow Attachment Downloads from AGOL Feature Layer (photos collected with Field Maps)

[Silas_Mathes]

Hello,

We've been using Field Maps (Collector) since 2019 to document our fieldwork with points and photo attachments. The field data are stored/hosted in ArcGIS Online Feature Layers. Our workflow is to collect the data to AGOL and then use an arcpy script to download the photos locally. Starting around August, the download time for each photo attachment (typically either 200KB or 900KB, depending on the Field Maps photo resolution setting) slowed to around 30 seconds.  Previously the download time was around 2-3 seconds per attachment.  We can collect several hundred photos for large sites, and downloading our photos now takes hours of time. 

Has anyone else experienced slow attachment downloads from AGOL Feature Layers?  If so are you just living with the delay, or did you find a work around?

We've tested various internet connections at home and in the office and double-checked our scripts, which utilize the following code snippet:

from arcgis.gis import GIS
gis = GIS("URL", "username","password")
search_result = gis.content.search("AGOL LAYER", "Feature Layer")

feature_layer_collection = search_result[1]
feature_layer = feature_layer_collection.layers[0]

feature_layer.attachments.download(oid=XXXXXX, attachment_id=XXXXX)

Thanks for any help!

Silas Mathes

Davey Resource Group, Nashville, TN   

[ArcDevelopment]

Did you ever get an answer to this? Im finding that a single 1.7MB png takes around 12 seconds to download which is really slowing our software.

[SilasMathes]

We haven't experienced the slowdown since we started with fresh, empty AGOL hosted feature layers to collect our data/photos around January of this year. Our hosted layers are building back up in size (biggest currently has around 500 attachments) as we collect field data, so I'll update you if we experience slow downloads again.  How many records/attachments are already in your hosted layers?    

[sakurai]

The attachment download method is very time consuming. (ArcGIS API for Python 2.3.0)
So I implemented attachment download using REST API.

for feature in features:
    attachments = fLayer.attachments.get_list(oid=feature.attributes[oidField])
    for attachment in attachments:
        attachmentUrl = "{0}/{1}/attachments/{2}".format(inputRecordSet["url"], feature.attributes[oidField], attachment["id"])    
        response = requests.get(attachmentUrl, params={
            "token": gis._con.token
        })
        attachement_path = os.path.join(attachement_dir, attachment["name"])
        with open(attachement_path, 'wb') as saveFile:
            saveFile.write(response.content)

[CalvinHarmin]

lyr = FeatureLayer(url=layer_url, gis=gis) # establish a FeatureLayer object from AGOL source
attachment_manager = lyr.attachments
attachment_list = attachment_manager.get_list(objectid) # this is a list, and each item in the list is a small dict of attachment attributes
if attachment_list: # ignores a blank (empty) list
    for attachment in attachment_list: 
        # download attachment
        attachment_path = attachment_manager.download(objectid, attachment["id"]) # this returns a list but it is a single string (path)

I've tried to boil down my code I'm using to the above. I am experiencing an issue where, for example, a Survey123 form submission (saves to an AGOL  hosted feature layer) has 4 attachments and it is taking > 15 minutes to download all of the photos. Each photo is about 9mb. Each one takes > 3 minutes to download. This seems extremely slow. I haven't tried @sakurai workaround but I just wanted to put in my experience about the slow download behavior. 

[SilasMathes]

@CalvinHarmin I can confirm that @sakurai 's method of using the standard Python requests library is much faster for attachment downloads--the only difficulty I had in implementation was finding the correct way to reference a valid token.  I ended up using: 

token = arcpy.GetSigninToken()
token = token["token"]

Let me know if you're interested and I can share our script.   ESRI reported some server issues yesterday (3/5/2025) for hosted feature layers and we couldn't download anything.  I think that's resolved now, though. 

[RhettZufelt]

Have you looked at the photo sizes for the latest points collected? 

I ask as I have a project in Field Maps that set to capture Small sized photos, and for some reason, randomly at some point, it started collecting them in the device default size (large as they get).

This made the images so large they sometimes timed out trying to submit and took forever to download them after that.

Looked in Field Maps Designer, and was still set to Small.  Set it to Large and save, then back to Small and save and it 'fixed' the issue and started saving the small sized photos again.  At least, until the next time it changed itself.

So, now I routinely check some of the newly collected photo sizes in the Hosted Feature Class, and if/when they start getting huge again, I repeat the FM Designer sequence to 'fix' it.

R_

[SilasMathes]

Thanks Rhett--we'll check our attachment sizes (and settings) frequently from now on!