Does ArcGIS Online support range requests for downloading large files?

Question

We've currently got some cron scripts that backup content from our ArcGIS Online into a S3 for long term storage.

As part of this process we make use of the export to GDB endpoint to package up Feature Services and attachments and then copy that from ArcGIS Online into our S3 before removing the item from ArcGIS Online.

All of this is done using microservices. Unfortunately we're encountering issues where our microservices timeout due to the time it takes to download the GDB. The size of the GDB is approximately 10GB including the attachments.

Does ArcGIS Online support the use of HTML range requests for downloading the file? Our thoughts are to break up the file into parallel requests and then conversely do a multipart upload to S3.

JamesIng · Answer

I believe it our microservices fail / stop after 15mins.

So at 10GB it hits that time limit.

abdhassa · Answer

Hello @JamesIng ,  how long does it take before it timeouts? I have a similar process backing up the data to a GCP Bucket, but the current data is 4 GB and wondering if its gets to 10 GB or more what the implications would be.

Thanks