You can use the following tool:
It will download all attachments to a specified directory.
I have been able to download my survey using both www.survey123.com and exporting it off of ArcGIS Online. However, not all of the pictures are coming. Can anyone please help me with a solution to get them all down into a Geodatabase for further manipulation?