nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Export Feature Service with Attachments

ODAMapping2012

Hi,

I've got a feature service with attachments enabled (it's a point layer with photos on that can be edited in the field and photos recorded using an ipad) that I'm trying to export out of arcgis online.
Every way that I try to export it doesn't include the attachments, is it possible?

Many thanks,

Andy

タグ付けされた投稿をもっと見る

Accepted answers

MikeMinamiP1

I'm updating this answer based on the current version. You can export to a file geodatabase that will contain the attachments.

Navigate to the item page of your hosted feature layer.

Find the layer you want to export features and click the small arrow next to the name to reveal a context menu, and export the data to a file geodatabase. You can then download a ZIP file of the geodatabase, that will contain the attachments

---------------

Original Reply

Export of attachments is supported through the API only at this time. It was not included in the update this week.

You can navigate to the REST endpoint of your service, like this:

http://services.arcgis.com/xyz/arcgis/rest/services/states/FeatureServer

Click Create Replica
Specify the Layers by index number e.g., 0,1,2 (this service above has 5 layers)
Set the boolean values to true.
Sync Model = none
Data Format = FileGDB
Click Create Replica.

This will start a process that will yield a zip file you can download.

Thanks,

Mike

All comments

RandyWeaver

I believe that your attachments are not working because the GLOBALID of the new dataset you created no longer reference the RELGLOBALID that is used to related those attachments back to their original features. Or in the case of not using a GLOBALID, the OBJECTID has changed from previous datasets that you merged together, which can also be used as the reference ID for attachments, it all depends on how you setup the original attachments.

AyçinÇAKMAK

Hi, I have a question about attachment tables. I have datasets more than one and an attachment table for all these datasets. I want to unite my dataset layers on one layer and reestablish the relation between attachments. I created a new relationship class, it works but couldn't get the attachments. Does anyone have any opinion about this?

Thanks

DrewTaylor1

I exported a FGDB as described above, but no attachments/photos were included. Is there something I'm missing?

Sohini_Garg

Thank you Randy! I'll try the python script.

Sohini_Garg

Thank you Mike!

RandyWeaver

I believe this may be of assistance to you: Python script to pull hosted features with attachments into a local file geodatabase. See ReadMe below.

MikeMinamiP1

S Garg

First, I don't write much code, so this is my best guess...

The ability to export is part of the REST API. I believe that you can make REST calls through Python. Thus, it seems possible to automate this process. Keep in mind that the API will create an item in ArcGIS Online that is a ZIP file of the file geodatabase.

I believe this is the correct API reference.

ArcGIS REST API

Mike

Sohini_Garg

Hi Mike - just saw your updated answer about exporting the layer and attachments into a zipfile. Is there a way to use python to achieve the same in an automated manner instead of manually having to go through the steps on AGO? This will be especially useful for downloading copies of multiple such layers (with attachments) on a regular basis.

Thanks!
S

TrilliumLevine1

Hi Mike,

Not sure what you mean -- what are signup coupons?

MikeStonewall

Brian,

This looks like a good a solution. Can you please send more info on getting "signup coupons"?

Thanks,

Mike

BenNadler

Export your feature service data as a file geodatabase. This creates a new item which you can then download (zip file).

the attachments are automatically included.

You can do this programmatically using Arcrest site package from Github. I think there is even an example here: Another GIS Blog: Using ArcREST to Export Hosted Feature Services

StephanLe_Roux

Trill

Thank you for the response.

I have done as suggested above . Still got the error as below. I must be doing something wrong.

I also tried some of the above mentioned proxy setting. I have tried the SETX and I have tried the def get_response as mentioned in your post above.

MichaelNesius

That's it (I'm a complete newbie to working with the REST API)! Thanks for the quick reply!

I started to piece it together late yesterday when I came across these suggested edits for working with proxies in another feature service script on github.

I ended up using pacparser on my office's wpad to determine my server ip and port and hardcoded them

os.environ['http_proxy'] = "http://" + pxy_user + ":" + pxy_pass + "@ + pxy_srvr + :" + pxy_port

thanks again!

TrilliumLevine1

Hi Stephen,

You need to enter your credentials in the last if clause at the bottom of the script:

if __name__ == "__main__":

TOKEN = login("yourUserNameHere", "yourPasswordHere")

Let me know if it works...

-Trill

TrilliumLevine1

Hi Mike,

When you're running SETX you're entering your specific user information as well as server and port info, right? Sorry if that's a silly question, but just wanted to make sure. In lieux of using SETX in the command line to reset the environment variables, you could also include urllib2 proxy handlers directly in the get_response def as shown below -- this is probably a more elegant solution:

def get_response(url, query='', get_json=True):

opener = urllib2.build_opener(

urllib2.HTTPHandler(),

urllib2.HTTPSHandler(),

urllib2.ProxyHandler(

{'https': 'http://yourUserName:yourPassword@YourProxyIP:ProxyPort',

'http': 'http://yourUserName:yourPassword@YourProxyIP:ProxyPort',

))

urllib2.install_opener(opener)

encoded = urllib.urlencode(query)

request = urllib2.Request(url, encoded)

if get_json:

return json.loads(urllib2.urlopen(request).read())

return urllib2.urlopen(request).read()

If you don't want to hardcode your info into the proxy handler, you could use this instead, which would allow you to enter your credentials via the command line:

{'https': 'http://' + sys.argv[1] + ':' + sys.argv[2] + '@YourProxyIP:ProxyPort',

'http': 'http://' + sys.argv[1] + ':' + sys.argv[2] + '@YourProxyIP:ProxyPort'}

If you do it this way, don't forget to import the sys module at the top of your script: import sys

You'd then enter the name of the script and your credentials in the python prompt like this:

>>> nameOfScript yourUserName yourPassword

Keep in mind that if you have special characters in your credentials (@, &, etc.) yourUserName and yourPassword need to be surrounded by double quotes.

Hope this works for you, please let me know if you need any more pointers.

- Trill

StephanLe_Roux

Trillium,

I am trying to use your BackupServiceAttachments.py. I am not a python expert, so I am doing what I can to try to get this working. I need to get this script working for my project, it does exactly what I need done.

I have changed the relevant sections like.

serviceTodayString =

serviceYesterdayString =

When I run the script it creates the folder and then stops with the following error.

{u'message': u'Unable to generate token.', u'code': 400, u'details': [u'Invalid username or password.']}

I am not sure where I should be adding my username and password ? There is a few places in the code where username and password gets mentioned.

Can you please give some direction even if you just give me the line where the username and password should be entered.

Kind regards

MichaelNesius

I'm trying to use Trill's script.

It works when I monitor the http traffic with Fiddler, but fails with urllib2.URLError: urlopen error 10061 'no connection could be made because the target machine actively refused it' when I run the script without Fiddler open.

I believe Fiddler makes it work because it is essentially acting as a proxy while it is open. Simply running SETX https_proxy http://user:pw@serverIP:port in the command prompt doesn't seem to cut it for me.

Any suggestions?

thanks,

Mike

*My office uses a wpad.dat for the proxy if that matters

TrilliumLevine1

For anyone who is still looking for answers on extracting attachments from a secured ArcGIS online-hosted feature service: I've been working with Brian Brown (who has been helpful byond the call of duty) on developing a script that I can use to download attachments and replicate the entire hosted feature service locally.

Brian's base code can be found on his github site: https://github.com/bgeomapping/arcgis-toolboxes

I made some minor modifications to it, which are included in the attached code:

Functionality to create a directory for attachments and another for the spatial data.
Functionality for unzipping and renaming the replicated geodatabase.
I need this to run daily and delete the download from 'yesterday', so I added functionality for that.
I also wanted to have the global id in the file name, and for it to add a file extension to the attachment even if one wasn't included as part of the the file name -- functionality for that is added.
As far as I can tell the base code works only for images, but since attachments can be virtually any format, I modified the code to handle any format.
Generate a report showing number of attachments downloaded per layer in feature service.

Other things to note: if the specified url ends in FeatureServer, the entire service will be replicated and all attachments for all layers with attachments in the service will be downloaded. If the specified url ends in FeatureServer/<layer index>, only that layer will be replicated and only attachments for that layer will be downloaded. Also, the code creates the following subdirectories for attachments: Layer > Feature OID > attachments, as well as an 'All attachments' folder -- I don't need the 'All attachments' portion, so it's commented out. This should work in both Python 2.6 and 2.7 (I've tested in 2.6, Brian in 2.7) and is written so that ArcGIS need not be installed on the machine running the script (in other words, no arcpy import).

I hope this helps some of you!!!

- Trill

BackupServiceAttachments.py.zip

Center_City_DistrictPhiladelph

Getting an error now when trying to edit the layer definition. Nothing was edited but the "maxRecordCount" and a constant error of" Invalid definition for 'LastEditDate'. Even when I am NOT editing the "maxRecordCount" and press the "Update Layer Definition" button this error occurs on each of my feature services. I am hosting all the data on ArcGIS Online and not running a server.

MikeMinamiP1

For performance reasons, we don't recommend setting the value above 2000.

How to update the Max Record Count of a Feature Service in REST‌

If your goal is to just extract the data with attachments from an ArcGIS Online hosted feature layer, our recent update now supports exporting a file geodatabase of the layer with all attachments. This shouldn't require increasing the query limit on the service endpoint.

Use hosted features and tiles—Help | ArcGIS‌

Thanks,

Mike

Center_City_DistrictPhiladelph

I found out that you can change the amount of records that the feature service displays and downloads when you make a local copy

The steps taken in order to access the Service Definition File were the following:

Sign into Organizational Account on arcgis.com.
Click on My Content > Open the feature Service whose feature count you are looking to expand.
Click on the url under the Layers heading in order to access the ArcGIS REST Services Directory.
Delete the existing url up to the rest endpoint and then replace with /admin ex: http://services.arcgis.com/Wl7Y1m92PbjtJs5n/arcgis/rest/services/failure_1002/FeatureServer/0 would be turned to http://services.arcgis.com/Wl7Y1m92PbjtJs5n/arcgis/admin.
Click on Services in order to access all feature services within your organization.
Click on the feature Service whose feature count you are looking to expand.
Scroll down to the bottom and click on Update Definition.
Select Ctrl+f and search for maxrecordcount.
Change all 1,000s to the number of features you are desiring.
Select Update Service Definition.
Go back to your My Content and open the feature class in a new web map or open in Desktop.

bshepard

I have just collected 1500 points each with attachments(pictures) and it seems that when create a local copy for editing to use the script to extract the attachments I can only get 1000 features to copy over, is this a arcgis online file limit? a setting's feature limit?

How can I get all my features downloaded, and have each features attachments saved locally.

I have been successful before I went out and collected all 1500 with a few hundred and everything worked fine, now it seems that since I have over 1000 features and it's hosted on arcgis online there I can not create a local copy with every feature!

Please some help would be helpful.
-Rich

I'm having the same issue. I have an AGOL hosted feature service with ~1,700 records, but only 1,000 show up if I open the service in Desktop 10.1.

We collect data during monitoring/treatment season, and I want to export this data to a feature class for permanent storage on our server. Smaller datasets work really well by opening the service in Desktop and exporting to a feature class, however I can only export 1,000 records in this manner. I successfully exported to a shapefile in AGOL, but my field names are truncated.

Is there some sort of 1,000 feature limitation, or a 10.1 limitation? Is this resolved in 10.2.2? Being able to export collected data to a permanent system of record with attachments should be a core functionality, not a feature that's under development.

-Brian

Center_City_DistrictPhiladelph

I have just collected 1500 points each with attachments(pictures) and it seems that when create a local copy for editing to use the script to extract the attachments I can only get 1000 features to copy over, is this a arcgis online file limit? a setting's feature limit?

How can I get all my features downloaded, and have each features attachments saved locally.

I have been successful before I went out and collected all 1500 with a few hundred and everything worked fine, now it seems that since I have over 1000 features and it's hosted on arcgis online there I can not create a local copy with every feature!

Please some help would be helpful.
-Rich

JohnTownsend

There is a script will extract attachments to files: http://support.esri.com/em/knowledgebase/techarticles/detail/41763

Thanks. That is exactly what I needed.

MichaelOlkin

There is a script will extract attachments to files: http://support.esri.com/em/knowledgebase/techarticles/detail/41763

Is there a way to export the attachments out of the database and into a file folder. For instance, I would like to be able to take all of the attachments and produce .jpg images in a folder external to the database. Currently, I would have to open each attachement individually and perform a Save As. This won't fly when I have to do that 1000 times. Having the ability to export all attachements would be ideal. Having the ability to export these attachements and assign a file name based on table attributes would be even better.

JohnTownsend

Is there a way to export the attachments out of the database and into a file folder. For instance, I would like to be able to take all of the attachments and produce .jpg images in a folder external to the database. Currently, I would have to open each attachement individually and perform a Save As. This won't fly when I have to do that 1000 times. Having the ability to export all attachements would be ideal. Having the ability to export these attachements and assign a file name based on table attributes would be even better.

AdamGlover

Hi,
Is it possible that, with ArcGIS Desktop 10.2 edition , can be save all attachments(photos) from ArcGIS online feature service?

You do not need a specific version of Arc to export this data.

Have you tried to download this data using the CreateReplica command?

Say the rest end point for my feature service (Hosted in ArcGIS online) is as follows...

http://services1.arcgis.com/*************/arcgis/rest/services/*****/FeatureServer

If I add the create replica command to this as displayed below...

http://services1.arcgis.com/*************/arcgis/rest/services/*****/FeatureServer/createreplica

Separate the layers that you want with a comma "0,1,2..."

Set geometry type

Be sure to set "Return Attachments" to True

Sync Model to "None"

Data format to "FileGDB"

Once you click to create replica then you will a url generated from which you can download a file geodatabase with your feature class, relationship class, and attachments table.

Hope that helps.

Adam

Anonymous User

Hi Allison,

If you extract the data as Mike instructed and add it to ArcMap, you can get the attachments by Identifying the Feature. In the Identify Results window you will see the number of attachments returned. You can click on the arrow to choose which attachment to open. The relationship class takes care of the relate from the Features to the attachments in the attachment table.

[ATTACH=CONFIG]29948[/ATTACH]

Hope that helps,
Andrew

get_attachements.JPG

MikeMinamiP1

Alison,

Sorry, I don't know the ArcMap side of things... maybe others on this forum might. Or, you might try posting this specific question in the ArcGIS for Desktop forum.

Thanks,

Mike

AlisonKuemmel

Got it! Thank you! I now have my replicated data loaded into Desktop. I'm not too familiar with relationship classes, but I'm hoping you can help me with the final intake/viewing of the attachments on my local machine.

I have both my original parcel layer and the parcels_ATTACH open in ArcMap.

It allows me to join the parcels to the attachment table based on a pre-defined relationship class
(I tried to do the join (the table to the parcel layer) and based it on a pre-defined relationship class.
I receive an error that the join data cannot be based on a 1-many relationship class.)

There are fields referencing the data, but I don't actually know what to do with them to view the attachments. How do I open them to view the photos?

My final use for this project is to take the information created in the field to send to other departments for following up on the field collection. I will transfer the polygon info into a point file, then create a Map Tour so that directors can easily see everything in one dashboard-type interface.

Thanks for your quick responses, I hope this explains my goal. Do you have advice on the next step? Is it feasible that once I join it to a point file it will open in a Map Tour using these points and associated images?

Thanks,
Alison

MikeMinamiP1

Alison,

I think you are one level too low. When you navigate to the rest endpoint of the service, remove the index number from the end of the URL, for example, remove the /0 or /1.

Mike

AlisonKuemmel

Thank you for your reply, Mike!

This sounds promising, but for my rest service I only have the option of Query, Update Features, Apply Edits, or Generate Renderer.

(Create Replica is not a choice)

Is there something different I should do when I first set up the parcel service? Our organization's administrator actually posted the data, but I could take that part over if it gives different access rights.

I've attached a screenshot of the rest service page that I come to for my parcel layer.

DonPritt

Looks like ESRI's inching towards this ability, which is good, this is a huge importance for my organization and the future of us staying with our organizational account.

MikeMinamiP1

I'm updating this answer based on the current version. You can export to a file geodatabase that will contain the attachments.

Navigate to the item page of your hosted feature layer.

---------------

Original Reply

Export of attachments is supported through the API only at this time. It was not included in the update this week.

You can navigate to the REST endpoint of your service, like this:

http://services.arcgis.com/xyz/arcgis/rest/services/states/FeatureServer

Click Create Replica
Specify the Layers by index number e.g., 0,1,2 (this service above has 5 layers)
Set the boolean values to true.
Sync Model = none
Data Format = FileGDB
Click Create Replica.

This will start a process that will yield a zip file you can download.

Thanks,

Mike

AlisonKuemmel

Good afternoon,

I have come across this need in my organization. I know the newest updates came through this week, was this addressed in any of these updates to ArcGIS online?

Thank you,
Alison

BrianFlood

hi

we're going to move to an open beta very soon, in the mean time if you want to test the service please send me an email directly (bFlood at arc2earth.com )

We're moving some of the internal parts around to make it more efficient for multiple Org users to backup the same data. We also want to support different backup file types (shp, geojson, kml, FGDB etc) At the same time we're layering some new functionality over the top of the service, more info to come next week

cheers
brian

senemfidan

While I'm trying register to Arc2Box it gives an error "A valid coupon is required for the Arc2Box Beta program"

So Is there anybody who knows what's the coupon?

My purpose is via this Arc2Box to download whole my attachments from Arcgis Online to dropbox with features id.

LeonScott

I do have the sync option enabled.

To access the data in Desktop I do the following
1) Log into organizational account for ArcGIS.com
2) Access item details for my feature service
3) Select Open->"Open in ArcGIS 10.1 for Desktop"
4) Open the downloaded ArcGIS Portal Item file
5) Open "Edit Features"->"Create Local Copy for Editing" from the context menu of the service

I was curious why the Open menu on ArcGIS.com specified the 10.1 version, but that I figured that was nothing.
If you need access to my service to reproduce the problem, please contact me and I'm sure I can make that work.

And for the record, exporting directly to FGDB would be great!

Leon

BrianFlood

if you are looking for on-demand or continuous backup of your Feature Service data/attachments, you could try out this new service:

http://www.arc2box.com

It connects to your AGOL account and exports your data to your DropBox account. It's free now during beta testing but we're targeting a low subscription price ($9/month)

cheers
brian

MikeMinamiP1

You are accessing a hosted feature service right? Did you enable the Sync option?

As I understand it, there may be a bug in Desktop here. The desktop team is investigating it and would make any fix available in a service pack release. Is it possible for you to share your service so we can reproduce the problem? Maybe giving us the steps you used to create it would help...

On the ArcGIS.com side, we are working on exporting directly from the website to a FGDB, which would contain the attachments. Scheduled for release at this point, by the end of the year.

Thanks,

Mike

LeonScott

ArcGIS for Desktop 10.2 will support "Creating a local copy" of the service that will also contain the attachments.

Thanks,

Mike

I have 10.2 Desktop running, when I run "Edit Features"->"Create Local Copy for Editing" from the context menu of the service it is not bringing over the attachments. Is there another tool that I am missing?

Leon

senemfidan

Hi,
Is it possible that, with ArcGIS Desktop 10.2 edition , can be save all attachments(photos) from ArcGIS online feature service?

MikeMinamiP1

ArcGIS for Desktop 10.2 will support "Creating a local copy" of the service that will also contain the attachments.

Thanks,

Mike

AdamAull

The ability to export feature classes and attachments from ArcGIS Online to my enterprise geodatabase is extremely important to my organization. This definitely needs to be focus of ESRI since all other ESRI products are integrating with each other and able to share data bi-directionally.

MikeBell

It's our reason for considering abandonment of arcgis online.....no support for many simple commons things like this.....

MikeMinamiP1

No release of this coming in the near term. Our efforts are currently focused on database synchronization, rather than export and manual synchronization.

Thanks,

Mike

MichaelOlkin

We hope to support this in a future update.

Any word on how soon this future update might be coming?

会話に参加する

サインインしたメンバーは投稿、更新のフォローなどができます。初めてですか？無料アカウントを登録してください。

クイックリンク

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.