topic Re: Extract Features From MapServer/ Rest/ Soap/ etc? in ArcGIS Enterprise Questions

Extract Features From MapServer/ Rest/ Soap/ etc?

JustinMeyers — Thu, 15 Jan 2015 15:04:13 GMT

Is it possible to extract gis data (features, records, geometry, etc) from arcgis rest/ soap/ Mapservers?

For example: ProxyServices/DDOTBaseMapProxy (MapServer)

can i extract the first layer

Railroad_1200 (1)

and make it a shapefile/ feature class, etc?

Thanks!

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JakeSkinner — Thu, 15 Jan 2015 16:33:02 GMT

I created a tool that will do this, but I don't think it will work with 9.3 services (which the above URL is referencing). You should be able to make minor adjustments to the python code to do this, though.

http://epro.maps.arcgis.com/home/item.html?id=16e5cc64178941839eca62837f168ec9

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

XanderBakker — Thu, 15 Jan 2015 16:47:10 GMT

with Python:

the simple way: https://community.esri.com/thread/118781#445348

or using a little more advanced: https://community.esri.com/thread/118781#445572

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JustinMeyers — Thu, 15 Jan 2015 17:54:30 GMT

can i do it with this dataset?

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JakeSkinner — Thu, 15 Jan 2015 18:34:48 GMT

Yes, I was able to do this with the tool I referenced. Attached is a feature class within a File Geodatabase.

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JustinMeyers — Thu, 15 Jan 2015 19:26:51 GMT

Thanks for the update. I cannot get the tool to work for some reason? Do I have to edit the python code? Also, the feature class attribute table shows 77,994 records, but the actual geometry has way less? The attached picture shows in red where the features are (the black is just a admin 1 boundary of indonesia). I dont think the tool actually grabbed all the geometry (unless you stripped out the geometry and just kept empty records for size?)? Please let me know.

Thanks!

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JustinMeyers — Thu, 15 Jan 2015 19:32:50 GMT

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

XanderBakker — Thu, 15 Jan 2015 19:36:26 GMT

It seems there are only 2000 valid geometries, the rest has null geometry (checked with Check Geometry). I did the same using my code and that does seem to generate the valid geometries.

I would have attached the zipped gdb, but it is 116 MB and too large to attach to the thread. If you can provide me with an email address I can send it using wetransfer.com

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JakeSkinner — Thu, 15 Jan 2015 19:40:38 GMT

The feature class appears correct. I added the service to ArcMap by making an ArcGIS Server connection to the rest directory:

http://services2.arcgis.com/LvCBNZuwhTWWbvod/ArcGIS/rest/services

I turned off all layers but the first and overlapped the feature class. Here is a screen shot of the service:

Here is a screen shot of the feature class:

Also, when running the tool, you will want to make sure you are specifying '/query' at the end of the URL. Ex:

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

XanderBakker — Thu, 15 Jan 2015 19:47:36 GMT

Jake Skinner‌, could you run a Check Geometry on your resulting featureclass?

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JustinMeyers — Thu, 15 Jan 2015 19:50:41 GMT

okay, I'm running the tool and it seems to be working so far (I will have to check the geometry). I kept on trying different web addresses; then i saw the address you put in. Thanks for all of your help! I might have a few follow-up questions in case this didn't work, but it looks like this thing is just clippin along!!! Thank you so much; talk with you soon!

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

XanderBakker — Thu, 15 Jan 2015 19:54:17 GMT

You can download the gdb from here:

https://www.dropbox.com/l/mfE3IQwXxMO1puq8JAqMSs

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JakeSkinner — Thu, 15 Jan 2015 21:01:38 GMT

Looks like there was an error with the script. For some reason, it was only inserting the geometry for the first 1,000 features. I went ahead and updated the tool/script to work correctly. I also updated it so that you don't have to enter '/query' at the end of the URL.

http://epro.maps.arcgis.com/home/item.html?id=16e5cc64178941839eca62837f168ec9

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JustinMeyers — Fri, 16 Jan 2015 14:13:40 GMT

Jake,

Do you have a e-mail I may contact you at? I have a few follow-up questions and a few things I am trying to work through with some other data and I cannot get the tool to work.

Thanks!

Justin

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

PeterYoung — Tue, 20 Jan 2015 14:34:09 GMT

The 1/15 .zip file doesn't open. Please repost -- I'd like to give this a try.

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JakeSkinner — Tue, 20 Jan 2015 14:43:55 GMT

Try using 7zip to unzip the file.

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JustinMeyers — Thu, 05 Mar 2015 21:33:47 GMT

Jake,

for some reason when i run the tool on different datasets (in UTF-8) non-roman characters (korean, chinese, cyrillic, etc characters) it wipes/scrambles them. Is there a way to fix this?

Thanks

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

LeoLadefian5 — Tue, 31 Jan 2017 17:20:17 GMT

Hi Jake, the referenced tool is locking me out from downloading. Permissions.

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

JakeSkinner — Tue, 31 Jan 2017 17:23:16 GMT

Leo Ladefian‌, you can download the tool from the following link:

https://community.esri.com/docs/DOC-6496-download-arcgis-online-feature-service-or-arcgis-server-featuremap-service

Re: Extract Features From MapServer/ Rest/ Soap/ etc?

Gijsvan_den_Dool — Thu, 16 Mar 2017 12:55:23 GMT

Hi Jake,

I tried to download the tool but I got "Permission Denied".

Is there another location where I can find the tool, and (more important) can it be used to extract data from this service:

http://www.pcn.minambiente.it/arcgis/rest/services

I would like to obtain a feature set of the highest resolution water lines to process further (hydrologically condition my DEM)

Thanks,

Gijs