topic Re: Arcgis for Server download from service workaround in ArcGIS JavaScript Maps SDK Questions

Arcgis for Server download from service workaround

PeriklisPanagiotidis — Mon, 09 Feb 2015 09:39:17 GMT

As Arcgis for server has not a built in download shapefile(or any other format) functionality the "clip and ship" geoprocessing example is being suggested by many users and developers. However I find it quite limiting. As far as I understand, the "Extract Data" tool requires first to be run with a pre-defined set of Layers as a "Parameter" just like the "Zion" example.

What I (and many other developers) need is a script/service that takes an Arcgis Server service as an input (or a relevant js object like featureset) and returns a shapefile (or any other format) as an output. Of course I am referring to a client web application. I am using the Javascript API but if I am not mistaken Flex developers face the same issue. Thanks.

Re: Arcgis for Server download from service workaround

AdamMouton — Thu, 02 Apr 2015 20:41:12 GMT

I too am looking for a way to export a layer. The clip and ship is not a solution when it comes to a user picking a layer from the list to export. Unless someone knows of a way to modify the geoprocessing service to take an the proper variables.

Re: Arcgis for Server download from service workaround

RobertKirkwood — Tue, 28 Jul 2015 20:32:53 GMT

i tried this example but it does not work:

ArcGIS API for JavaScript Sandbox

how do i create the geoprocessing service?

Re: Arcgis for Server download from service workaround

RobertScheitlin__GISP — Tue, 28 Jul 2015 21:03:26 GMT

Robert,

As you probably notice, sample server 4 does not have the GP service available anymore. Here is the help doc link for creating your own clip and ship GP service:

ArcGIS Server Help - Clip and Ship

Re: Arcgis for Server download from service workaround

RobertKirkwood — Tue, 28 Jul 2015 21:08:54 GMT

Thanks. The link you sent only takes me to:

ArcGIS Server Help

I dint see the example. I will search for it.

Re: Arcgis for Server download from service workaround

RobertScheitlin__GISP — Tue, 28 Jul 2015 21:27:47 GMT

Robert,

Sorry I thought they fixed that link issue. Here is the link as plain text (don't click the link, just copy the text and paste it into your browsers address bar):

"http://help.arcgis.com/en/arcgisserver/10.0/help/arcgis_server_dotnet_help/index.html#//00930000003t000000"

Re: Arcgis for Server download from service workaround

PeriklisPanagiotidis — Wed, 29 Jul 2015 09:14:19 GMT

Hi all,

As I wrote in original post, the limitation of the above solutions is that you have to predefine the layers to clip/download. What I did to work around this limitation was to write a small script on the server, I used C# but anything will work, that provides a single service. That service takes a WFS link as an input and builds a shapefile using the GDAL library. Then wraps it up in a zip file, puts it on the server and returns a link to the file...

Not the most efficient way to do it and might time-out for large datasets but I haven't found anything better.

To avoid the timeouts you can instead of returning a link to the file, send an email with the link to the user when the zip file is ready.

I have tested libraries in js that build the shapefile on the client but they were slower and time-out a lot more.

It would be great (and surely easy to develop) if this could be done with a build in GP service.

Cheers

Re: Arcgis for Server download from service workaround

nita14 — Wed, 29 Jul 2015 10:09:49 GMT

HI Periklis,

You can do what you want with one geoprocessing tool: JSON to Feature . Here is the workflow:

1) Create the python script to Query input Map or Feature Service (send request to Query Endpoint). Pass the output JSON to arcpy.JSONToFeatures_conversion tool. Zip the output shape and expose it as GPDataFIle as an output parameter

2) Share the script as a Geoprocessing Service

Regards,

Adam

Re: Arcgis for Server download from service workaround

RobertKirkwood — Wed, 29 Jul 2015 14:02:16 GMT

One problem i am having with the tutorial is that it wont let me do this:

Expand Toolboxes > System Toolboxes > Server Tools.tbx > Data Extraction > Extract Data Task.
Drag the Extract Data Task tool to the ArcMap table of contents.

I get the error object could not be added to the map.

Re: Arcgis for Server download from service workaround

RobertKirkwood — Wed, 29 Jul 2015 14:37:15 GMT

i found this link in the forums:

Could Not Add The Specified Data Object to the Map

and made this work:

<!DOCTYPE html>

<html>

<head>

<!--The viewport meta tag is used to improve the presentation and behavior of the samples

on iOS devices-->

<title>Extract Data</title>

<style>

html, body {

height: 100%;

width: 100%;

margin: 0;

padding: 0;

visibility: hidden;

font-family: sans-serif;

}

.claro .dijitBorderContainer-child {

border: none;

}

.claro .dijitBorderContainer-dijitContentPane, .claro .dijitContentPane {

padding: 0;

}

.claro .dijitTitlePaneContentInner {

line-height: 1.4em;

}

#controls {

position:absolute;

top:1em;right:1em;

width:auto !important;

height:auto !important;

z-index:10;

}

#loading {

display: none;

vertical-align: middle;

}

.freehandIcon { background-image:url(./images/i_draw_freepoly.png); width:20px; height:20px; }

.polyIcon { background-image:url(./images/i_draw_poly.png); width:20px; height:20px;}

</style>

var gp, map;

var selectionToolbar;

require([

"esri/map", "esri/config",

"esri/layers/ArcGISDynamicMapServiceLayer",

"esri/tasks/Geoprocessor", "esri/tasks/FeatureSet", "esri/toolbars/draw",

"esri/symbols/SimpleFillSymbol", "esri/symbols/SimpleLineSymbol",

"esri/graphic",

"esri/Color",

"dojo/dom", "dojo/dom-style", "dojo/query", "dojo/parser",

"dijit/registry",

"dijit/layout/BorderContainer", "dijit/layout/ContentPane",

"dijit/TitlePane", "dijit/form/CheckBox", "dijit/form/ComboBox",

"dojo/domReady!"

], function(

Map, esriConfig,

ArcGISDynamicMapServiceLayer,

Geoprocessor, FeatureSet, Draw,

SimpleFillSymbol, SimpleLineSymbol,

Graphic,

Color,

dom, domStyle, query, parser,

registry

) {

// Create all dijits.

parser.parse();

// Prevent flash of unstyled content(FOUC).

domStyle.set(query("body")[0], "visibility", "visible");

// Specify where the location of the proxy to use to communicate with the extract GP service.

esriConfig.defaults.io.proxyUrl = "/proxy/";

// Keep a reference to the loading icon DOM node.

var loading = dom.byId("loading");

map = new Map("map", {

basemap: "streets",

center: [-104.946372, 43.433484],

zoom: 7,

});

map.on("load", initSelectionToolbar);

var homelandSecurity = new ArcGISDynamicMapServiceLayer("https://wygiscservices-dev.wygisc.org/arcgis/rest/services/EORI/Geologic_Clip/MapServer");

map.addLayer(homelandSecurity);

gp = new Geoprocessor("https://wygiscservices-dev.wygisc.org/arcgis/rest/services/EORI/MyGPService/GPServer/Extract%20Data%20Task");

gp.setOutSpatialReference({wkid:3857});

registry.byId("polygon").on("click", function() {

activateTool(this.id);

});

registry.byId("freehandpolygon").on("click", function() {

activateTool(this.id);

});

registry.byId("extract").on("click", extractData);

function initSelectionToolbar() {

map.graphics.clear();

selectionToolbar = new Draw(map);

selectionToolbar.on("draw-end", function(e) {

selectionToolbar.deactivate();

var symbol = new SimpleFillSymbol(

"solid",

new SimpleLineSymbol("dash", new Color([255,0,0]), 2),

new Color([255,255,0,0.25])

);

var graphic = new Graphic(e.geometry, symbol);

map.graphics.add(graphic);

});

}

function activateTool(tool) {

map.graphics.clear();

// The draw.activate expects a string like "polygon" or "freehand_polygon".

selectionToolbar.activate(tool);

}

function extractData(){

//get clip layers

var clipLayers = [];

if ( registry.byId("layer3").get("checked") ) { clipLayers.push("Bedrock Geology"); }

if ( clipLayers.length === 0 || map.graphics.graphics.length === 0 ) {

alert("Select layers to extract and draw an area of interest.");

return;

}

var featureSet = new FeatureSet();

var features = [];

features.push(map.graphics.graphics[0]);

featureSet.features = features;

var params = {

"Layers_to_Clip": clipLayers,

"Area_of_Interest": featureSet,

"Feature_Format": registry.byId("formatBox").get("value")

};

domStyle.set(loading, "display", "inline-block");

gp.submitJob(params, completeCallback , statusCallback, function(error){

alert(error);

domStyle.set(loading, "display", "none");

});

}

function completeCallback(jobInfo){

if ( jobInfo.jobStatus !== "esriJobFailed" ) {

gp.getResultData(jobInfo.jobId, "Output_Zip_File", downloadFile);

}

function statusCallback(jobInfo) {

var status = jobInfo.jobStatus;

if ( status === "esriJobFailed" ) {

alert(status);

domStyle.set("loading", "display", "none");

}

else if (status === "esriJobSucceeded"){

domStyle.set("loading", "display", "none");

}

function downloadFile(outputFile){

map.graphics.clear();

var theurl = outputFile.value.url;

window.location = theurl;

}

});

</script>

</head>

<div data-dojo-type="dijit/layout/BorderContainer"

data-dojo-prps="gutters:false"

style="width: 100%; height: 100%;margin:0;">

<div id="map"

data-dojo-type="dijit/layout/ContentPane"

data-dojo-props="region:'center'">

1.Select area of interest

<br>

<button id="polygon"

data-dojo-type="dijit/form/Button"

data-dojo-props="iconClass:'polyIcon', showLabel:false">

Polygon

</button>

<button id="freehandpolygon"

data-dojo-type="dijit.form.Button"

data-dojo-props="iconClass:'freehandIcon', showLabel:false">

Freehand

</button>

2.Select Layers to extract data from

<br>

<label for="layer3">Incident Area</label>

3.Specify download format

<br>

<option>Shapefile - SHP - .shp</option>

<option>File Geodatabase - GDB - .gdb</option>

<option>Autodesk AutoCAD - DXF_R2007 - .dxf</option>

<option>Autodesk AutoCAD - DWG_R2007 - .dwg</option>

<option>Bentley Microstation Design (V8) - DGN_V8 - .dgn</option>

</select>

<button id="extract" data-dojo-type="dijit/form/Button">Extract Data</button>

</div>

</body>

</html>

Re: Arcgis for Server download from service workaround

PeriklisPanagiotidis — Wed, 29 Jul 2015 15:06:18 GMT

Thanks Adam, that simplified things a lot. You actually don't need to use JSON to Feature tool. You can save it directly to shapefile. I will put the code below.

However I am still frustrated that I have to go through the service to get to the file instead of doing that in the background. Geoserver has that functionality built in

In any case, if anyone wants to use the script below they will probably want to add a return string with the file name according their needs.

import arcpy

from arcpy import env

import zipfile

import sys

import os

import glob

from random import randint

baseURL= arcpy.GetParameterAsText(0)

where = '1=1'

fields ='*'

token = ''

#The above variables construct the query

query = "?where={}&outFields={}&returnGeometry=true&f=json&token={}".format(where, fields, token)

fsURL = baseURL + query

fs = arcpy.FeatureSet()

fs.load(fsURL)

fs.save(arcpy.env.scratchFolder+"\\"+"download_file.shp")

#Randomize file name

def random_with_N_digits(n):

range_start = 10**(n-1)

range_end = (10**n)-1

return randint(range_start, range_end)

#Ziping the shapefile files

def zipShapefile(inShapefile, newZipFN):

if not (os.path.exists(inShapefile)):

print inShapefile + ' Does Not Exist'

return False

if (os.path.exists(newZipFN)):

os.remove(newZipFN)

if (os.path.exists(newZipFN)):

return False

zipobj = zipfile.ZipFile(newZipFN,'w')

for infile in glob.glob( inShapefile.lower().replace(".shp",".*")):

zipobj.write(infile,os.path.basename(infile),zipfile.ZIP_DEFLATED)

zipobj.close()

return True

randomname = str(random_with_N_digits(8))

InputShapeFile = arcpy.env.scratchFolder+"\\"+"download_file.shp"

#Public folder. Probably you will want to change this

OutputZipFile = "C:\\inetpub\\wwwroot\\Shapefiles\\"+randomname+"_file.zip"

zipShapefile(InputShapeFile,OutputZipFile)

print "done!"

Re: Arcgis for Server download from service workaround

KevinHibma — Wed, 29 Jul 2015 15:58:50 GMT

You must be using the 10.0 version of the tutorial. Try the 10.1+ version here: Geoprocessing service example: Clip And Ship—Sharing geoprocessing workflows | ArcGIS for Desktop

(The steps you mention are telling you to make a "tool layer", a concept that does not exist in 10.1+)

Re: Arcgis for Server download from service workaround

JasonHansel — Wed, 20 Jun 2018 23:31:33 GMT

Hi,

Python Noob. All I would like is for our users to be able to Download a layer(s) from a Map Service in .shp/,gdb output. I'm not digging the Extract Toolset, mainly because users "might" get inaccurate data via Clip. I would rather use a 'Select' but am not having a bunch of luck. I tried the above code but am getting errors, see below. Any help is Grate-ly appreciated. Thanks!

Runtime error
Traceback (most recent call last):
File "<string>", line 33, in <module>
File "c:\program files (x86)\arcgis\desktop10.5\arcpy\arcpy\arcobjects\arcobjects.py", line 175, in load
return convertArcObjectToPythonObject(self._arc_object.Load(*gp_fixargs(args)))
RuntimeError: RecordSetObject: Cannot open table for Load