real-time massive raster processing in Hadoop with ArcPy or GP tools

[larryzhang]

Hi, dear fellows,

can you share any hands-on practices and coding experience to use Hadoop framework with ArcGIS (saying, ArcGIS Pro with raster GP tools or ArcPy) on HDFS and then perform MapReduce jobs on raster data?

[SarahAmbrose]

HI Larry,

Esri currently has a MapReduce/Hadoop solution called GIS tools for Hadoop. At this stage in the project, these tools are geared towards vector data. We aren’t currently adding raster capabilities to the GIS Tools, but still haven’t ruled it out.

Sarah

Imagery and Rasters​
Big Data​

[larryzhang]

Thanks, Sarah,

Hopefully, very sooner ArcGIS Pro users can see some innovative 'raster jobs' of MapReduce / Hadoop, in particular, over Mosaic Dataset ...

[WentaoWANG1]

Is it meaning that I can't use LineOfSight on Hadoop?

[SarahAmbrose]

Hi Wentao,

That is correct - you can't currently use the Line of Site tools. The list of functions that can be used through GIS Tools for Hadoop are listed here: UDF Documentation · Esri/spatial-framework-for-hadoop Wiki · GitHub .