Latest Contributions by SarahAmbrose

Hi Wentao, That is correct - you can't currently use the Line of Site tools. The list of functions that can be used through GIS Tools for Hadoop are listed here: UDF Documentation · Esri/spatial-framework-for-hadoop Wiki · GitHub . ... View more

Hi Matej, You may also be interested in the following, put out by the team: Randall T. Whitman, Michael B. Park, Sarah M. Ambrose, and Erik G. Hoel. 2014. Spatial indexing and analytics on Hadoop. In Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL '14). ACM, New York, NY, USA, 73-82. DOI=10.1145/2666310.2666387 http://doi.acm.org/10.1145/2666310.2666387 We had a similar questions on the spatial framework repo : Framework Documentation · Issue #82 · Esri/spatial-framework-for-hadoop · GitHub  , so you may want to check if the poster has a public thesis somewhere. Other than that, the links that Abhishek Rathi​ posted, are a great place to start, with this being the first thing I would try out: GIS Tools for Hadoop for Beginners · Esri/gis-tools-for-hadoop Wiki · GitHub If you have any issues, please create an issue in the github repo, and we will help out ASAP. ... View more

Hi Jeremy, Glad to hear that the aggregation tutorial worked. In the sample (https://github.com/Esri/gis-tools-for-hadoop/tree/master/samples/point-in-polygon-aggregation-hive) point in polygon aggregation you grouped results (group by counties.name) and ended up with a count within counties. To join attributes you will want to remove the group by term, add the attribute fields you are interested in joining, and complete the join, similar to: SELECT counties.name, table.attributestojoinhere FROM counties JOIN earthquakes WHERE ST_Contains(counties.boundaryshape, ST_Point(earthquakes.longitude, earthquakes.latitude)) - Sarah ... View more

Hi Lorena, You won't see any tools if you go double click on the HadoopTools.pyt. Does you unzipped folder look like this?: I'm going to create an issue on the GitHub site, so we can reference the issue more easily - if it works for you, we can communicate there. The GitHub issue can be found here: X when adding Hadoop tools in 10.2.2 · Issue #12 · Esri/geoprocessing-tools-for-hadoop · GitHub ... View more

Hi Lorena, I wasn’t able to reproduce the problem yet. Can you make sure you completed the following steps: Downloaded the toolbox and files using the “Download Zip” (on the right hand side) button from (https://github.com/Esri/geoprocessing-tools-for-hadoop) Unzipped the downloaded folder by right clicking the .zip, then Extract All In ArcMap, open the tool box, then right clicked, Add Toolbox Select the unzipped .pyt (as shown in your screen shot). If you have completed these steps, and it’s still not working, can you still add the toolbox even though there is an X (and if so can you open the tools)? If the answer is no, can you get tell me the md5 checksum (I’ll tell you how to get this)? To get the checksum, In Cygwin, go to the directory your toolbox is stored in: cd c:/Users/sara/Downloads/geoprocessing-tools-for-hadoop-master/geoprocessing-tools-for-hadoop-master You will then calculate the md5checksum on the toolbox: md5sum HadoopTools.pyt and get something like: e68151f010f1c4908f18eabe91200e25 *HadoopTools.pyt e68151f010f1c4908f18eabe91200e25 is the md5 checksum, and what I am interested in. Let me know if you need any clarifications. Thanks, Sarah ... View more

Hi Lorena,  I haven't been able to reproduce this using  v.10.2.2. What version of Windows are you using, and are you using ArcMap in English (or another language)? Are you able to provide a screen shot of what the problem looks like? Or let me know if it looks similar to this  https://github.com/Esri/geoprocessing-tools-for-hadoop/issues/6 Thanks, Sarah ... View more

Hi Lorena, What version of ArcMap are you using? Sarah Big Data​ ... View more

HI Larry, Esri currently has a MapReduce/Hadoop solution called GIS tools for Hadoop. At this stage in the project, these tools are geared towards vector data. We aren’t currently adding raster capabilities to the GIS Tools, but still haven’t ruled it out. Sarah Imagery and Rasters​ Big Data​ ... View more

Hi Ricardo - we aren't currently adding raster capabilities to the GIS Tools for Hadoop, but aren't ruling it out either. What kind on analyses are you looking to complete? -Sarah ... View more

Hi Jeremy, Congrats on getting a Hadoop cluster – you can read about our own experience here. Currently you won’t be able to show hot spots, but will still be able to look for trends. I would recommended doing an aggregation by bins analysis (there is a new blog post and tutorial on this subject). Aggregating will produce a raster like result, showing the amount of salt being applied. The biggest difference between aggregation by bins and hot spot analysis is that hot spots shows statistical significance. From your question, it doesn't seem like that is very important, as you are more interested in finding information about the distribution of salt. With the current UDFs you are able to complete a near analysis by applying a buffer and then using a within or intersect operation (depending on your criteria). These GIS Tools for Hadoop need to be used with MapReduce, and thus need to be completed in Hadoop (not ArcGIS). Although the analysis is completed with Hadoop, you are able to move datasets between Hadoop and ArcGIS using the Geoprocessing Tools for Hadoop. You are correct that Big Data solutions are currently in R&D, and we think you will be very excited about what is coming. We are continuing to work on out of the box functionality, and will keep the GeoNet community posted on new developments. In the meantime please feel free to ask questions in GeoNet or submit issues on the GitHub site. ... View more

If the link isn't working try this: New Spatial Aggregation Tutorial for GIS Tools for Hadoop | ArcGIS Blog ... View more

Hi Patricia, There are no plans to depreciate/remove the GIS Tools for Hadoop. Let me know if you have any more questions, Sarah ... View more

Hi Patricia, Have you checked out gis-tools-for-hadoop? It’s available on GitHub, and may be what you are looking for. There is also a Big Data group on GeoNet where you can ask questions about GIS Tools for Hadoop. ... View more