|
POST
|
Hi Wentao, That is correct - you can't currently use the Line of Site tools. The list of functions that can be used through GIS Tools for Hadoop are listed here: UDF Documentation · Esri/spatial-framework-for-hadoop Wiki · GitHub .
... View more
04-07-2016
08:50 AM
|
0
|
0
|
963
|
|
POST
|
Hi Matej, You may also be interested in the following, put out by the team: Randall T. Whitman, Michael B. Park, Sarah M. Ambrose, and Erik G. Hoel. 2014. Spatial indexing and analytics on Hadoop. In Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL '14). ACM, New York, NY, USA, 73-82. DOI=10.1145/2666310.2666387 http://doi.acm.org/10.1145/2666310.2666387 We had a similar questions on the spatial framework repo : Framework Documentation · Issue #82 · Esri/spatial-framework-for-hadoop · GitHub , so you may want to check if the poster has a public thesis somewhere. Other than that, the links that Abhishek Rathi posted, are a great place to start, with this being the first thing I would try out: GIS Tools for Hadoop for Beginners · Esri/gis-tools-for-hadoop Wiki · GitHub If you have any issues, please create an issue in the github repo, and we will help out ASAP.
... View more
03-11-2016
09:26 AM
|
1
|
1
|
1116
|
|
POST
|
Hi Jeremy, Glad to hear that the aggregation tutorial worked. In the sample (https://github.com/Esri/gis-tools-for-hadoop/tree/master/samples/point-in-polygon-aggregation-hive) point in polygon aggregation you grouped results (group by counties.name) and ended up with a count within counties. To join attributes you will want to remove the group by term, add the attribute fields you are interested in joining, and complete the join, similar to: SELECT counties.name, table.attributestojoinhere FROM counties
JOIN earthquakes
WHERE ST_Contains(counties.boundaryshape, ST_Point(earthquakes.longitude, earthquakes.latitude)) - Sarah
... View more
08-27-2015
08:15 AM
|
0
|
2
|
1686
|
|
POST
|
Hi Lorena, You won't see any tools if you go double click on the HadoopTools.pyt. Does you unzipped folder look like this?: I'm going to create an issue on the GitHub site, so we can reference the issue more easily - if it works for you, we can communicate there. The GitHub issue can be found here: X when adding Hadoop tools in 10.2.2 · Issue #12 · Esri/geoprocessing-tools-for-hadoop · GitHub
... View more
07-17-2015
03:21 PM
|
0
|
1
|
1141
|
|
POST
|
Hi Lorena, I wasn’t able to reproduce the problem yet. Can you make sure you completed the following steps: Downloaded the toolbox and files using the “Download Zip” (on the right hand side) button from (https://github.com/Esri/geoprocessing-tools-for-hadoop) Unzipped the downloaded folder by right clicking the .zip, then Extract All In ArcMap, open the tool box, then right clicked, Add Toolbox Select the unzipped .pyt (as shown in your screen shot). If you have completed these steps, and it’s still not working, can you still add the toolbox even though there is an X (and if so can you open the tools)? If the answer is no, can you get tell me the md5 checksum (I’ll tell you how to get this)? To get the checksum, In Cygwin, go to the directory your toolbox is stored in: cd c:/Users/sara/Downloads/geoprocessing-tools-for-hadoop-master/geoprocessing-tools-for-hadoop-master You will then calculate the md5checksum on the toolbox: md5sum HadoopTools.pyt and get something like: e68151f010f1c4908f18eabe91200e25 *HadoopTools.pyt e68151f010f1c4908f18eabe91200e25 is the md5 checksum, and what I am interested in. Let me know if you need any clarifications. Thanks, Sarah
... View more
07-17-2015
09:39 AM
|
0
|
3
|
1141
|
|
POST
|
Hi Lorena, I haven't been able to reproduce this using v.10.2.2. What version of Windows are you using, and are you using ArcMap in English (or another language)? Are you able to provide a screen shot of what the problem looks like? Or let me know if it looks similar to this https://github.com/Esri/geoprocessing-tools-for-hadoop/issues/6 Thanks, Sarah
... View more
07-16-2015
01:57 PM
|
0
|
5
|
1141
|
|
POST
|
Hi Lorena, What version of ArcMap are you using? Sarah Big Data
... View more
07-15-2015
10:26 AM
|
0
|
7
|
1141
|
|
POST
|
HI Larry, Esri currently has a MapReduce/Hadoop solution called GIS tools for Hadoop. At this stage in the project, these tools are geared towards vector data. We aren’t currently adding raster capabilities to the GIS Tools, but still haven’t ruled it out. Sarah Imagery and Rasters Big Data
... View more
06-04-2015
10:35 AM
|
1
|
3
|
963
|
|
BLOG
|
Hi Ricardo - we aren't currently adding raster capabilities to the GIS Tools for Hadoop, but aren't ruling it out either. What kind on analyses are you looking to complete? -Sarah
... View more
04-15-2015
01:57 PM
|
0
|
0
|
689
|
|
POST
|
Hi Jeremy, Congrats on getting a Hadoop cluster – you can read about our own experience here. Currently you won’t be able to show hot spots, but will still be able to look for trends. I would recommended doing an aggregation by bins analysis (there is a new blog post and tutorial on this subject). Aggregating will produce a raster like result, showing the amount of salt being applied. The biggest difference between aggregation by bins and hot spot analysis is that hot spots shows statistical significance. From your question, it doesn't seem like that is very important, as you are more interested in finding information about the distribution of salt. With the current UDFs you are able to complete a near analysis by applying a buffer and then using a within or intersect operation (depending on your criteria). These GIS Tools for Hadoop need to be used with MapReduce, and thus need to be completed in Hadoop (not ArcGIS). Although the analysis is completed with Hadoop, you are able to move datasets between Hadoop and ArcGIS using the Geoprocessing Tools for Hadoop. You are correct that Big Data solutions are currently in R&D, and we think you will be very excited about what is coming. We are continuing to work on out of the box functionality, and will keep the GeoNet community posted on new developments. In the meantime please feel free to ask questions in GeoNet or submit issues on the GitHub site.
... View more
04-13-2015
10:32 AM
|
1
|
5
|
1686
|
|
BLOG
|
The Big Data team has added a new tutorial for beginners wanting to try out the GIS Tools for Hadoop. It walks you through the steps of downloading and installing a virtual machine, installing the tools using GitHub, and points you to interesting samples and tutorials to try out. https://github.com/Esri/gis-tools-for-hadoop/wiki/GIS-Tools-for-Hadoop-for-Beginners This introductory tutorial is also outlined in a blog post on the Esri website. Welcome to the wonderful world of big data! Big Data Geodatabase Geoprocessing Developers GIS
... View more
04-06-2015
12:27 PM
|
3
|
1
|
2042
|
|
BLOG
|
If the link isn't working try this: New Spatial Aggregation Tutorial for GIS Tools for Hadoop | ArcGIS Blog
... View more
03-26-2015
10:00 AM
|
0
|
0
|
689
|
|
BLOG
|
The Big Data team has created a new tutorial on aggregating your big data using GIS tools for Hadoop. You can read the blog post here. Aggregation is a powerful technique for visualizing your big data, so be sure to check it out!!
... View more
03-26-2015
09:59 AM
|
0
|
5
|
2474
|
|
POST
|
Hi Patricia, There are no plans to depreciate/remove the GIS Tools for Hadoop. Let me know if you have any more questions, Sarah
... View more
03-23-2015
12:37 PM
|
0
|
1
|
2078
|
|
POST
|
Hi Patricia, Have you checked out gis-tools-for-hadoop? It’s available on GitHub, and may be what you are looking for. There is also a Big Data group on GeoNet where you can ask questions about GIS Tools for Hadoop.
... View more
03-23-2015
10:22 AM
|
1
|
3
|
2078
|
| Title | Kudos | Posted |
|---|---|---|
| 1 | 07-18-2023 04:44 AM | |
| 1 | 06-01-2021 07:01 AM | |
| 1 | 07-29-2020 03:36 PM | |
| 1 | 04-13-2015 10:32 AM | |
| 2 | 05-29-2018 01:19 PM |
| Online Status |
Offline
|
| Date Last Visited |
2 weeks ago
|