Community
Select to view content in your preferred language

Webinar Resources: Geospatial Data Science at Scale

583
0
12-05-2023 10:30 AM
SBattersby
by Esri Contributor
Esri Contributor
3 0 583
‎12-05-2023 10:30 AM

We presented during a Data Science Connect webinar with our partners at Amazon Web Services (AWS) to discuss integrating ArcGIS GeoAnalytics Engine within the AWS EMR environment to enable performing geospatial data science at scale.  If you missed the webinar, the recording is available here.

Historically, spatial analysis has been difficult to apply to big data stored in the cloud due.  In part, this is due to the unique characteristics and data types for representing geography.  To remedy the situation, users have typically had to patch together disconnected libraries and packages to product actionable results – and these libraries are often not optimized for Spark-based big data environments.  Ultimately, the challenges of this have often meant that spatial information has not been utilized to its full potential in organizational decision making.

GeoAnalytics Engine on Amazon EMR provides a solution to this obstacle, enabling users to unlock massive parallel analysis capabilities for their spatial analytics workflows. With over 160 spatial functions and tools, GeoAnalytics Engine can directly process data from an Amazon Simple Storage Service (Amazon S3) data lake.

GeoAnalytics Engine on AWS EMR can be easily deployed and set up in your cluster to power your spatial workflows. GeoAnalytics Engine fits across your workflow with tools and functions customized for tasks such as:

  • Creating geometry from point coordinates, addresses, well-known text, or spatially enabled files (e.g., Esri Feature Service or File GeoDatabase, GeoJSON, etc.)
  • Enriching locations of interest using geographic context
  • Incorporating proximity analyses
  • Creating drivetime service areas
  • Calculating geographical statistics to understand the spatial patterns in your data

create_service_areas.pngcr_sequence_find_best_preserve_first_and_last.png

In the webinar, we introduced AWS EMR and GeoAnalytics Engine and demonstrated the value add of combining the two technologies. We also presented an application for rideshare modeling and prediction using Geographic Weighted Regression (GWR) and other ML models.  More details about the demonstration can be found in Using ArcGIS GeoAnalytics on Amazon EMR to predict rideshare demand

SBattersby_0-1701705747591.png

 

For more information, here are some of the links and background materials that we discussed in the webinar.

SBattersby_1-1701705796090.pngEsri and AWS  – Combine GIS with the power and innovation of AWS.  Learn about running ArcGIS and other Esri products within the AWS environment.

 

 

 

 

SBattersby_2-1701705810886.pngAmazon EMR and ArcGIS GeoAnalytics Engine – Learn more about big data analytics with Amazon EMR and Esri’s ArcGIS GeoAnalytics Engine through examples and use cases.

 

 

 

 

SBattersby_3-1701705816555.png

GeoAnalytics Engine Community – Explore GeoAnalytics Engine through the product community.  The Community site contains GeoAnalytics Engine blogs, videos, questions, documents, and ideas.

 

 

SBattersby_4-1701705824362.pngArcGIS GeoAnalytics Engine Developers – Developer documentation with an overview of the GeoAnalytics Engine product, functions, and tools.  ArcGIS GeoAnalytics Engine delivers spatial analysis to your big data by extending Apache Spark with ready-to-use SQL functions and analysis tools.  

 

We'd love to know more about your big data analytics and how we can support your use cases with GeoAnalytics Engine in Amazon EMR!