https://community.esri.com/t5/arcgis-pro-ideas/accelerating-3d-nearest-neighbor-search-using/idi-p/1634454 <P>Idea: Accelerating 3D Nearest Neighbor Search Using Snowflake + ArcGIS Pro</P><P>We had a performance bottleneck running 3D nearest neighbor analysis (e.g., finding the closest wellbore) using ArcPy in ArcGIS Pro — it took 30 hours per US county on a single machine.</P><P>I solved this by parallelizing the workflow with AWS Step Functions, EC2, and Python multithreading. By slicing the data by county and running ArcPy on 10 EC2s (8 threads each), we reduced processing time to <STRONG>1.5 hours</STRONG>. Outputs were written to File GDBs and stored in S3.</P><P>Now, I'm exploring the next step: <STRONG>offloading the processing to Snowflake</STRONG>. The idea is to store spatial data in Snowflake, use its <STRONG>multi-cluster compute</STRONG> to run 3D proximity logic in parallel (via SQL or Snowpark), and connect ArcGIS Pro for visualization.</P><P>This could eliminate the need for EC2 and scale analysis instantly using Snowflake’s native elasticity.</P> Sun, 20 Jul 2025 23:07:10 GMT VenkataKondepati 2025-07-20T23:07:10Z https://community.esri.com/t5/arcgis-pro-ideas/accelerating-3d-nearest-neighbor-search-using/idi-p/1634454 <P>Idea: Accelerating 3D Nearest Neighbor Search Using Snowflake + ArcGIS Pro</P><P>We had a performance bottleneck running 3D nearest neighbor analysis (e.g., finding the closest wellbore) using ArcPy in ArcGIS Pro — it took 30 hours per US county on a single machine.</P><P>I solved this by parallelizing the workflow with AWS Step Functions, EC2, and Python multithreading. By slicing the data by county and running ArcPy on 10 EC2s (8 threads each), we reduced processing time to <STRONG>1.5 hours</STRONG>. Outputs were written to File GDBs and stored in S3.</P><P>Now, I'm exploring the next step: <STRONG>offloading the processing to Snowflake</STRONG>. The idea is to store spatial data in Snowflake, use its <STRONG>multi-cluster compute</STRONG> to run 3D proximity logic in parallel (via SQL or Snowpark), and connect ArcGIS Pro for visualization.</P><P>This could eliminate the need for EC2 and scale analysis instantly using Snowflake’s native elasticity.</P> Sun, 20 Jul 2025 23:07:10 GMT https://community.esri.com/t5/arcgis-pro-ideas/accelerating-3d-nearest-neighbor-search-using/idi-p/1634454 VenkataKondepati 2025-07-20T23:07:10Z