I seek guidance on optimizing the performance of processing tasks within ArcGIS Pro 3.2.I focus on addressing a processing bottleneck when executing a task with a heavy load.
My project involves distinguishing a large number of agricultural land polygons that are free from steep slopes, meaning they do not intersect with polygons designated as steep terrain (a technique known as Boolean overlay analysis). There are about 50 million farmland polygons and 10 million steep slope 100m mesh polygons. Both the agricultural land and steep slope polygons are stored individually as shapefiles (vector format) on the SSD of the C drive. For this purpose, I utilized the "Select Layer By Location" tool from the "Data Management Toolbox," adjusting it to select agricultural polygons that intersect with steep slope polygons (+ Invert spatial relationship). Although I anticipated the process to be time-consuming. However, I was surprised to find that the utilization of the CPU, GPU, and memory on my computer remained under 10%, seldom reaching 20%, despite the prolonged processing time. Typically, if these components were nearly maxed out and causing delays, I would consider optimizing the workflow or upgrading the system's components. However, since the bottleneck seems to stem from the software, it appears more prudent to tackle this issue first. My computer specifications are shown below meets the recommended specifications. My hope is to address the bottleneck on the software side and speed up my task.
I would appreciate suggestions on:
Methods to address the bottleneck and use hardware performance efficiently.
- Modifications to ArcGIS Pro, Windows or other settings
- Alternatives to the current toolbox utilized
- Adjustments to improve hardware compatibility with ArcGIS Pro ...etc.
I am not looking for such solutions at this time:
Methods that do not address the bottleneck directly to speed up and streamline tasks.
- Simplifying polygons
- Files dividing and automation (Model builder, ArcPy)
- Employing raster geoprocessing tools ...etc.
My primary goal is to fully leverage my PC's capabilities to enhance processing speed in ArcGIS Pro.
・PC specifications
- Model: ASUS G35DX-R9R2080TI
- Operating System: Windows 10
- CPU: AMD Ryzen 9 3950X (16 cores, 32 threads)
- GPU: NVIDIA GeForce RTX 2080 Ti (11GB)
- Memory: DDR4-3400 64GB
- Storage: SSD (NVMe PCI Express 3.0 x4) 512GB + HDD 2TB (with at least 100GB of free space on the SSD)
- Power Options: High-Performance mode