Hi - I hope someone can point me in the right direction. Problem is as follows:
I have a point feature layer of fire hotspots (NASA MODIS product) that has a dateonly attribute (among others) for the past 25 years or so, subset to my AOI, etc. About 780,000 features.
I have a subset of NASA POWER monthly meteorological data, subset to AOI, variables and matching date range of fire data.
I need to add to the fire features' attribute table the corresponding meteorological values of monthly surface temperature, precipitation, etc.
If I try to create a table using the fire locations as the sample layer using the multidimensional tool, 'Sample', for all fires and all met monthly data across the years, the computational load is too high (I have had the process running on a pretty fast machine for the last 50 hours or so and still not done). Obviously, if I use the 'Sample' tool and limit the time dimension to 1 year, the table pops out pretty quickly. As it stands, I am asking Pro to make a table with about 7 billion elements. Not needed for what I want, but I was going to just join the desired information from that master table to my point feature layer for use later in a MaxENT or Random Forest model.
There must be an easier way. How can I search through the met data spatially- and time-wise and grab what I need? I'd like to stay in ArcGIS Pro as I am trying to brush up on my ArcGIS Pro skills, but if the answer is 'do it in Python', I'll just use Matlab or R as my Python is pretty bad.
Thanks!
The first things I'd check would be:
1. A Spatial index created/existing on both layers to the highest level possible first.
2. Attribute indexes on your date fields you're matching against.
3. Data location - ensure this is done locally, if you're doing this over VPN, sde, database, OneDrive, Fileshare etc etc. this is the problem. Process it locally.
4. Parallel Processing Factor (Environment setting)—ArcGIS Pro | Documentation Check if you can use it with your tool, and use it to the highest level if so.