Hello,
I used the generate near table to find distances between all points within 110 km of each other for a set of 67,000 points where I expect there to be somewhere between 300-2000 qualifying 'near' points for each of the 67,000 input points. The operation completed in about 4 hours.
I haven't opened the results table since I am worried that its large size will crash ArcGIS Pro. Instead, I decided to export the table as a .csv to my hard drive, since I have software outside of ArcGIS Pro that will be able to open it.
I started the export process about 3 hours ago. The progress bar advanced for about 2 hours until it got stuck at 20%. However, when I look at my computer's performance monitor I can see that both my CPU and RAM are still working hard. I think it's still downloading, but I'm not sure how to know for sure.
I am debating whether I should just be patient, wait all day, and see if this works OR if I should bail out of the process since I may be asking ArcGIS Pro to export a larger table than it can. I'm also not sure if I'm running into problems with my desktop's hardware. I have a fast CPU and 64 GB of RAM.
Honestly, I don't really know how many rows the table has, since I haven't opened it, but if each of my 67,000 points has 1,000 neighbors, that would be 67 million records. The way I set up the tool, the table should have just 4 fields (orig. point ID, near point ID, distance in meters, and distance rank).
Does anyone here have any insights, suggestions, or predictions about what might happen here? For now, I'm going to let the process keep running. If this is futile and any of you have ideas for how I can get this very large table out of ArcGIS Pro, I'd be grateful.
I don't really know of any other tools outside of ArcGIS that can do the work that the Generate Near Table does so efficiently. For my current project, getting access to the results in this table is critical. Any ideas?
