topic Re: ArcGIS crashing while running Weighted Overlay tool in model builder in ArcGIS Spatial Analyst Questions

ArcGIS crashing while running Weighted Overlay tool in model builder

PRASHANTPATEL — Tue, 09 Aug 2016 19:12:36 GMT

Hello,

I have been working on some heavy shape files which includes Alberta's road, river, power gas,substations, land cover, slope, urban areas etc data where I am trying to perform the weighted overlay analysis in model builder using total of 7 files mentioned here, ArcGIS is getting crashed within seconds. I have check all the input files everything seems OK to me. Since yesterday, ArcGIS has crashed almost 25 times. When I use less number of files, say 5 instead of 7, weighted overlay is working fine.

My system specs are 8GB RAM, i5-4590, 3.3GHz, 64-bit. I don't understand the reason for this issue.

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

DanPatterson_Retired — Tue, 09 Aug 2016 19:18:05 GMT

are there spaces in the paths or filenames for the inputs and outputs.

Can you elaborate on the details of 'seems fine', sometimes it is the inputs that are in error.

Also, details of file sizes etc. and have you read the details of the help topic just in case.

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

PRASHANTPATEL — Tue, 09 Aug 2016 19:36:09 GMT

There are no space as such in either input or output files.

My inputs are raster outputs of reclassify tool. On basic shape files, I have performed multiple buffer rings, then dissolve, feature to raster and then reclassify.

Compressed file sizes are in the range of 700MB to 910MB. Total size of all 7 files is close to 5.87GB.

I haven't found any help option yet for this particular problem.

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

DanPatterson_Retired — Tue, 09 Aug 2016 21:51:50 GMT

d:academics\projectwork\gis\test practice\160610\replica_mohiba work\pref_ana_ref_mohib\pref_ana_rep_mohib.gdb\en_prefana_wo

124 characters in length 2 spaces hmmmm not good

everything is converted to an esri grid if it is a shapefile.

can I suggest you try to move everything to d:\test

also... what is the cell size, and extent? do you have a lot of small area?

and try again

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

PRASHANTPATEL — Wed, 10 Aug 2016 18:38:55 GMT

I tried moving the files in d:\Test drive but it's not working. Here is snapshot of crashed ArcMap.

Also, cell size is 30 X 30 m. There is enough small areas. For extent, I have attached image below.

As I mentioned earlier I performed number of operations before I finally got the inputs for weighted overlay analysis. All in all, the total file size of all the data comes out to be close to 31GB. However, raster inputs files for Weighted overlay analysis is around 5.87 GB.

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

DanPatterson_Retired — Wed, 10 Aug 2016 20:45:49 GMT

there are still spaces in your paths... look at the dialog. Now, go to the Results menu (geoprocessing menu section) and copy the results of a failed attempt. It usually gives you more information that is reported by the dialog. And you could simplify stuff by doing an incremental weighted overlay starting with just 2 inputs, then 3 once the paths are fixed. You may be having memory issues or file issues until the base issues are addressed

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

PRASHANTPATEL — Wed, 10 Aug 2016 23:24:13 GMT

I fixed the space problem in the path. Basically, I was running Weighted overlay analysis in Model Builder and this was not showing any entries in Result window. As soon the model is run, system got crashed withing 2-3 seconds.

However, when I opened the weighted overlay tool directly form the tool box (ToolBox/Spatial Analyst Tool/Overlay/Weighted Overlay) and run the tool after putting all 7 input files, fortunately system worked, so is the result window. I have got some output results although not what I desired but yeah, at least ArcMap didn't crash.

Thank you for your solutions. It really worked.

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

DavidYeany — Wed, 07 Sep 2016 17:46:55 GMT

I am having the same issue with the stand alone tool as well as model builder. I want to combine 13 eight bit integer rasters into a weighted overlay. The tool seems to crash at 5 input layers now. I say now because a couple months ago I was able to run the tool with these layers in model builder. The tool also crashed ArcGIS when trying to process 6 input rasters in the stand alone tool. My machine has 16GB of memory and a 64bit processor. I have no spaces in my file names and have even reduced the length of file pathways substantially.

I don't see running multiple pieces separately as a viable option to the analysis because the layers are dependent on each other, summing to the total of the whole model.

Does anyone know if this is a known bug or is there a solution?

Thanks.

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

PRASHANTPATEL — Wed, 07 Sep 2016 22:16:23 GMT

ArcGIS crashes when your input raster files are not correct.

First, make sure all of your raster files have proper and similar symbology (can be found under Layer Properties).

Second, try to run the Weighted overlay analysis directly from the toolbox i.e. open 'Weighted Overlay' tool from (ToolBox/Spatial Analyst Tool/Overlay/Weighted Overlay), not in the Model builder interface.

If you can share some screenshots of the file name and model builder operation, it would be a good help.

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

DavidYeany — Wed, 07 Sep 2016 22:57:16 GMT

Let's first focus on figuring out why Weighted Overlay crashes Arc when I run the stand alone tool. This happens when I add more than 5 of the input layers in the ATV.gdb below.

All input rasters are 8bit integer, most unsigned, and all snapped to the same extent and same 30m cell size:

All input rasters have integer values from 0-3. Some grids have NoData values and not 0 values. Should this matter, as long as I scale those NoData values to 0 in the tool?

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

DavidYeany — Thu, 08 Sep 2016 13:21:44 GMT

Should it matter whether rasters are 'signed' or 'unsigned'?

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

DanPatterson_Retired — Thu, 08 Sep 2016 20:53:46 GMT

you are using arcmap and not Pro... therefore you have limitations to memory access in arcmap, regardless of how much memory you actually have.

options

Background processing, if installed, uses 64 bit and permits larger memory access.
Tiling (dicing) your study area (with a slight overlap) reduces memory, IF you reduce the analysis extent explicitely within the model and/or script and/or tool
skip the model, learn how to script by exporting the python snippet and its associated environment information from the Results window Using the Results window—Help | ArcGIS for Desktop
run with a few samples and incrementally build until it crashes... run your operating system monitoring to monitor memory useage.
try it in ArcGIS Pro

In order dissect a problem, you have to break it into its component parts and sometimes, into smaller bites until you get a full process to work with the desired attributes for a prescribed spatial area. Then you can increase the spatial area. If that fails, decrease the attributes. A balance will be found for the software used, the data types and the processes you are undertaking. The rule of 'baby steps' Good luck

Re: ArcGIS crashing while running Weighted Overlay tool in model builder

BrianHall1 — Mon, 05 Apr 2021 13:29:12 GMT

In my own case, shortening the path length fixed it. I had no spaces. Thanks for your help.