topic Re: Arcmap crashing/shutting down in ArcGIS Spatial Analyst Questions

Arcmap crashing/shutting down

RobertoFilloramo — Mon, 26 Mar 2018 14:41:07 GMT

Hi,

I have a problem with my Arcmap (v.10.3.1), I am trying to use the contour tool using the deriving data from my DTM (8mt) but it doesn't work. I used this file for other tool and it always worked. Anyway, I presumed that it was the file the problem, so I started to use the Slope file as attempt but when I try to use the contour tool Arcmap crashes blocking itself or shutting down directly.

In your opinion, what could be the cause?

Thank you in advance

Regards

Roberto

Re: Arcmap crashing/shutting down

DanPatterson_Retired — Mon, 26 Mar 2018 15:01:55 GMT

Not enough information.

source and type of data?

nature and location of files?

computer specs?

Just this data? or any data?

Only you? or anyone on your machine?

That should get you started.

Is this a Discussion? or did you mean to make it a Question?

Re: Arcmap crashing/shutting down

RobertoFilloramo — Mon, 26 Mar 2018 17:29:02 GMT

Actually it is a question...

So, the DTM (8x8 cell and it is a merging result form other form the same source) comes from the Apulia Region website (Italy), I used it for all my process in Arcmap. But I don't know now it didn't work... I used the DTM for applying the Tobler's function as described here: Week 9 - Anisotropic cost surfaces and Least-cost paths | www.MapAspects.org . So it worked up to the Path Distance (part B, step2), but just once.

So I tried to use another method (ArcGIS Tutorial: Tobler's Hiking Function | Kaitlin Hakanson - Academia.edu ), but in this case the DTM didn't work at all. So, just as attempt I used the Slope (generated from the DTM), it worked up to the point 4, because when I tried to use the contour tool Arcmap crashed or shutted down directly.

The file are stored in a separated folder in the second HD subdivision, that it is not that one in which was installed the program and where it is the default database (but since now I worked like this without problem), in my laptop (the only machine with which I used to work).

I attached some specs on my DTM and PC (you have to consider that the HD subdivision in which is installed ArcGIS has free 95.4 GB on 372GB (276GB used); while the second one 487 GB free on 537 GB (49.6 GB used).

I hope that in this way it is more clear.

Thank you in advance.

Regards

Roberto

Re: Arcmap crashing/shutting down

DanPatterson_Retired — Mon, 26 Mar 2018 17:36:41 GMT

It is projected, it is a big file and you are doing this in arcmap.

Try it in PRO which will use your available memory which is still pretty slim for raster analysis like that.

To test... clip out a small area, use it to make sure there is nothing wrong with the file type etc.

I suspect it is your resources

The cpu memory and video memory recommendations for ArcMap and PRO should be considered the absolute minimum... to use on a good day with small-ish files...

For big stuff, tiling, mem-mapping and other workarounds can come into play.

To see what is actually going on, run your system monitoring when you run tools with rasters and observe..

Re: Arcmap crashing/shutting down

RobertoFilloramo — Tue, 27 Mar 2018 09:19:19 GMT

Dear Dan,

Thank you for your suggestions... I observed the monitoring system and actually the RAM involved it was almost the 70% using the contour tool, yet it stopped at the 6% so I thing it was a memory problem. Therefore, I tried to clip my DTM and I followed the steps as in the guideline (ArcGIS Tutorial: Tobler's Hiking Function | Kaitlin Hakanson - Academia.edu). It worked correctly up to the point 4, yet when I used the contour tool it didn't work again (it reached the 3/4%) then I launched the tool a second and a third times but it failed directly.

So, I guess that I should attempt to do it in PRO (as you said) or maybe to expand my RAM, just because the file clipped or not seem to work for the other tools.

Thanks

Regards

Roberto

Re: Arcmap crashing/shutting down

XanderBakker — Tue, 27 Mar 2018 11:40:29 GMT

So your raster has 10,435 * 4,951 = 51,663,685 pixels and usig a pixel depth of 32 bits (4 bytes per pixel) results in a raster of 197.08MB. This is really not very big considering the fact that I have processed rasters in the past with a size of 30GB (although I did use SSD drives for fast IO).Also have a look here: FAQ: What is the maximum size a raster Grid can be?

You are using a Esri Grid raster and a path that is pretty long and it might be good to make the path shorter (see storage limitations in this topic: Esri Grid format—Help | ArcGIS Desktop ).It might also be more efficient to work with a raster inside a File Geodatabase. If tools are not working, there might be something wrong with your data.

Re: Arcmap crashing/shutting down

RobertoFilloramo — Wed, 28 Mar 2018 11:27:44 GMT

Thank you for the reply Xander, I tried to make shorter the path and putting the data bulk into a unique geodatabase but I still continue to have problem only using the path distance tool. It sounds strange because I used the same DTM for cost distance, euclidean distance, cost path, slope, viewshed tools with reasonable results. Moreover, although the DTM was obtained from a merging, all the single DTM tiles come from an official site. Could it be the use of the Tobler's function table (as explained both in the web page link and in the academia.edu link)?

Re: Arcmap crashing/shutting down

XanderBakker — Wed, 28 Mar 2018 11:47:23 GMT

The Path Distance—Help | ArcGIS Desktop tool is a pretty complex tool with a lot of optional parameters. Can you specify which parameters are you using and what ranges of values the raster have that you are using for the parameters? Is it possible to attach (part of) the data?

Re: Arcmap crashing/shutting down

RobertoFilloramo — Wed, 28 Mar 2018 14:53:47 GMT

So the path distance worked, but I still have problem (that it is the hardest now) with the contour tool, since when I launch after a while ArcGIS shuts down or crashes or blocks. So I tried to attached here my files, but without success... If it is possible, may I have your email in order to send you?

Thank your for your patience and time.

Regards

Roberto

Re: Arcmap crashing/shutting down

SteveLynch — Wed, 28 Mar 2018 15:06:15 GMT

I don't believe that the size of the raster alone is causing the crash. I think that the contour interval, ArcMap v10.3.1, 32 bit processing and the size of the raster are the causes (listed in order).

Let us try and debug the problem;

- Slope works, this means that the raster is not corrupted

- use a larger contour interval (what is the min/max value in the raster?)

- if the above works, then it is a memory issue, we've added more error checks in subsequent versions.

-Steve

Re: Arcmap crashing/shutting down

RobertoFilloramo — Wed, 28 Mar 2018 15:29:19 GMT

hi Steve,

the interval that I used was 15, but also with 10 I had the same problem.

Yes, it is not the first time that I gained the slope from this DTM and always it worked.

Thanks

Roberto

Re: Arcmap crashing/shutting down

SteveLynch — Wed, 28 Mar 2018 15:38:39 GMT

Roberto

What is the min/max value in the raster?

and is the output going to a shapefile of file geodatabase?

-Steve

Re: Arcmap crashing/shutting down

RobertoFilloramo — Thu, 29 Mar 2018 16:23:56 GMT

the raster has as max "High : 1,94202e+006" and min "Low : 0", while the output going to a shapefile

Roberto

Re: Arcmap crashing/shutting down

SteveLynch — Thu, 29 Mar 2018 16:35:54 GMT

Roberto

Wow, that answers all my questions. Values between 0 and circa 2 million with a interval of 10 and output to shapefile.

A shapefile file cannot exceed 2.1GB (on disk, this is a Microsoft limitation).

Please try output to file geodatabase and for testing purposes please use a contour interval of 500000.

Thanks

-Steve

Re: Arcmap crashing/shutting down

RobertoFilloramo — Thu, 29 Mar 2018 16:46:54 GMT

So, I stored it in a geodatabase and put your value.... It worked! Thank you!!!

But now I need to work with low contour values, because for it is the time lapse that someone could take to cross the landscape...so, should I resize the raster or there is another way?

Roberto

Re: Arcmap crashing/shutting down

SteveLynch — Thu, 29 Mar 2018 17:05:20 GMT

OK, now we've established that the Contour tool is working.

Contour lines are similar to when you slice a potato. If your range is large and you have a small contour interval it means that many lines will be created. In your case it'll create contours at 10, 20, 30, 40, ..., 2 million.

Do you only want lines, for example, at 10, 20, 30 and 50? If so rather use the ContourList tool or create a new raster that only has values between 0 and ~50 and use the Contour tool.

-Steve

Re: Arcmap crashing/shutting down

RobertoFilloramo — Thu, 29 Mar 2018 17:12:42 GMT

Sorry, it is not clear to me.... So, I have to use the contour tool setting intervals like "10, 20, 30, 50", did I understand well? Anyway, I need the lines to estimate graphically the walking time lapse.

Roberto

Re: Arcmap crashing/shutting down

SteveLynch — Thu, 29 Mar 2018 17:31:34 GMT

You need to use the ContourList tool

Re: Arcmap crashing/shutting down

SteveLynch — Thu, 29 Mar 2018 17:58:35 GMT

Contour will create a line at every, say, 10 (contour interval), so if your min, max =0,100, you’ll get lines at 10, 20, 30, 40, 50 , 60 , 70 , 80, 90

For the same raster, ContourList with lines at, say 10, 55, 90, will create lines at 10, 55, 90

The one is an interval and the other is a list of values at which you want lines.

Re: Arcmap crashing/shutting down

RobertoFilloramo — Thu, 29 Mar 2018 18:25:57 GMT

Thank you for your suggestion!!! I tried using the intervals at 15, 30, 45, 60, 75, 90 and it worked, at least the shp appeared into the layer table of contents yet it didn't show up in the data frame.

Sorry for bothering you

Thanks

Roberto