topic Re: Out of memory error in Imagery and Remote Sensing Questions

Out of memory error

AdamBorczyk — Fri, 04 Aug 2017 20:34:10 GMT

Hi,

for the past few days I suddenly started to experience Out Of Memory error coming out of ArcMap. It happens when I'm working with raster Classification tool. I basically draw some training sites on a raster and press 'view histogram' of the sites or 'view scatterplot'. I was able to use it normally until recently. What is strange, I'm able to perform chosen classification with this data, just can't preview histogram/scatterplot/statistics (which is crucial). After some attempts to open these histograms etc., I get ArcMap crashed and a window to send the report appears.

The image I'm working on is ~800mb product of Landsat image (7 bands), but it also happens on any other image.

What I tried to do after getting the error:

- clean up Windows using Disk Cleanup (some temp files etc)

- clean the Default.gdb to zero (that was my scratch space)

- disable all extensions except one which is needed (Spatial Analyst)

- started new project, new .mxd file and load only the raster to work on into it

- create fresh new shapefile of training sites

- restart laptop and Arc of course

I run Windows 7 Pro x64 and ArcGIS 10.5.0.6491. I got 8GB of RAM and 4-core Sandy Bridge CPU. I have 20-30 GB free on my SSD disk. I would appreciate any help, since I cannot do my work at all because of it.

https://community.esri.com/community/gis/managing-data?sr=search&searchId=0f88668d-ed0b-4e6c-8bcf-950639d4d4da&searchIndex=0‌

Re: Out of memory error

DanPatterson_Retired — Fri, 04 Aug 2017 21:39:17 GMT

check your specs against the recommended here

8 Gb of ram is not relevant unless you are using something that supports 64 bit background geoprocessing...

ArcMap is restricted to 4 max., in a perfect world

Check your video specs specifically

And if it works on a more uptodate machine and operating system with better specs you could rule out issues with the data itself

Re: Out of memory error

AdamBorczyk — Fri, 04 Aug 2017 21:54:47 GMT

Hi, thanks for the advice. Unfortunately my laptop has better specs than recommended and it doesn't help. E.g. I run ArcMap with 1GB NVidia card. I'll try to find some new machine to try it, but what puzzles me is that I was successfully using this tool for a few months already! And it suddenly stopped - there must be a way to repair it.

Re: Out of memory error

DanPatterson_Retired — Fri, 04 Aug 2017 22:25:36 GMT

If it worked with that exact same file previously, then it has something to do with your environment or you may need to Repair arcmap (through your operating system in the ininstall/install section, there is a repair... can't remember where exactly in win 7)

Re: Out of memory error

AdamBorczyk — Sat, 05 Aug 2017 12:38:27 GMT

Thank you for your suggestion. I tried both to reinstall ArcGIS package and repairing the installation and so far it works. I hope it won't crash again - then I'll try another machine.

Re: Out of memory error

AdamBorczyk — Sun, 06 Aug 2017 14:24:45 GMT

I think I got this. When processing images, there was a field to (optionally) specify NoData value. There was some value input already and I left it untouched since it was default. This value was 2147483647 (or -2147483647). This got my raster promoted to 32-bit signed integer, because it was 16-bit signed int before. I suppose 32-bit ArcGIS geoprocessing won't handle 2^32 value range in raster, hence the error. Not sure if it's correct what I think, but it behaves like this.

So the point is to observe and take action if some tool wants your NoData to have a value that is above the range of your current raster, because otherwise it promotes it to the next pixel depth range.

I personally used a Copy Raster tool afterwards, where you can specify pixel depth and NoData value.

Re: Out of memory error

DanPatterson_Retired — Sun, 06 Aug 2017 14:29:35 GMT

nodata... environment setting mentions bit promotion and some options on how to avoid it... glad it worked out

Re: Out of memory error

AdamBorczyk — Sat, 12 Aug 2017 20:34:52 GMT

You're right, but the Pricipal Components just doesn't honour this Environment setting.

Re: Out of memory error

XanderBakker — Mon, 14 Aug 2017 14:15:11 GMT

You could create a mask for the area that contains data and use the mask setting which is support by Principal Components—Help | ArcGIS Desktop

Re: Out of memory error

AdamBorczyk — Mon, 14 Aug 2017 16:20:35 GMT

Hi, thanks. This doesn't have any effect on pixel depth though. The advantage is only that you don't need to run separate Clip Raster tool (which takes a long time) - of course in case you actually need any clip.

Re: Out of memory error

NajdALHanahnah — Wed, 01 May 2019 11:30:26 GMT

I have faced the same issue and I found the source of this problem in my case as follow :-

1-Data source unknow (I defined data source).

2-If you have multiple data frame , check the source for each data frame and if the system hanging remove the smallest data frame with low details.

3- close the program and re-open the program.

4-check the symbology used (the source).

I have checked the above instructions and its work with me.