idea ArcPy in Script Memory Flush in ArcGIS Pro Ideas

ArcPy in Script Memory Flush

MichaelAlires — Wed, 28 Sep 2011 17:06:26 GMT

It would be great to be able to flush my RAM in the midst of a script to prevent my process from being prematurely cancelled out due to a lack of RAM. I am dealing with a number of cursors and files of rows over 1 million. Any ability to clear out the RAM during the operation would be greatly appreciated.

Re: ArcPy in Script Memory Flush

ChrisMathers — Thu, 29 Sep 2011 20:33:23 GMT

That is a big issue with arcpy. You can manually manage python memory use with garbage collection but the geoprocessor has separate memory space than python so you cant actually do anything to that object.

Re: ArcPy in Script Memory Flush

MatthiasMueller — Wed, 26 Oct 2011 09:38:51 GMT

An effective memory management for ArcPy would be desirable. I am executing lots of tools each one taking the input from its predecessor. Memory usage is ever increasing - seems the occupied resources from each tool are not freed until the whole script has finished.

Re: ArcPy in Script Memory Flush

DuncanHornby — Thu, 17 Nov 2011 11:56:31 GMT

It would be great if there was some method on arcpy that purged the memory even if it had a performance hit. If I'm doing large data crunching I'm not going to worry over a few seconds if the data crunching takes several hours. I was imagining something like:

arcpy.ClearMemory

Then behind the scenes this would release cursors and objects that are out of scope etc.

Re: ArcPy in Script Memory Flush

KristinGoff — Wed, 25 Jan 2012 19:12:48 GMT

This is definitely an area of concern for my operation. We are running about 30 automated geprocessing scripts at night.

Re: ArcPy in Script Memory Flush

JamieKass — Thu, 10 Jan 2013 17:51:04 GMT

there need to be more options for tackling heavy geoprocessing than the Dice tool, and a memory flush would help greatly.

Re: ArcPy in Script Memory Flush

MatthiasGlosa — Sun, 03 Mar 2013 15:29:36 GMT

I agree with the previous comments.
My concern is also the crunching of a large database (over 4gb and millions of entries).
After the database, which i want to prozess, reaches a certain size arcpy gives me some error.
When i check my RAM load everything is clear. Even when i use something like "arcpy.Delete_management" there is no reduction in memory load.
Please optimize this. Currently arcpy is unusable in the way i like.

Re: ArcPy in Script Memory Flush

KimOllivier — Mon, 01 Jul 2019 03:51:21 GMT

Maybe that is why using spatialite on large datasets works so much better.