AnsweredAssumed Answered

how to prevent memory use increase in task manager during 'bad' parallel processing?

Question asked by co.bzk on Mar 9, 2016
Latest reply on Mar 10, 2016 by jayanta.poddar

Hi,

 

I am currently trying to perform a model from model builder over 600,000 feature classes in arcgis 10.2 (perhaps 10.2.1 or 10.2.2)

In this model I use these tools (several times): viewshed analysis, raster calculator, extract by attributes, extract by mask, buffer, and erase.

 

To speed up the calculation, I'd like to use parallel processing. But because of urgent deadlines I cannot afford to learn about the correct way to perform it.

I've seen that not all tools can be used in the parallel processing environment and honestly, I don't have the time to check all the tools I use or find alternatives and of course learn to debug the final model with parallelisation in it.

 

Instead, I was told to split the work and run it in several arcgis windows opened at a same time. This works actually pretty well.

But after a time, if I check the Windows Task Manager, the memory use will increase a lot and at the same time the calculation speed will decrease.

Eventually the model crash and I have to start over where it ended.

 

My question is: does anyone no where precisely this comes from? Or more importantly, how to solve the problem.

I run the models from arctoolbox, not from model builder, so intermediate data should be erased at each run of the loop.

 

Thanks in advance for the help!

 

Coline

Outcomes