Python memory error!

2748
4
Jump to solution
06-19-2012 12:08 PM
KevinBell
Deactivated User
I'm no computer science grad, so hopefully one of you geniuses have some insight on this.

I'm running a virtual machine w/ 8 GB ram and trying to scale up a process that works well with smaller amounts of data, but python is throwing a memory error when it uses up about 3 GB of ram.  Is there a setting in python that needs tweaking in order to get it to chew more?  I'd have expected to see more ram get used before choking.


If anyone's interested, the script takes multiple grids with different values and combines them into a single point fc with attributes for each of the grids values.
Tags (2)
0 Kudos
1 Solution

Accepted Solutions
BruceNielsen
Frequent Contributor
I don't think that 32-bit software (ArcGIS & the version of Python that comes with it) can address over 3Gb. You may need to re-work your code so it doesn't use as much memory.

PS: I am a Computer Science grad.

View solution in original post

0 Kudos
4 Replies
BruceNielsen
Frequent Contributor
I don't think that 32-bit software (ArcGIS & the version of Python that comes with it) can address over 3Gb. You may need to re-work your code so it doesn't use as much memory.

PS: I am a Computer Science grad.
0 Kudos
KevinBell
Deactivated User
^^^  thanks!
0 Kudos
KevinHibma
Esri Regular Contributor
This is an interesting article about making your Python setup large address aware.
http://gisgeek.blogspot.com/2012/01/set-32bit-executable-largeaddressaware.html

I'm not encouraging it (use at your own risk), but you may find gains from it.
0 Kudos
MarcoBoeringa
MVP Regular Contributor
You may also wish to have a look at this recent thread, as it discusses issues and solutions regarding 32-bit / 64 bit memory space and Python/ArcGIS too:

Large Dictionary Compression?
http://forums.arcgis.com/threads/58348-Large-Dictionary-Compression?highlight=32+bit+stream+network

Marco
0 Kudos