topic Re: It appears "in_memory" is not really in memory. in Python Questions

It appears "in_memory" is not really in memory.

DougMcGeehan — Sun, 12 Dec 2021 08:02:11 GMT

I have ArcCatalog 10.0 from the ArcGIS Desktop 10 SP4 suite. Just now, I pulled up the interactive Python window to test some code out in the application's interpreter.

>>> result = arcpy.CreateFeatureclass_management(out_path="in_memory", out_name="in_memory_junk")
>>> type(result)
<class 'arcpy.arcobjects.arcobjects.Result'>
>>> print str(result)
<Result 'C:\\Users\\DMCGEE~1\\AppData\\Local\\Temp\\2\\j6cc4de20957342a3aa8cda7d65b8cc7a.gdb\\in_memory_junk'>

I wasn't expecting to see the result of CreateFeatureclass to reside a temporary file geodatabase in the C:\Users\DMCGEE~1\AppData\Local\Temp\2\ directory. However, it's there, as indicated in the screenshot below.

[ATTACH=CONFIG]15140[/ATTACH]

I realize the documentation for in-memory workspaces indicates that "when data is written to the in-memory workspace, the computer's physical memory (RAM) is consumed", but the fact that the temporary file geodatabase is located in a temporary directory makes me think otherwise.

Re: It appears "in_memory" is not really in memory.

MathewCoyle — Tue, 12 Jun 2012 18:12:54 GMT

in_memory workspace is in memory with a temporary reference to a directory on disk. It should disappear once you close the process it was opened in.

Re: It appears "in_memory" is not really in memory.

DougMcGeehan — Tue, 12 Jun 2012 18:50:18 GMT

I haven't been working with ArcGIS for long, so I haven't had the opportunity to test in-memory feature classes to witness any measurable differences. I'll take your word for it, but the idea of a file on disk referencing data in memory doesn't seem very feasible without some sort of low-level process actively translating file-reads to RAM-reads.

Re: It appears "in_memory" is not really in memory.

KevinHibma — Sun, 12 Dec 2021 08:02:14 GMT

Are you using Background Processing?
Processing in the background means sending the features you want to process over to another process and then getting a result back.
Because its another process we have to persist them to disk for ArcMap to read them on the way back.

Heres the same command with BG on and BG off (foreground processing/processing inside ArcMap):

>>> arcpy.CreateFeatureclass_management("in_memory", "foooo")
<Result 'C:\\Users\\kevi5105\\AppData\\Local\\Temp\\arcC8DF\\jbf5bcaebf45a4c28bfe57a0e27b6e65a.gdb\\foooo'>
>>> arcpy.CreateFeatureclass_management("in_memory", "foooo2")
<Result 'in_memory\\foooo2'>

Re: It appears "in_memory" is not really in memory.

DougMcGeehan — Wed, 13 Jun 2012 11:40:17 GMT

Are you using Background Processing?

I'm sure the interactive Python window in ArcCatalog is a background process. This would explain the temporary file geodatabase on disk. Are all 'in_memory' feature classes stored in this way for background processes?

Re: It appears "in_memory" is not really in memory.

KevinHibma — Wed, 13 Jun 2012 14:06:53 GMT

To say the Python window is a background process isn't really correct.
See this link, hopefully it'll explain background processing. You can enable/disable it and see the different results.
http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#//00210000003q000000

Re: It appears "in_memory" is not really in memory.

MarcoBoeringa — Wed, 20 Jun 2012 13:12:01 GMT

Are you using Background Processing?
Processing in the background means sending the features you want to process over to another process and then getting a result back.
Because its another process we have to persist them to disk for ArcMap to read them on the way back.

Why o why didn't ESRI document this crucial factor in getting in_memory to work in the Help file???

I really can not find it in the main in_memory Help topic. This issue regarding background processing should be added under the "The following considerations must be made in deciding to write output to the in-memory workspace" text line. I have been struggling with this issue too.

topic Re: It appears "in_memory" is not really in memory. in Python Questions

It appears &quot;in_memory&quot; is not really in memory.

Re: It appears "in_memory" is not really in memory.

Re: It appears "in_memory" is not really in memory.

Re: It appears "in_memory" is not really in memory.

Re: It appears "in_memory" is not really in memory.

Re: It appears "in_memory" is not really in memory.

Re: It appears "in_memory" is not really in memory.

It appears "in_memory" is not really in memory.