topic Re: Arcpy Pro crash when using memory or in_memory in Python Questions

Arcpy Pro crash when using memory or in_memory

HarrySmiles — Tue, 28 Feb 2023 23:31:47 GMT

I updated from ArcGIS Pro 3.0.3 to 3.1 yesterday, and since then any time I try to write anything into "memory" or "in_memory" it causes ArcGIS Pro to crash.

This is an example of some code, but everything I have tried with memory or in_memory causes the same issue.

arcpy.MakeFeatureLayer_management(input_locations, input_location_layer, f"{input_name_field} = '{location}'")

arcpy.CopyFeatures_management(input_location_layer, f"memory\\{location}_facility")

I have tried doing a full uninstall (including deleting all the Pro folders and registry entries), and I've also tried creating a new Python Environment but get the same issue.

Any ideas?

Re: Arcpy Pro crash when using memory or in_memory

DanPatterson — Wed, 01 Mar 2023 00:49:54 GMT

to test, skip the substitution and use the actual field names and locations

eg dump, f"{input_name_field} = '{location}'") and this f"memory\\{location}_facility"

Re: Arcpy Pro crash when using memory or in_memory

HarrySmiles — Wed, 01 Mar 2023 02:38:42 GMT

I tried running the code in a notebook outside of the loop with everything hard coded and get the same issue unfortunately.

arcpy.MakeFeatureLayer_management(input_locations, 'location_layer_CRAN', "code = 'CRAN'")

arcpy.CopyFeatures_management('location_layer_CRAN', "memory\\CRAN_facility")

I don't know enough about the how the memory or in_memory workspaces work to debug this but I'm now confident they are the issue. I created a tempory filegeodatabase and used that instead of memory and it works.

arcpy.MakeFeatureLayer_management(input_locations, 'location_layer_CRAN', "code = 'CRAN'")

arcpy.CopyFeatures_management('location_layer_CRAN', "c:\\aaa\\temp.gdb\\CRAN_facility")

Re: Arcpy Pro crash when using memory or in_memory

Anonymous User — Wed, 01 Mar 2023 03:02:21 GMT

Try adding a '\' to the memory: "\\memory\\CRAN_facility"

There is another thread on here that memory\\ fails, but \memory\\ works. I'll try to link it for reference.

Edit- Here is the thread.

Re: Arcpy Pro crash when using memory or in_memory

HarrySmiles — Wed, 01 Mar 2023 03:11:07 GMT

Thanks for the reply, but unfortunatley I now get this error:

ERROR 000210: Cannot create output \memory\CRAN_facility

That is using.

arcpy.CopyFeatures_management('location_layer_CRAN', "\\memory\\CRAN_facility")

arcpy.CopyFeatures_management('location_layer_CRAN', "\memory\\CRAN_facility")

Re: Arcpy Pro crash when using memory or in_memory

Anonymous User — Wed, 01 Mar 2023 03:20:26 GMT

Man, that is troublesome! How about os.path.join('memory', 'CRAN_facility')?

Re: Arcpy Pro crash when using memory or in_memory

Anonymous User — Wed, 01 Mar 2023 03:32:00 GMT

Try adding the r decorator to the string. These two worked for me, but the "memory\\CRAN_facility" gave me the error that you received.

arcpy.CopyFeatures_management(fc, r"memory\CRAN_facility") arcpy.CopyFeatures_management(fc, os.path.join("memory", "CRAN_facility2"))

Re: Arcpy Pro crash when using memory or in_memory

HarrySmiles — Wed, 01 Mar 2023 03:39:24 GMT

Same thing I'm afraid. I don't know enough about the underlying mechanism of the memory or in_memory workspaces, but I have a feeling that something has either moved with the upgrade or something got corrupted.

That said I kind of assumed that a full reinstall would have fixed the issue and it didn't.

I have tried running the code on a colleges computer and it worked on that one, which was also updated Pro to 3.1 yesterday. That tells me it isn't a code issue but an Arcpy or Python issue.

I have also tried cloning the environment but I get the same issue with the clone.

Re: Arcpy Pro crash when using memory or in_memory

ShaunWalbridge — Wed, 01 Mar 2023 04:49:39 GMT

Have you submitted the crash dumps? If you send one to me, I can take a quick look to see if it's anything obvious. Are you using the default `arcgispro-py3` environment, or a custom environment?

Re: Arcpy Pro crash when using memory or in_memory

HarrySmiles — Wed, 01 Mar 2023 04:59:52 GMT

Thanks Shaun.

Our work firewall seems to block sending the dump but here is one.

That was using the default environment, but I have also cloned it and get the same. I did try to create a new environment using conda, then installed the arcpy package. When I try to import arcpy using that environment I got the below error so I gave up on that.

ImportError: DLL load failed while importing _arcgisscripting: The specified module could not be found.

Re: Arcpy Pro crash when using memory or in_memory

ShaunWalbridge — Wed, 01 Mar 2023 05:10:47 GMT

OK, thanks for a quick post. It looks like the crash is happening very low level in the stack, when trying to read the relationship classes of the data. Is this dataset you're working with particularly old or otherwise have any special characteristics? I'm suspicious that there potentially is some lower level issue based on the fact that it failed again after a reinstallation and was working on your colleagues machine, unfortunately nothing obvious from that crash dump to point at a clear cause other than the relationship classes functions being loaded from a DLL fail.

Re: Arcpy Pro crash when using memory or in_memory

HarrySmiles — Wed, 01 Mar 2023 05:17:51 GMT

Hi Shaun,

Here is a subset of the input data. I tested and get the same issue with this. I don't think it is related to the input data as it works on a different computer, reading the same data from the network drive. I have also tried it locally on my computer with no luck.

Cheers

Re: Arcpy Pro crash when using memory or in_memory

HarrySmiles — Wed, 01 Mar 2023 23:15:21 GMT

After some advise I tried another uninstall and full folder wipe, then reinstalled and it seems to have fixed the issue. I'm not sure what changed as I had done that, but I'm back up and running now.

Thanks