topic Re: 64-bit ArcPy Not releasing Python Process on Completion in Python Questions

64-bit ArcPy Not releasing Python Process on Completion

EricFulcher1 — Thu, 11 Jun 2020 14:02:41 GMT

I'm using a command script to run an arcpy process on ArcMap 10.6 - 64-bit arcpy. On successfully completing the script, the process ends - but doesn't release/kill the python.exe (or pythonw.exe), therefore the bat script hangs and doesn't finish. In the script below, its the arcpy.mapping.ListDataFrames that causes the process to hang (that was fun narrowing down...). Comment it out and python terminates correctly. If i run this in 32 bit python terminates correctly - so just 64 bit. I'm thinking esri bug? Am I missing something?

Thanks,
Eric

Cleaned up script (may have missed something here) but it says the script is Finished.

import arcpy
import string
import gc

def main():
print("Completion Script is Starting")

mxd = arcpy.mapping.MapDocument("D:\WOBufferScripts\LeakSurveyScripts.mxd")
# Running this causes python to not close.
dataFrame = arcpy.mapping.ListDataFrames(mxd)[0]
del dataFrame
del mxd
gc.collect()
print("Completion Script Has Finished")

if __name__ == "__main__":
main()

Re: 64-bit ArcPy Not releasing Python Process on Completion

DanPatterson — Thu, 11 Jun 2020 15:24:20 GMT

You mention batch file. Does the script terminate outside of the batch file?

Re: 64-bit ArcPy Not releasing Python Process on Completion

EricFulcher1 — Thu, 11 Jun 2020 15:53:13 GMT

its a runscript.bat file and no it never returns from the python process.

This is just me typing quick but

arcpy script1.py

arcpy.script2.py

It never gets to script2 even tho script1 is in fact finished.

Re: 64-bit ArcPy Not releasing Python Process on Completion

JoshuaBixby — Fri, 12 Jun 2020 15:31:38 GMT

How many MXDs have you tried it with? Does it fail on all of them or just this one?

Re: 64-bit ArcPy Not releasing Python Process on Completion

EricFulcher1 — Fri, 12 Jun 2020 19:29:49 GMT

You have value Joshua! Created new mxd, added 2 layers and the process closed successfully. It was a 10.2.1 mxd originally. wonder what it doesn't like.....

Thank You!

Re: 64-bit ArcPy Not releasing Python Process on Completion

DanPatterson — Fri, 12 Jun 2020 19:55:41 GMT

I marked Joshua Bixby‌ 's answer correct since he provided the hint as to the check you didn't try

Re: 64-bit ArcPy Not releasing Python Process on Completion

JoshuaBixby — Fri, 12 Jun 2020 20:41:12 GMT

64-bit ArcGIS (ArcPy and other software) doesn't support all workspaces that 32-bit ArcGIS does, e.g., personal geodatabases. If the MXD contains one of these workspaces, a 64-bit process can easily hang trying to process it.

Re: 64-bit ArcPy Not releasing Python Process on Completion

EricFulcher1 — Wed, 24 Jun 2020 23:06:10 GMT

I don't see how you have the POV to mark this correct. Must get reputation points or something.

Re: 64-bit ArcPy Not releasing Python Process on Completion

EricFulcher1 — Wed, 24 Jun 2020 23:11:52 GMT

Thanks Joshua. Actually - the mxd has about 20 SDE Feature classes. I found if I rebuild the mxd from scratch (same FCs) - same issue. But by trial and error - if I remove one FC (Oracle SDE GDB) it magically works now. Go figure.....Doubt I'll get esri to debug this. Other FCs in the same feature dataset dont' impact it. weird......

Re: 64-bit ArcPy Not releasing Python Process on Completion

ChrisWalsh — Mon, 12 Oct 2020 13:52:19 GMT

Is there a way to identify incompatible workspaces? I'm currently running into this similar issue where an automated publishing script running on 64 Bit Arcpy doesn't release it's process. This script has been working for years for multiple mxd's, but has only just now shown this behaviour after we upgraded to ArcServer 10.8.

Re: 64-bit ArcPy Not releasing Python Process on Completion

JoshuaBixby — Mon, 12 Oct 2020 15:29:45 GMT

I assume this is still in relation to Oracle EGDB FCs, so this reply is coming from that angle/perspective.

after we upgraded to ArcServer 10.8

Can you elaborate? Did you mean you upgraded the Oracle EGDB schema to 10.8? Or, are you running the scripts from ArcPy on ArcGIS Enterprise machines and those were upgraded to 10.8? Or, do you mean both?

Re: 64-bit ArcPy Not releasing Python Process on Completion

ChrisWalsh — Tue, 13 Oct 2020 10:20:19 GMT

Apologies, the update to 10.8 seems to have nothing to do with it. I tried running our automated publishing script against a 10.6 environment and the same thing is happening. 10.6.1 Server, 10.6.1 schema.

Re: 64-bit ArcPy Not releasing Python Process on Completion

PaulBatley — Fri, 22 Jan 2021 16:14:31 GMT

Hey, We're getting the same issue for both 32 & 64bit and it only started happening around an installed Windows update KB4593226. Prior to the update our python jobs running via Scheduled Tasks runs through but will not run on the next schedule as the process is already running, due to the fact the process never terminates. We have debugged sys.exit() and it is firing correctly. Our only workaround is to have the following code:
os.kill(os.getpid(),9)
This ensures the process terminates and that batch processing continues.

Re: 64-bit ArcPy Not releasing Python Process on Completion

RTRC_BOGLicense_Mgr — Fri, 19 Feb 2021 12:28:11 GMT

Hi Paul, I have the same problem, only with your suggestion the process ends. Thanks.

Re: 64-bit ArcPy Not releasing Python Process on Completion

PaulBatley — Tue, 23 Feb 2021 10:50:43 GMT

Hi,
Just to update further. After KB4598243 which superceded the patch mentioned above, the issue started affecting the Interop tool too. With the FME.exe process now not closing down and causing a further problem as the file handles for the logging were inherited and therefore the python Scheduled Task couldn't re-run because of the orphaned FME process. The code below resolved the orphaned FME not shutting down with the Standard signum (,9) kill signal.

## Python for dealing with child processes
parentProcess = psutil.Process(os.getpid())
children = parentProcess.children(recursive=True)
for ofspring in children:
localLogger.write("Child ProcessID: {}".format(ofspring.pid) + " terminating...")
os.kill(ofspring.pid,9)
localLogger.write("Python Process PID: {}".format(os.getpid()) + " terminating...")
os.kill(os.getpid(),9)

Re: 64-bit ArcPy Not releasing Python Process on Completion

EricFulcher1 — Wed, 22 Sep 2021 19:40:09 GMT

Sweet - I'm going to so try this.

Thanks!

Re: 64-bit ArcPy Not releasing Python Process on Completion

willemjenniskens — Wed, 06 Oct 2021 21:46:07 GMT

Great solution! This fixes it for me and should be marked as the solution imo.

Re: 64-bit ArcPy Not releasing Python Process on Completion

EricFulcher1 — Thu, 07 Oct 2021 13:02:06 GMT

If I could figure out how to change the solution flag - I would. Somebody looking for points marked it as solved.... But yes this is the solution.

Re: 64-bit ArcPy Not releasing Python Process on Completion

DarrylKlassen1 — Wed, 11 Jan 2023 16:22:35 GMT

Thanks, this worked great for me. My PY was completing but not exiting and moving on to the next script in the BAT file. Once I added that piece of code at the end, works great.