topic Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1 in Geoprocessing Questions

Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1?

AlanStewart — Thu, 09 May 2013 16:39:42 GMT

I have both installed on the same box. There are DTBGGP64.pth and a Server10.1.pth files in the C:\Python27\ArcGISx6410.1\Lib\site-packages folder. The first points to the the C:\Program Files (x86)\ArcGIS\Desktop10.1\bin64 folder and the second points to the C:\Program Files\ArcGIS\Server\bin folder. This seems to be a conflict.

When I enable background processing and debug into a Python geoprocessing task it fails when arcpy is imported. Printing sys.path reveals:

>>> sys.path: ['C:\\ARCGIS~1\\GEOPRO~1\\TGT_GP~1\\Scripts', 'C:\\ARCGIS~1\\GEOPRO~1\\TGT_GP~1\\Scripts', 'c:\\program files (x86)\\arcgis\\desktop10.1\\bin', 'c:\\program files (x86)\\arcgis\\desktop10.1\\ArcPy', 'c:\\program files (x86)\\arcgis\\desktop10.1\\ArcToolbox\\Scripts', 'C:\\arcgisserver\\geoprocessing\\TGT_GPExporter\\ExportGeoPDF.tbx', 'C:\\Windows\\system32\\python27.zip', 'C:\\Python27\\ARCGIS~1.1\\DLLs', 'C:\\Python27\\ARCGIS~1.1\\lib', 'C:\\Python27\\ARCGIS~1.1\\lib\\plat-win', 'C:\\Python27\\ARCGIS~1.1\\lib\\lib-tk', 'C:\\Python27\\ARCGIS~1.1\\Lib\\SITE-P~1\\PYTHON~1', 'C:\\Python27\\ARCGIS~1.1', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages', 'C:\\Program Files (x86)\\ArcGIS\\Desktop10.1\\bin64', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages\\win32', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages\\win32\\lib', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages\\Pythonwin', 'C:\\Program Files\\ArcGIS\\Server\\bin', 'C:\\Program Files\\ArcGIS\\Server\\arcpy', 'C:\\Program Files\\ArcGIS\\Server\\ArcToolbox\\Scripts']

Note that it is pointing to the 32-bit Desktop bin folder, before the 64-bit Desktop bin64 folder is pointed to. Where is all these extra path entries coming from?

I need to publish the geoprocessing task to Server. In the past we have used ArcMap on the Server box in authoring our web applications, which call a geoprocessing task. Is this not possible anymore?

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

KevinHibma — Thu, 09 May 2013 17:07:50 GMT

The two .PTH files are fine. 64bit BG and Server share 64bit Python.

Whats the error you get while importing arcpy?

It looks like you've done the sys.path print from the Python window in ArcMap?
Heres the output of print sys.path in the Python window. Not quite the same as yours.

>>> sys.path
['C:\\Python27\\ArcGISx6410.2', u'c:\\program files (x86)\\arcgis\\desktop10.2\\arcpy', 'C:\\QATest\\py\\pyharness', 'C:\\Windows\\system32\\python27.zip', 'C:\\Python27\\ArcGIS10.2\\Lib', 'C:\\Python27\\ArcGIS10.2\\DLLs', 'C:\\Python27\\ArcGIS10.2\\Lib\\lib-tk', 'c:\\gpServices\\Sanity\\queryLayer', 'C:\\Program Files (x86)\\ArcGIS\\Desktop10.2\\bin', 'C:\\Python27\\ArcGIS10.2', 'C:\\Python27\\ArcGIS10.2\\lib\\site-packages', 'C:\\Program Files (x86)\\ArcGIS\\Desktop10.2\\arcpy', 'C:\\Program Files (x86)\\ArcGIS\\Desktop10.2\\ArcToolbox\\Scripts']

Do you have Python entries in your actual PATH environment variable?
Do you have a PYTHONPATH environment variable pointing at something?

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Thu, 09 May 2013 19:10:16 GMT

The two .PTH files are fine. 64bit BG and Server share 64bit Python.

As long as any differences between the versions of the arcgisscripting.pyd files at both locations don't cause problems running the same script in Server and ArcMap BGGP64.

Whats the error you get while importing arcpy?

>>> Unhandled exception while debugging...
Traceback (most recent call last):
File "C:\ARCGIS~1\GEOPRO~1\TGT_GP~1\Scripts\ExportGeoPdfScript.py", line 47, in <module>
    import arcpy
File "c:\program files (x86)\arcgis\desktop10.1\ArcPy\arcpy\__init__.py", line 21, in <module>
    from arcpy.geoprocessing import gp
File "c:\program files (x86)\arcgis\desktop10.1\ArcPy\arcpy\geoprocessing\__init__.py", line 14, in <module>
    from _base import *
File "c:\program files (x86)\arcgis\desktop10.1\ArcPy\arcpy\geoprocessing\_base.py", line 14, in <module>
    import arcgisscripting
ImportError: DLL load failed: %1 is not a valid Win32 application.

It looks like you've done the sys.path print from the Python window in ArcMap?

Yep, I inserted it into my script immediately before the import statement for arcpy.

Do you have Python entries in your actual PATH environment variable?
Do you have a PYTHONPATH environment variable pointing at something?

No and no.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

KevinHibma — Thu, 09 May 2013 19:17:31 GMT

The arcgisscripting.pyd is the same file used in both Server and 64bit BG.

Thats the error I suspected you were getting. Its 32bit trying to call into 64bit. Some wire, somewhere has been crossed and its trying to use the wrong libraries.

Are you running a script tool out of process? If so, can you try running in process?

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Thu, 09 May 2013 19:31:00 GMT

Are you running a script tool out of process? If so, can you try running in process?

Yes, I had the 'Run Python script in process' option in the Source tab unchecked. However, checking it makes no difference.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

KevinHibma — Thu, 09 May 2013 19:33:05 GMT

I'm running out of ideas....

Any chance your script is calling subprocess or multiprocess?
That is, something in your script is making threads or other processes or even doing a os.command?

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Thu, 09 May 2013 19:42:58 GMT

Any chance your script is calling subprocess or multiprocess?
That is, something in your script is making threads or other processes or even doing a os.command?

I use os.getpid(). Why would that cause a problem? I'll try it without.

Here's the entire script, up to the point where it blows up:

import sys
import string
import os
import shutil
import uuid
import platform
import getpass
import time

print("@@@@@@@@@@@@@@@@@@@@@@")
print("Python version: " + platform.python_version())
print("Python compiler: " + platform.python_compiler())
print("Python interpreter: " + string.join(platform.architecture()))

is64Bits = False
if sys.maxsize > 2**32:
    is64Bits = True

print("Is a 64 bit architecutre: %s" % is64Bits)
print("PID: %s" % os.getpid())
print("User: " + getpass.getuser())

print("sys.path: %s" % sys.path)

import arcpy

Here's the output in the PythonWin 64-bit debugger:

PythonWin 2.7.2 (default, Jun 12 2011, 14:24:46) [MSC v.1500 64 bit (AMD64)] on win32.
Portions Copyright 1994-2008 Mark Hammond - see 'Help/About PythonWin' for further copyright information.
>>> @@@@@@@@@@@@@@@@@@@@@@
>>> Python version: 2.7.2
>>> Python compiler: MSC v.1500 64 bit (AMD64)
>>> Python interpreter: 64bit WindowsPE
>>> Is a 64 bit architecutre: True
>>> PID: 3036
>>> User: Alan
>>> sys.path: ['C:\\ARCGIS~1\\GEOPRO~1\\TGT_GP~1\\Scripts', 'C:\\ARCGIS~1\\GEOPRO~1\\TGT_GP~1\\Scripts', 'c:\\program files (x86)\\arcgis\\desktop10.1\\bin', 'c:\\program files (x86)\\arcgis\\desktop10.1\\ArcPy', 'c:\\program files (x86)\\arcgis\\desktop10.1\\ArcToolbox\\Scripts', 'C:\\arcgisserver\\geoprocessing\\TGT_GPExporter\\ExportGeoPDF.tbx', 'C:\\Windows\\system32\\python27.zip', 'C:\\Python27\\ARCGIS~1.1\\DLLs', 'C:\\Python27\\ARCGIS~1.1\\lib', 'C:\\Python27\\ARCGIS~1.1\\lib\\plat-win', 'C:\\Python27\\ARCGIS~1.1\\lib\\lib-tk', 'C:\\Python27\\ARCGIS~1.1\\Lib\\SITE-P~1\\PYTHON~1', 'C:\\Python27\\ARCGIS~1.1', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages', 'C:\\Program Files (x86)\\ArcGIS\\Desktop10.1\\bin64', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages\\win32', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages\\win32\\lib', 'C:\\Python27\\ARCGIS~1.1\\lib\\site-packages\\Pythonwin', 'C:\\Program Files\\ArcGIS\\Server\\bin', 'C:\\Program Files\\ArcGIS\\Server\\arcpy', 'C:\\Program Files\\ArcGIS\\Server\\ArcToolbox\\Scripts']
>>> Unhandled exception while debugging...
Traceback (most recent call last):
File "C:\ARCGIS~1\GEOPRO~1\TGT_GP~1\Scripts\ExportGeoPdfScript.py", line 45, in <module>
    import arcpy
File "c:\program files (x86)\arcgis\desktop10.1\ArcPy\arcpy\__init__.py", line 21, in <module>
    from arcpy.geoprocessing import gp
File "c:\program files (x86)\arcgis\desktop10.1\ArcPy\arcpy\geoprocessing\__init__.py", line 14, in <module>
    from _base import *
File "c:\program files (x86)\arcgis\desktop10.1\ArcPy\arcpy\geoprocessing\_base.py", line 14, in <module>
    import arcgisscripting
ImportError: DLL load failed: %1 is not a valid Win32 application.
[Dbg]>>>

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Thu, 09 May 2013 19:51:54 GMT

That is, something in your script is making threads or other processes or even doing a os.command?

I took out all of the imports other than sys and string and any code dependent on the removed imports. The end result is the same.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Fri, 10 May 2013 17:31:12 GMT

I've added the BGGP64 update to another machine with only Desktop 10.1 SP1 installed and am seeing the exact same issue, so it's not the presence of ArcGIS Server that is messing things up. Both machines are Win 7.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

curtvprice — Sat, 11 May 2013 03:49:42 GMT

Clearly you do have 32-bit paths in your sys.path that do not belong there when you are running the 64-bit python. The question is where they are coming from.

This sure looks like something you'd want to open a support incident to get to the bottom of the issue.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Mon, 13 May 2013 14:14:32 GMT

It has miraculously started working. I did nothing other than update the legacy "import arcgisscripting... arcgisscripting.create()" to "import arcpy" and rearranging some of the embedded debugging messages.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Tue, 14 May 2013 12:06:45 GMT

I may have this figured out. For me the breakage seems to only happen when using the 64-bit version of PythonWin and only when ArcMap opens PythonWin. I.e., Pythonwin is closed when the debug session is started from ArcMap.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

AlanStewart — Tue, 14 May 2013 18:24:03 GMT

ESRI tells me the issue also occurs when ArcMap is set to use 64-bit PythonWin as the Python editor. NIM091620 has been created to address the issue.

Re: Is ArcMap 10.1 64-bit background geoprocessing compatible with ArcGIS Server 10.1

KevinHibma — Fri, 10 Dec 2021 21:07:50 GMT

Based on the information your presented here and the bug that was logged, we now know its because of the path and its contents when you launch an IDE from ArcMap (right click on script > edit for example).
If you launch the IDE by itself, the path is fine.
When launched from ArcMap you'll see the 32bit path in the sys.path: c:\\program files (x86)\\arcgis\\desktop10.1\\bin

As a hack, you could do this:

import sys
sys.path.remove('c:\\program files (x86)\\arcgis\\desktop10.1\\bin')
import arcpy
#rest of your script

Or if you're using an IDE that you set the Python interrupter, like WING for example, you can qualify which Python it should run against (like the 32bit one)
Or using a 32bit IDE will work fine as well.