topic Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine? in Python Questions

Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

SamGuilford — Wed, 28 Nov 2018 16:35:02 GMT

I posted this as a comment on this thread, but as the OP's answer involved messing around copying and pasting files, I think it warrants a new question:

I'm currently running ArcGIS Desktop 10.6 (python 2.7) and ArcGIS Pro 2.2.4 (python 3x) on the same machine. I have also installed the Anaconda Python 2.7 32-bit distribution so I can use arcpy in the Spyder IDE. However, this means that some basic tools in Pro now throw errors when I try to run them - I assume because it's trying to access the older version of Python. Does Esri have any official suggestions?

Thank you.

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

DanPatterson_Retired — Wed, 28 Nov 2018 22:17:20 GMT

I used spyder for both arcmap (when I had it installed) and ArcGIS pro for some time.

I just wrote scripts as if they were python 3 scripts and paid attention to those tools that differed in their parameters when I needed to have a script run in both map and pro. I found no glitches in using pro's arcpy in both scenarios.

Are you running into particular problems?

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

SamGuilford — Mon, 03 Dec 2018 20:35:48 GMT

Thank you for your response, good to know. Let me reframe. I though it was a Python problem, but perhaps it isn't. Pro throws this error when I try to use Raster Calculator (from within Pro):

I thought this must have to do with the Anaconda Python 2.7 32-bit distribution I have installed conflicting with Pro, which needs Python 3 64-bit. However, shouldn't Pro be calling its own version of Python, regardless? Even if it weren't, wouldn't the immediate problem have to do with the version, not the bit type? To check all this, I have run this same process (raster calculator on the same file) on my secondary computer, which has the same program setup (Desktop, Pro, Anaconda), and there are no problems on that machine. I tried reinstalling Pro and Anaconda, and the problem persists. Any ideas?

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

DanPatterson_Retired — Mon, 03 Dec 2018 22:36:06 GMT

Python for arcmap and hence arcpy is usually installed in a c:\pythonx.x folder

Python for Pro is installed in C:\your_installation_path\bin\Python\envs\arcgispro-py3

arcpy is installed in C:\your_installation_path\Resources

I would check to see which version you launch. I do all my scripting in Pro using spyder as well.

If you want to work with both version of python in spyder, have a look. I only use pro, so I can't confirm

Working with packages and environments in Spyder · spyder-ide/spyder Wiki · GitHub

The simplest would be to pip install spyder in your 2.7 distribution so that you are sure you are using the correct version for both.

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

SamGuilford — Tue, 04 Dec 2018 22:31:25 GMT

This wasn't using scripting at all - it was just using the GUI in Pro. I believe I have an idea how to get scripting to work for both python versions, but before I do that I'd like to get Pro back to working as a stand alone program.

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

DanPatterson_Retired — Tue, 04 Dec 2018 23:00:21 GMT

I don't use the python thing in Pro since it isn't clear what it is running

I would hate to recommend doing a ….

Control Panel, Add/Remove programs, 'Repair' ...

'Repair' might fix the ArcGIS Pro problem, but it may undo something that you now have working

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

SamGuilford — Wed, 05 Dec 2018 16:31:32 GMT

I repaired Pro, same problem. Then I uninstalled Anaconda completely, repaired Pro again, same problem. I suppose there might be remnants of Anaconda somewhere? If the rest of Pro works fine, why would Raster Calculator be giving me errors in this way? It seems to throw on this line:

...

import arcgisscripting

ImportError: DLL load failed: %1 is not a valid Win32 application.

Any ideas beyond completely wiping Pro from the machine and starting over?

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

DanPatterson_Retired — Wed, 05 Dec 2018 18:53:19 GMT

Sorry, None. Tech Support I suppose, I suspect there are too many places where conflicts can arise

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

curtvprice — Sat, 11 Dec 2021 22:40:15 GMT

I'm guessing what's going on is you installed your non-ArcGIS Python and used the installer's defaults to mess with the global windows system paths. This will definitely break Esri's Python instances because the Python sys.path includes folders that conflict with the Python you are using. From Pro, try this to see what's in the python path.

import sys
print(sys.executable)
print("\n".join(sys.path)‍‍)‍‍‍‍‍

Maybe the best solution here is to totally remove Anaconda, repair install ArcGIS Desktop and ArcGIS Pro.

Using Anaconda modules from the ESRI python environment - USGS OEI/Enterprise GIS - myUSGS Confluence

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

ShaunWalbridge — Thu, 13 Dec 2018 05:20:16 GMT

Sam, are you still suffering from this issue? Do you have a custom environment you're working with, or just the default arcgispro-py3 environment? There are numerous places that Python can be injected into the environment that aren't entirely obvious (system variables, registry keys, cross-linked .pth files) so debugging can be tricky. Can you reproduce this from a command line session of Pro via the Python Command Prompt session? I can give you some starting points before you jump on with support.

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

SamGuilford — Thu, 13 Dec 2018 14:50:59 GMT

Hi Shaun - I have yet to resolve the issue. I did take Curtis Price‌'s suggestion to investigate the syspath, and found that there are two 10.6 paths that have snuck into the Pro environment somehow (see pic below). My best guess is that the problem really has nothing to do with python, and everything to do with Pro trying to access 10.6's 32-bit materials. However, I don't know how this happened or how to reconfigure the paths (I have opened an Esri support ticket, no luck yet). My latest attempt was to uninstall 10.6 completely and then repair Pro, but those paths remain. Any suggestions?

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

DanPatterson_Retired — Sat, 11 Dec 2021 22:40:18 GMT

To reiterate Curtis Price‌'s comment

sys.exec_prefix
'C:\\ArcGISPro\\bin\\Python\\envs\\arcgispro-py3'

sys.executable
'C:\\ArcGISPro\\bin\\Python\\envs\\arcgispro-py3\\pythonw.exe'

#---- ArcGIS Pro install folder 'C:\\ArcGISPro ... yours will differ‍‍‍‍‍‍‍

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

ShaunWalbridge — Sat, 11 Dec 2021 22:40:21 GMT

OK, yes those entries for 10.6 are causing the problem -- you can see on sys.path that they precede the actual places you want to be finding Pro DLLs, which causes the crash. Can you report what the below reports?

import glob
import os
import site

print("PYTHONPATH: {}".format(os.environ.get("PYTHONPATH", "undefined")))
print("PYTHONHOME: {}".format(os.environ.get("PYTHONHOME", "undefined")))

for loc in site.getsitepackages():
    for pth in glob.glob(os.path.join(loc, "*.pth")):
        print(pth)
        with open(pth, 'r') as f:
            print(f.read())
‍‍‍‍‍‍‍‍‍‍‍‍‍

That should help debug things.

Thanks,

Shaun

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

SamGuilford — Thu, 13 Dec 2018 20:10:59 GMT

Hi Shaun - here's what I got:

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

ShaunWalbridge — Thu, 13 Dec 2018 20:19:05 GMT

OK, thanks. The issue is that the PYTHONPATH variable is set. PYTHONPATH is tricky, because it is used in the initialization of Python and will preempt other settings on the machine. We fixed a bug for ignoring PYTHONPATH in Pro 2.3, but unsetting this variable should be enough to fix your machine. You can find the environment variables by pressing Win+Break > Advanced System Settings > Environment variables and removing PYTHONPATH entries from the user and system variable panes if it exists. This page on modifying environment variables may be helpful: https://www.computerhope.com/issues/ch000549.htm

Once you've unset that, you can check that its correct by closing and reopening. You'll have to fully close e.g. a Python Command Prompt session for these to be flushed, but if it works, your Pro should work again and you shouldn't see any 10.6 references when checking sys.path.

Cheers,

Shaun

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

curtvprice — Fri, 14 Dec 2018 21:11:36 GMT

Shaun: great solution having Pro's environment ignore PYTHONPATH, that should save a lot of trouble for users! Color me pleased.

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

SamGuilford — Fri, 14 Dec 2018 21:44:08 GMT

This did it - simple, yet I never thought to check there. Thanks!

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

ShaunWalbridge — Fri, 14 Dec 2018 21:58:56 GMT

Yes, I'm happy to see this fix go in too! One thing I should note -- it actually retains the PYTHONPATH value, but makes them a lower priority than the DLLs for the environment that is driving Pro. This ensures that Pro will work correctly, but will still allow someone who relied on PYTHONPATH for sharing e.g. a Python module to show up in Pro. The PYTHONPATH fix won't help on the command line, because that's a setting built into the python.exe. For posterity, if anyone hits this on the command line, you can start Python with `python -E` to ignore Python environment variables, or better yet unset PYTHONPATH. If you do need to inject additional locations for Python to find modules, add a .pth file which includes the path into Lib\site-packages.

Re: Run ArcGIS Desktop (Python 2x), Pro (Python 3x), and Anaconda Python 2.7 all on the same machine?

ShaunWalbridge — Fri, 14 Dec 2018 21:59:14 GMT

Great! Glad we figured it out.