topic Re: Code working in ArcGIS Pro Python Window but not in Spyder in Python Questions

Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Wed, 31 Jul 2019 01:16:20 GMT

Like many of you, I want to be able to edit and execute python code from Spyder instead of ArcGIS's Python Window. I am running into some problems and hoping that someone can help me troubleshoot what exactly is going on. I noticed that some old scripts that I had written would no longer execute in Spyder but when the code was copied into ArcGIS Pro's Python Window the code worked just fine. After messing around with it for quite some time, uninstalling and reinstalling both ArcGIS Pro and Anaconda3 Navigator (3.7 64-bit), to not avail I decided to roll uninstall both again, delete all traces of them from my system, delete registry keys, etc. to make sure it wasn't the fault of something latent on my computer after uninstalling.

I just got everything reinstalled and am running into the exact same problem. Again, the code will work when copy pasted into the Python Window in ArcGIS Pro, but not in Spyder. Here is how I installed it after my clean uninstall:

1) Installed ArcGIS 2.3

2) Installed Patched 2.3.1, 2.3.2, and 2.3.3 in that order (I'm wary of 2.4 and know my code was working on 2.3)

3) Opened ArcGIS, signed in, went to Project --> Python --> Manage Environments --> Clone Environment

4) Once the Cloned Environment (named arcgispro-py3-clone) finished installing I closed ArcGIS Pro and restarted it

5) Went back into Project --> Python --> Manage Environments and changed the environment to the cloned environment

6) Checked that my sample code worked in the cloned environment in the Python Window, it did

7) Installed the spyder package (which installed all of its dependencies)

😎 Restarted ArcGIS Pro, checked that spyder package was installed, tried code again in Python Window, it worked

9) Installed Anaconda3 -> unchecked Anaconda3 as default Python 3.7, did not add to path

10) Opened Anaconda3 and checked for cloned arcgispro-py3 environment, it was there

11) Restarted computer for good measure

12) In Anaconda3, switched to arcgispro-py3-clone environment and launched spyder

13) Opened and ran my test code

Here is the error given to me by Spyder:

runfile('G:/My Drive/Python Scripts/polyline_to_polygon.py', wdir='G:/My Drive/Python Scripts')
Traceback (most recent call last):

File "<ipython-input-1-210cd50e08ec>", line 1, in <module>
runfile('G:/My Drive/Python Scripts/polyline_to_polygon.py', wdir='G:/My Drive/Python Scripts')

File "C:\Users\Tab5a\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 827, in runfile
execfile(filename, namespace)

File "C:\Users\Tab5a\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 110, in execfile
exec(compile(f.read(), filename, 'exec'), namespace)

File "G:/My Drive/Python Scripts/polyline_to_polygon.py", line 27, in <module>
ap.CopyFeatures_management(vtx_arr, vtx_output)

File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\management.py", line 2624, in CopyFeatures
raise e

File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\management.py", line 2621, in CopyFeatures
retval = convertArcObjectToPythonObject(gp.CopyFeatures_management(*gp_fixargs((in_features, out_feature_class, config_keyword, spatial_grid_1, spatial_grid_2, spatial_grid_3), True)))

File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\geoprocessing\_base.py", line 498, in <lambda>
return lambda *args: val(*gp_fixargs(args, True))

RuntimeError: Object: Error in executing tool

I'm hoping I left out a step or something of that nature akin to forgetting to copy the batch files in ArcMap, but otherwise I have no clue why this wouldn't be working. Thank you all for your time and help.

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Sun, 12 Dec 2021 03:06:01 GMT

Thomas

The ArcGIS Pro environment is currently only supporting python 3.6.8..

I suspect that is the root of the problem.

In fact, if you try a --no-pin, esri's environment doesn't support 3.7, only 3.6.9 (btw, 3.8 will be coming along soon)

(arcgispro-py3) C:\arc_pro\bin\Python\envs\arcgispro-py3>conda update python --no-pin --dry-run
Fetching package metadata .............
Solving package specifications: .

Package plan for installation in environment C:\arc_pro\bin\Python\envs\arcgispro-py3:

The following packages will be UPDATED:

    python: 3.6.8-h9f7ef89_7 --> 3.6.9-h5500b2f_0


(arcgispro-py3) C:\arc_pro\bin\Python\envs\arcgispro-py3>‍‍‍‍‍‍‍‍‍‍‍‍

If you have a need to test out python 3.7, I would suggest separating your Arc* stuff from your python stuff until esri upgrades their packages. Minor upgrades x.x.Y tend not to cause issues, but x.Y upgrades I have found to be problematic at times. So --no-pin and --dry-run should always be examined first.

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Sun, 12 Dec 2021 03:06:04 GMT

Anaconda is 3.7. But the environment I am using within Anaconda is 3.6.6 as it is a clone of the default environment within ArcGIS Pro 2.3.3. Below is the original environment after running conda update python --no-pin --dry-run:

C:\Program Files\ArcGIS\Pro\bin\Python\Scripts>conda update python --no-pin --dry-run
Fetching package metadata .............
Solving package specifications: .

Package plan for installation in environment C:\Users\Tab5a\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone:

The following packages will be UPDATED:

    python:         3.6.6-hea74fb7_0       --> 3.6.9-h5500b2f_0
    sqlite:         3.25.2-hfa6e2cd_0      --> 3.29.0-he774522_0
    vc:             14-h21ff451_11         --> 14.1-h0510ff6_4
    vs2015_runtime: 14.0.25420-0      esri --> 14.15.26706-h3a45250_4

The following packages will be DOWNGRADED:

    freetype:       2.8-h51f8f2c_1    esri --> 2.8-vc14_0             esri [vc14]


C:\Program Files\ArcGIS\Pro\bin\Python\Scripts>‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

And here is that same command run on my clone environment:

(arcgispro-py3-clone) C:\Users\Tab5a>conda update python --no-pin --dry-run
Fetching package metadata .............
Solving package specifications: .

Package plan for installation in environment C:\Users\Tab5a\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone:

The following packages will be UPDATED:

    python:         3.6.6-hea74fb7_0       --> 3.6.9-h5500b2f_0
    sqlite:         3.25.2-hfa6e2cd_0      --> 3.29.0-he774522_0
    vc:             14-h21ff451_11         --> 14.1-h0510ff6_4
    vs2015_runtime: 14.0.25420-0      esri --> 14.15.26706-h3a45250_4

The following packages will be DOWNGRADED:

    freetype:       2.8-h51f8f2c_1    esri --> 2.8-vc14_0             esri [vc14]


(arcgispro-py3-clone) C:\Users\Tab5a>‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Note that my cloned environment is located in C:\Users\Tab5a\AppData\Local\ESRI\conda\envs

Also, not sure if it matters at all, the cloned environment is not in the C:\Users\Tab5a\Anaconda3\envs but does show up in Anaconda Navigator as expected. Any ideas?

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Wed, 31 Jul 2019 06:04:47 GMT

If you scroll around using Windows File Explorer, are these folders there?

C:\Your_Install_Path\Resources\ArcPy

C:\Your_Install_Path\bin\Python\envs\Your_Clone_Env\Lib\site-packages\arcgis

C:\Your_Install_Path\bin\Python\envs\Your_Clone_Env\Lib\site-packages\spyder

If not, then Arc* stuff isn't there and spyder may or may not be installed

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Sun, 12 Dec 2021 03:06:10 GMT

Is spyder running the correct Spyder? (run from the IPython console in Spyder).

I don't use clones so I only have one python so I can't test another

import sys
sys.executable
'C:\\arc_pro\\bin\\Python\\envs\\arcgispro-py3\\pythonw.exe'‍‍‍‍‍‍

To change

How to change python version in anaconda spyder - Stack Overflow

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Sun, 12 Dec 2021 03:06:12 GMT

This is in Spyder.

Python 3.6.6 |Anaconda, Inc.| (default, Jun 28 2018, 11:27:44) [MSC v.1900 64 bit (AMD64)]
Type "copyright", "credits" or "license" for more information.

IPython 7.7.0 -- An enhanced Interactive Python.

import sys

sys.executable
Out[2]: 'C:\\Users\\Tab5a\\AppData\\Local\\ESRI\\conda\\envs\\arcgispro-py3-clone\\pythonw.exe'
‍‍‍‍‍‍‍‍‍

Any other way to check what is being used by by the Python Window in ArcGIS Pro? sys.executable returns:

import sys
sys.executable
'C:\\Program Files\\ArcGIS\\Pro\\bin\\ArcGISPro.exe'‍‍‍

Which I find odd based on https://docs.python.org/3/library/sys.html which says that sys.executable "returns a string giving the absolute path of the executable binary for the Python interpreter."

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Sun, 12 Dec 2021 03:06:15 GMT

import sys
sys.executable
'C:\\arc_pro\\bin\\ArcGISPro.exe'

sys.base_exec_prefix
'C:\\arc_pro\\bin\\Python\\envs\\arcgispro-py3'

sys.exec_prefix
'C:\\arc_pro\\bin\\Python\\envs\\arcgispro-py3'
‍‍‍‍‍‍‍‍‍

Have to add this to my "reasons not to clone"

/blogs/dan_patterson/2018/12/28/clone

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Sun, 12 Dec 2021 03:06:17 GMT

I get this:

import sys
sys.executable
'C:\\Program Files\\ArcGIS\\Pro\\bin\\ArcGISPro.exe'
sys.base_exec_prefix
'C:\\Users\\Tab5a\\AppData\\Local\\ESRI\\conda\\envs\\arcgispro-py3-clone'
sys.exec_prefix
'C:\\Users\\Tab5a\\AppData\\Local\\ESRI\\conda\\envs\\arcgispro-py3-clone'‍‍‍‍‍‍‍‍‍‍‍‍‍‍

which is correct right? Sorry, I don't quite understand what I should do/try. Should I uninstall and reinstall ArcGIS Pro and Anaconda? Should I clone or not? Should I try to make a clone in the path "C:\\Program Files\\ArcGIS\\Pro\\bin\\Python\\envs"? Should I try the mentioned .api patch? I'm assuming that if I do try the patch I have first install anaconda-navigator on/from my clone? Should I have installed anaconda-navigator from my clone in the first place rather than from the .exe from Anaconda's website?

Sorry for the plethora of questions, I am just lost and extremely frustrated with this.

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Wed, 31 Jul 2019 14:20:53 GMT

Well nothing has helped so far.

Why you need python 3.7?

Did you read my blog post?

If you don't need to clone, then don't

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Wed, 31 Jul 2019 16:46:24 GMT

I did, I guess I'm just a bit confused. I don't need python 3.7, Anaconda 3.7 is just the installer they have on the Anaconda website. I might be dense, but it shouldn't matter because I am using a separate environment for my arcgispro-py3-clone right?

Regardless, I am going to try to delete the clone, uninstall the Anaconda Navigator I got from their website installer, and install the packages directly into "C:\Program Files\ArcGIS\Pro\bin\Python\arcgispro-py3" folder using conda from "proenv.bat" and see if that works.

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Wed, 31 Jul 2019 16:51:50 GMT

uninstall everything,

Install arcgis pro

If you have no other packages other than spyder to install, you can either install it in the default or a cloned environment, assuming you have full administrative rights to your machine.

/blogs/dan_patterson/2018/12/13/spyder

/blogs/dan_patterson/2019/06/28/arcgis-pro-24-installation-package-updates-and-installs

/blogs/dan_patterson/2018/12/28/clone

/blogs/dan_patterson/2017/07/01/arcgis-pro-2-creating-desktop-shortcuts

And I have more on my blog

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Wed, 31 Jul 2019 23:08:56 GMT

Ok, working on that now. Uninstalled ArcGIS Pro and Anaconda and all related folders, files, registry keys, etc. that were left over after installation. Just installed ArcGIS Pro 2.3 and its three patches in "C:/ArcGISPro" shortening the path like you suggested. I have full control over my computer so am not making a clone.

Now updating numpy from proenv.bat (located at C:\ArcGISPro\bin\Python\Scripts) and learning about sphinx and will downgrade if I decide I want to. Next I will install Spyder. If I install anaconda-navigator after that is there anything else I have to do to get that to work properly?

Thanks again for your assistance.

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Thu, 01 Aug 2019 01:41:15 GMT

leave out Anaconda Navigator for now. It is a longer story and requires a patch that I haven't tested on Pro 2.4

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Thu, 01 Aug 2019 01:48:28 GMT

The patch mentioned in https://community.esri.com/blogs/dan_patterson/2018/12/28/clone ?

I am using 2.3.3 which is what you used for that I believe.

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Thu, 01 Aug 2019 01:53:27 GMT

Thomas... get it working first before you try the patch

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Thu, 01 Aug 2019 02:16:03 GMT

Fair enough. My problem still is not solved though, works in Python Window in ArcGIS Pro but not in Spyder. What the heck?

Re: Code working in ArcGIS Pro Python Window but not in Spyder

TonyDaSilva1 — Sun, 12 Dec 2021 03:06:20 GMT

I am having the same problem but I am not using Spyer. I am simply editing my code in Visual Studio Code and running it using the built in ArcGIS Python Interpreter. At first it was teh clip tool but now simple trying to add a field does not work anymore.

"pythonPath": "C:\\Program Files\\ArcGIS\\Pro\\bin\\Python\\envs\\arcgispro-py3\\python.exe"

>>> import arcpy
>>> fc = r"E:\Data\Parks.gdb\rsBox"
>>> arcpy.AddField_management(fc, "Update", "TEXT")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\management.py", line 3899, in AddField
    raise e
  File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\management.py", line 3896, in AddField
    retval = convertArcObjectToPythonObject(gp.AddField_management(*gp_fixargs((in_table, field_name, field_type, field_precision, field_scale, field_length, field_alias, field_is_nullable, field_is_required, field_domain), True)))
  File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\geoprocessing\_base.py", line 506, in <lambda>
    return lambda *args: val(*gp_fixargs(args, True))
RuntimeError: Object: Error in executing tool
>>>‍‍‍‍‍‍‍‍‍‍‍‍‍

Link to my question:

https://community.esri.com/message/867419-runtimeerror-object-error-in-executing-tool

Re: Code working in ArcGIS Pro Python Window but not in Spyder

ThomasBlankinship — Thu, 08 Aug 2019 23:27:08 GMT

Any ideas? This has thoroughly stumped me. It won't work with the IDE installed with ArcGIS Pro either.

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Fri, 09 Aug 2019 00:56:58 GMT

As a lark... change your field name to Update_ or something else.

I tend to avoid any keywords associated with anything. For example

Reserved Keywords (Transact-SQL) - SQL Server | Microsoft Docs

I couldn't find an equivalent list in the help files... would be nice, but I suspect that it may be database dependent

Re: Code working in ArcGIS Pro Python Window but not in Spyder

DanPatterson_Retired — Fri, 09 Aug 2019 10:26:57 GMT

I new I saw it

FAQ: What are the reserved words for Esri's file geodatabase?

But whether the case of the word is important is another question