topic Re: How to run python with the ArcGIS Pro 1.4 from outside in Python Questions

How to run python with the ArcGIS Pro 1.4 from outside

BidhyanandaYadav — Mon, 13 Mar 2017 23:00:50 GMT

With ArcGIS Desktop, version 10.4 for example, I installed the Anaconda Python and was able to run all the arcpy scripts from outside of the ArcGIS session (for example with Spyder, or Jupyter Notebook) with the following Desktop10.4.pth file created in site-package with following three lines of code

C:\Program Files (x86)\ArcGIS\Desktop10.4\arcpy
C:\Program Files (x86)\ArcGIS\Desktop10.4\bin
C:\Program Files (x86)\ArcGIS\Desktop10.4\ArcToolbox\Scripts

I want to replicate the same behaviour with the new ArcGIS Pro 1.4, but there seems no help on how to do this. I want to know how to do this with the Anaconda Python that is installed by default with ArcGIS Pro 1.4. Do I need to install a separate copy of Anaconda Python?

Re: How to run python with the ArcGIS Pro 1.4 from outside

DanPatterson_Retired — Mon, 13 Mar 2017 23:27:53 GMT

A quick run of sys.path yields for mine running python 3.5

'C:\\ArcPro\\Resources\\ArcToolbox\\Scripts',

'C:\\ArcPro\\Resources\\ArcPy',

'C:\\ArcPro\\bin\\Python\\envs\\arcgispro-py3',

'C:\\ArcPro\\bin',

plus personal ones and others that were from imports

you can set up icons on the desktop to run

C:\ArcPro\bin\Python\Scripts\proenv.bat then type spyder I usually right-click and get to 'run as administrator' to get it to go.

or set up a desktop shortcut to run spyder directly (again sometimes run as administrator is needed)

C:\ArcPro\bin\Python\envs\arcgispro-py3\Scripts\spyder.exe

Then I link spyder to PRO from the project window like so.

I keep a separate Anaconda distribution to run python 3.6+ with the scipy stack but no access to arcpy so I can work outside that environment

I have a couple of blog links , here is one if you are interested python and siblings with and without an arcmap environment

Re: How to run python with the ArcGIS Pro 1.4 from outside

BidhyanandaYadav — Tue, 14 Mar 2017 05:46:36 GMT

Thank Dan. So based on your response, there is no way to replicate the old ArcGIS Desktop 10.4 arcpy behavior with the new ArcGIS Pro 1.4. With older setup, I just installed Anaconda Python with all its goodies and updates and just inserted a path to arcpy, and everything worked like charm. Even updating the newer version of Numpy, Matplotlib created no issues.

Even though the Pro document says, its comes pre-installed with conda, it seems pretty restrictive. I haven't been able to figure out how to run Ipython/Jupyter notebook.

Re: How to run python with the ArcGIS Pro 1.4 from outside

DanPatterson_Retired — Tue, 14 Mar 2017 11:01:22 GMT

No.. the conda distribution for Pro has all that stuff and more including the ability to install other packages easily. Check out my blog links. When you install pro, you get the a nice conda distribution with the ability to run everything... here is

an image of the packages when you go to the Project window

Re: How to run python with the ArcGIS Pro 1.4 from outside

RebeccaStrauch__GISP — Tue, 14 Mar 2017 15:24:15 GMT

I'm just starting to install and test this myself, but at the Dev Summit it looked as if it could still be run outside of Pro. I think that is how they did most of the demos.

Check out Install and set up | ArcGIS for Developers You may need to log in to access.

So far (before I left work yesterday), I just added the package as Dan mentions. I'm not sure if you IT will allow me to use it as a standalone, but I am also looking into that. I know the "try it in the sandbox" seemed to be blocked on our network. Just in case you see issues with that too.

Re: How to run python with the ArcGIS Pro 1.4 from outside

BidhyanandaYadav — Tue, 14 Mar 2017 15:26:40 GMT

Hi Dan_Patterson I checked your blog on Anaconda, Spyer and ArcGIS PRO. I was able to follow some parts but not everything. I think things has changed in the new PRO 1.4 since this blog.

So anyway thats my confusion, since new ArcGIS PRO 1.4 already comes with conda/anaconda, along with the ability to add more packages, I want to make this one work for all my workflow without having to install additional copy of Anaconda Python on my system. With the requirement of 32-bit Python 2.7 for ArcGIS Desktop, its already a mess.

Specifically, I am unable to launch Jupyter notebook. Previously, with I was able to run this smoothly, now this does not work. Actually I think I have not been able to set this up. Before I try on my own and break something I was hoping that if someone has done this, I can follow your advice.

Re: How to run python with the ArcGIS Pro 1.4 from outside

RebeccaStrauch__GISP — Tue, 14 Mar 2017 19:46:35 GMT

Bidhyananda Yadav I'm also having issues getting it to run the way I thought it would.

Yesterday, I followed the instruction to add the arcgis API using the Python tab in ArcGIS Pro (as Dan describes and Install and set up | ArcGIS for Developers ).

Then I was trying to run the shortcut created for "Jupyter Notepad (arcgisPro-Py3)" that was created in my "C:\Users\<username>\AppData\Roaming\Microsoft\Windows\Start Menu\Programs\Anaconda3 (64-bit)" (and was located in the Start Menu for Anaconda) but it was just opening and closing right away. It looks as if the Target for the shortcut has an error or is truncated. The Target for the shortcut on my machine, after the path to the python.exe, ends with "C: that is, a double quote at the start, but not a closing double quote. I'm not sure what the full Target argument is supposed to be, as I let ArcPro 1.4 add is to the default location. I'm not sure if that is a bug or not. (??)

So I opened the Python command prompt in Pro and tried to "conda install -c esri arcgis" and a few others, and keep getting "parsing error SyntaxError:invalid syntaqx (<string>, line 1)".

Then I tried following the install instructions found Jupyter Notebook for the API, and installed Anaconda from the .exe as instructed. I'm keeping the "Register Anacaonda as my default Python 3.6" checked, however, since I do most of my development in 2.7 and Wing IDE, I may need to change things back (??).

That also does not seems to be working for me, and it doesn't look like Anaconda is showing in my path (may need to reboot after closing this comment).

I'm going to call in a tech support ticket and will let you know if I find out anything.

Re: How to run python with the ArcGIS Pro 1.4 from outside

DanPatterson_Retired — Tue, 14 Mar 2017 20:13:58 GMT

The top of the link was for 1.4.1, the rest as indicated was for legacy installations.

Just install 1.4.1, use their conda distribution, go to my above link images, set yourself up, install your other packages, create desktop shortcuts and you are ready to go.

I keep two distributions... one for non-arc* stuff using python 3.6 as the base, then I let Arc* do its thing and install its own conda distribution.... notice the separation. I also set up spyder to use as my IDE for both arcmap and PRO. I also set up a Jupyter QT consol and Pythonwin to run in both as well as Pycharm Edu to kick around on those occasions that I want to prepare lecture materials. The only thing that I don't use anymore is Pyscripter since development seems to be terminated (open the zip... the dates are two years old) and I read that it doesn't play nice anymore with the conda distribution from arc*. There is no limits to what you can do. In the pure Anaconda/python3.6 distribution, I am also using Matplotlib 2.0 which will give you a heads up on what you can do should esri update their package list with future releases.

Re: How to run python with the ArcGIS Pro 1.4 from outside

RebeccaStrauch__GISP — Tue, 14 Mar 2017 20:37:00 GMT

I do have Pro 1.4.1 installed. Not sure why mine isn't working as expected.

edit: I went back to the Pro "Python Package Manager" and "Update PAckages" and noticed it now had an update (wasn't showing yesterday afternoon). Installing that and trying again.

edit 2: I think getting that update that was the ticket for me to get the standalone Junyper Notebook to work. The shortcut with the the (arcgispro-py3) still is not working, but the other shortcut from the separate Anaconda install is opening. Guess I can cancel the tech support call.

Re: How to run python with the ArcGIS Pro 1.4 from outside

DanPatterson_Retired — Tue, 14 Mar 2017 20:51:49 GMT

hmmm I am using windows 10, on a local install, not connected to a network at all, but check out your licensing arrangements. I just find that keeping it untoggled off line easiest and make sure that your licensing portal is specified if it applies to you. Then you can go to your configure licensing options should all else fail.

Re: How to run python with the ArcGIS Pro 1.4 from outside

ShaunWalbridge — Wed, 15 Mar 2017 00:31:46 GMT

Rebecca,

The issue with the shortcut not working is a bug, and I see that a bug has been filed with its description. You can still run the notebook from the environment prompt, but that is annoying that the shortcut isn't working directly.

When you said that you opened up a "Python command prompt", do you mean the Python window that's included within Pro? The error you're getting makes it look like you're at a Python interepreter prompt, which would cause that issue. To install the ArcGIS API for Python, instead you'll want to run the shortcut in the Pro group called "Python command prompt", then run the command you included.

You shouldn't need to install another Anaconda, it'll probably make things more complicated than necessary -- you can also use the Python backstage from Pro (Project > Python) to install the API without having to use any command line tools at all.

Cheers,

Shaun

Re: How to run python with the ArcGIS Pro 1.4 from outside

ShaunWalbridge — Wed, 15 Mar 2017 04:44:26 GMT

Bidhyananda,

The issue of the notebook shortcut not working has been added as a bug, BUG-000103143. You should still be able to access the notebooks from the command line, just not from the shortcut directly.

Cheers,
Shaun

Re: How to run python with the ArcGIS Pro 1.4 from outside

RebeccaStrauch__GISP — Wed, 15 Mar 2017 17:34:18 GMT

Shaun Walbridge Thanks for the info on BUG-000103143. Because I figured out that something was wrong with the shortcut, that was why I installed the Anaconda process.

Bidhyananda Yadav The step I was messing up in BOTH the Anaconda and the Pro install was trying to run the

conda install -c esri arcgis

from the wrong location. (I has used the "Python Package Install" In Pro, and it appeared to work, but needed this step). I kept trying to run the command within the "jupyter notebook" or as Shaun pointed out, from the Pro Python interpreter prompt, which I was incorrectly calling the Pro Python command prompt. Once I ran it from the correct locations, the notebook worked as expected.

In short, for others that see this...

If installing using Pro (and not anaconda), (I think you stil need to install the arcgis python api package from within Pro first):
- open Start->All Programs->ArcGIS->ArcGIS Pro->Python Command Prompt (
  - you may want to open "As Administrator", although I didn't need to
- run the install command above (should only need to do once).
- once the install finishes, in the same window, test if it worked by typing "jupyter notebook" at the prompt and give it time to open in a browser.
- To further test, in the Jupyter Notebook that opens, type the line below and run (there is a button in the toolbar) to make sure you do not get an error.
  from arcgis.gis import GIS
- If all that works, it is good to go and I suggest trying some of the samples.
- Because it seems to open in the folder that you start the session, you may want to change that location with "cd \<path>" before starting the notebook, and eventually work with a copy of the shortcut for the Python Command Prompt to make it easier.
- To close, it seems you just have to close the tab in the browser, and then the command prompt (if anyone sees a smoother process, I'm interested)
For the Andaconda, external install, I follwed the instructions to download and install Anaconda, and like the above, I was using the wrong command prompt. Instructions are the same as above, except the command prompt for me is:
- Start->All Programs->Anaconda3 (64-bit)->Anaconda Prompt

Sample, using the Anaconda Prompt (Other prompt is similar)...I had already installed

I think if I have used the correct "ArcGIS Pro -> Python Command Prompt" (not the Python Interpreter within Pro) to do the "conda install -c esri arcgis" and to open the Jupyter Notebook, I think all would have worked fine without installing the Anaconda version. It does run the notebook in the browser, i.e. external to Pro, so if I was to start over (which I will on another machine), I would start with just that process to see if it all works.

Hopefully this works for you too. I see lots of potential in the Python API.

BTW - I think the Install and set up | ArcGIS for Developers needs to be a little more specific re: the proper "Command prompt" ....with the paths and/or a pic, like I have above. That would have saved me a lot of time (and was quickly pointed out by tech support this morning!)

EDIT: additional note. When I used the Pro ->Python -> Add Packages and install the "arcgis" for the first time, it still installed the 0.3 beta version (3/14/2017). I didn't notice that it was in the "Update Packages" list for a couple hours. You should make sure to update it there tot he 1.0.1 (or above) version if yours loads the beta.

Re: How to run python with the ArcGIS Pro 1.4 from outside

ShaunWalbridge — Sun, 19 Mar 2017 05:18:08 GMT

Rebecca,

Thanks for the details on your approach. Note that we also have an open bug on the unintuitive lack of "automatic refresh" issue you mentioned. We initially wanted to ensure that no remote request was made unless explicitly requeste by the user, but overall I think this is more likely to cause problems as you mentioned.

Re: How to run python with the ArcGIS Pro 1.4 from outside

BidhyanandaYadav — Mon, 20 Mar 2017 19:47:07 GMT

Thank you Rebecca Strauch, GISP Shaun Walbridge Dan Patterson. I also spent some time figure out the issues based on your comments/suggestions. Here's what I did.

I was able to run Python 3.5 from the default ArcGIS pro installation of Python. While Jupyter notebook and other packages can be directly installed from inside the ArcGIS pro Python panel, installing arcgis python package also helped setup the Jupyter notebook (even though arcgis python and arcpy are separate products). I would definitely recommend arcgis python.

But these are the issues I faced in my work. ArcGIS Pro python is quite restrictive, and I could not install other open source libraries such as GDAL, Geopandas etc. Since, my workflow depend on ArcPy, along with many other open source libraries I am unable to commit fully to ArcGIS Pro Python for all my work.

So I also have Anaconda Python 2.7 for ArcMap 10.5. Definitely, not the solution I was looking for because now I constantly have to switch between the two installations of Python, and this is definitely as hassle (contrary to the spirit of Python).

I would have liked the workflow similar to ArcGIS Desktop which allows you to install you own Python (Anaconda for example) and continue working with ArcPy by just including it in path.

Re: How to run python with the ArcGIS Pro 1.4 from outside

DanPatterson_Retired — Mon, 20 Mar 2017 20:52:49 GMT

hmmmm usually a 'pip' install is offered by a package to allow you to install anything you need. Some packages don't work well in virtualized environments and/or don't respond well to permanent or temporary additions to the python or system path. The two packages you cite have alternatives. They may not meet your familiarity level so that is also a workflow concern. Good luck

PS geos and gdal are available in the anaconda distribution meaning they can be installed in arcpro's version, they just aren't in the package list... which hasn't stopped anyone

Re: How to run python with the ArcGIS Pro 1.4 from outside

BidhyanandaYadav — Mon, 20 Mar 2017 22:46:22 GMT

Yeah pip should work, even conda install works. The Python that comes with ArcGIS Pro is not flexible enough to allow user the choice to install other open source packages. Especially, the ones related to open source GIS libraries. My whole interest in starting this question was to find out if anyone has been successful in using the ArcGIS Pro Python for all their workflow.

My intent is to have the latest version of 64-bit Python to accomplish all my work, including the ArcPy functionalities.

Re: How to run python with the ArcGIS Pro 1.4 from outside

DanPatterson_Retired — Tue, 21 Mar 2017 00:29:41 GMT

The version of python 3.5.1... is the same python 3.5.1 that everyone uses, there is no difference in python... let us make that absolutely clear... All esri did was produce a 'conda' package of the modules for that particular version of python so that they could ensure that everything would play nice. For example, the numpy version could have been upgraded, but some packages don't support a higher version, so it wasn't installed. You will find this the same with the pure Continuum Anaconda distribution, of which I have several covering all the versions that I may have to work with. The only difference is... if you want to use 'arcpy' , then esri sets the rules because they have to maintain their whole conda package.

As for workflow, I can choose to do whatever I want with any version of python within its own conda distribution (ie continuum's 3.4, 3.5 and 3.6 distributions), then when I need something done in ArcPRO or even ArcMap, I just bring the data into esri's distribution of packages. I have never had a problem, in fact, I could quite comfortably use theirs solely, since packages such as gdal and the other open source packages that try to circumvent arc*anything aren't needed in my workflow, since I have access to arcpy.

If you could provide a specific case where you can't do something in 'python' that would be an issue. If you are talking about something that you can't do in your workflow because of your chosen packages, then perhaps suggestions can be made as to alternatives within the existing esri conda distribution or other options within a continuum distribution or how to conda or pip install what you need. For example, gdal is quite old school only relying on numpy 1.0, and the whole raster-array-raster translation is readily handled. The only stumbling block may be in geodatabase support, but since you have arc* then that shouldn't be an issue.

The whole point of my missives, is that you can do anything you want within the confines of the PRO distribution... anything that isn't there, simple solutions exist and having the 'newest' continuum anaconda distribution provides the opportunity to plan ahead and/or exploit capabilities when they appear.

Give it a try, just keep your installations clean and separate and well managed.

Re: How to run python with the ArcGIS Pro 1.4 from outside

ShaunWalbridge — Tue, 21 Mar 2017 20:09:47 GMT

Bidhyananda,

I'm able to install a wide variety of packages within the Pro environment, including many other geospatial ones. Can you name any particular packages that aren't working for you?

If you have an existing external conda that you'd prefer to use, you can still use a .pth based cross-linking to achieve the same effect as before. As Dan mentioned in an earlier post on this thread, you just need to point it at the relevant locations within the Pro install to pick up (a) the ArcGIS Pro bin directory and (b) the locations of the ArcPy install. In a future release, we will make this simpler, but the same approach you've been using for ArcMap 10.x will work with Pro as well if you'd prefer not to use the Conda environment included with Pro.

Re: How to run python with the ArcGIS Pro 1.4 from outside

PhilMorefield — Sat, 11 Dec 2021 21:41:47 GMT

I'm afraid I need some additional help getting this to work, as well. Like I've done for a few years now, I added a .pth file to my Miniconda distribution folder. The contents of that file are:

C:\Program Files\ArcGIS\Pro\bin
C:\Program Files\ArcGIS\Pro\Resources\ArcPy
C:\Program Files\ArcGIS\Pro\Resources\ArcToolBox\Scripts

When I try to import arcpy, however, an error is thrown:

import arcpy
Traceback (most recent call last):
  Python Shell, prompt 1, line 1
  File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\__init__.py", line 66, in <module>
    from arcpy.geoprocessing import gp
  File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\geoprocessing\__init__.py", line 14, in <module>
    from ._base import *
  File "C:\Program Files\ArcGIS\Pro\Resources\ArcPy\arcpy\geoprocessing\_base.py", line 14, in <module>
    import arcgisscripting
builtins.ModuleNotFoundError: No module named 'arcgisscripting'‍‍‍‍‍‍‍‍‍‍

Any assistance would be much appreciated.