topic Re: Import arcpy into Jupyter Nootebook in ArcGIS API for Python Questions

Import arcpy into Jupyter Nootebook

IonutAlixandroae4 — Wed, 26 Jul 2017 09:22:38 GMT

Hi,

I have 3 versions of Python installed on my machine, 1st (v 2.7) which came with ArcMap 10.5, 2nd (v 3.5) which came with ArcGIS Pro and 3rd (v 3.6) which came with Anaconda 3 (for using Jupyter Nooteboks).

Now, in my notebooks I can use arcgis python API but I also want to use arcpy modules from ArcGIS Pro. Is there a workflow for this setup or some steps to take ?

Thanks,

Ionut

Re: Import arcpy into Jupyter Nootebook

JayantaPoddar — Wed, 26 Jul 2017 09:43:25 GMT

Here is what I found.

Did you check Adding the Arcpy Path to Anaconda in https://community.esri.com/groups/spatial-data-science/blog/2016/02/11/connecting-arcpy-to-your-jupyter-notebook ?

Also check the attachment. Hope it is helpful.

Re: Import arcpy into Jupyter Nootebook

Anonymous User — Wed, 26 Jul 2017 16:02:02 GMT

An easier way is to simply install the Python API using ArcGIS Pro's python package manager as explained here https://developers.arcgis.com/python/guide/install-and-set-up/#Install-using-ArcGIS-Pro

Then start your notebooks using the 'Python Command Prompt' that ships with Pro. You are good to go. You can import both ArcPy and the Python API.

Re: Import arcpy into Jupyter Nootebook

IonutAlixandroae4 — Wed, 26 Jul 2017 19:09:17 GMT

Hi Atma,

I have tried using ArcGIS Pro and I saw that I already had arcgis package installed (version 0.1); when I tried to update it, it ran a progress bar but nothing happened, nothing updated, and I don`t know why.

After that, I opened Python command prompt of ArcGIS Pro and typed "jupyter notebook" and got an error..

Thanks,

Ionut

Re: Import arcpy into Jupyter Nootebook

Anonymous User — Wed, 26 Jul 2017 20:24:00 GMT

Ionut, I will send this to the Pro team to investigate. Meanwhile, can you update the package by using the Python command prompt and typing

conda upgrade -c esri arcgis‍

This should update the package. From the screenshot, you have installed Pro for all users, in C:\program files. Hence start the Python command prompt as an administrator.

Re: Import arcpy into Jupyter Nootebook

IonutAlixandroae4 — Wed, 26 Jul 2017 20:56:38 GMT

Hi Atma,

Yes, I also think that the first problem I reported should be investigated by the Pro team, it may be a bug or something.

Also, I started Python cmd as Admin and tried to update arcgis but there`s a conflict or something and also, if I try to open jupyter notebook, I am missing some modules I think...

If I install Anaconda 3 and also Python API, isn`t there another way to "bring" ArcGIS Pro arcpy into it?

Thanks, I really appreciate your support!

Ionut

Re: Import arcpy into Jupyter Nootebook

Anonymous User — Wed, 26 Jul 2017 21:08:16 GMT

Your Pro Python version is 3.4 which we don't support. Its likely you are using a very old version of Pro. Can you update your Pro to the latest? This will update the conda and Python that ship with it.

Re: Import arcpy into Jupyter Nootebook

curtvprice — Wed, 26 Jul 2017 22:22:06 GMT

An easier way is to simply install the Python API using ArcGIS Pro's python package manager as explained here https://developers.arcgis.com/python/guide/install-and-set-up/#Install-using-ArcGIS-Pro

This only works if you have administrative access to the machine. These definitely more complicated instructions allow you to use a per-user (ie no admin required) Conda setup that is entirely independent of ArcGIS.

Re: Import arcpy into Jupyter Nootebook

ClintonDow1 — Thu, 27 Jul 2017 18:14:08 GMT

Hello Ionut,

It looks like something unusual has happened to your installation, I unfortunately can't seem to reproduce the issue so I'll give some general advice:

If the environment is broken, you can delete the 'arcgispro-py3' folder in %proInstall%\bin\Python\envs and rerun the installer, select 'repair installation' and it will recreate the fresh environment for you.
Jupyter Notebook creates shortcuts in the start menu, so may need Admin privileges to install correctly. (You should get a UAC pop-up in the Pro package manager in this case.)
Click the refresh button in the Pro package manager (blue circular arrows above package list) to get the latest versions of the package list. 'arcgis' is up to version 1.2.0 - there have been a few issues with packages shipped from Continuum Analytics that are outside of our control which may cause problems. (See this thread)
Anaconda is fairly aggressive in setting your system's PATH variable - double check that it isn't causing confusion. Its odd on the last screenshot to see Python 3.4 and 3.5 referenced on the same operation.
Currently arcpy is part of the Pro folder structure and not a 'pure' package, so it is not supported to install via Anaconda. (Working on this as we speak, should be supported soon.) As per Curtis' post it is possible to do currently but I can't guarantee things will work if you choose to follow those instructions.

Hopefully that helps a bit and gets you back to a working state. If you continue to have problems let us know!

Re: Import arcpy into Jupyter Nootebook

IonutAlixandroae4 — Fri, 28 Jul 2017 09:16:12 GMT

Hi Atma,

I have Pro 2.0 installed on my computer, updated via the updater window when started Pro 1.4... Python version installed with Pro is 3.5.3; Now I`m not really sure where does that 3.4 version of python comes from....

Also, In ArcGIS Pro I`m not having problems importing arcpy or arcgis

Thanks,

Ionut

Re: Import arcpy into Jupyter Nootebook

IonutAlixandroae4 — Fri, 28 Jul 2017 10:07:57 GMT

Hi Clinton,

Thanks for the reply and your feedback!!

Trying to reply in the order you provided:

1. I have re-installed ArcGIS Pro and when I try to reinstall arcgis package, it shows the loading bar, it appears as it was installed but after I can`t find it at installed packages, it`s still at packages available to install (to add), so no install. I had 0.1 verison before re-installed and working...

2. I have admin privileges on my computer; I have installed Anaconda 3 (3.6 - 64 bits) in C:/Users/%user%/ Anaconda3; It also created a path in the environment variables on C:\Users\%user%\Anaconda3\Scripts

3. That refresh button does the refresh but still no changes when installing argis package

4. Anaconda3 has a path in env variables

5. I`ll wait for arcpy for jupyter nootebook.

Now, the problems seems to be at installing arcgis in Pro 2.0....

Thanks,

Ionut

Re: Import arcpy into Jupyter Nootebook

LefterisKoumis — Wed, 13 Sep 2017 21:39:22 GMT

I spent numerous hours trying to figure out why I couldn't install my packages (like arcgis) using the ArcGIS Pro python package, only to find out that I had to disable the security first. So, in python commnad window type:

conda config --set ssl_verify false

Then you will have no problems.

Re: Import arcpy into Jupyter Nootebook

simoxu — Thu, 14 Sep 2017 03:07:00 GMT

I am just curious why you need to use ArcPy in notebook at the first place, by my understanding, ArcPy is a local API which is best to run inside of ArcGIS desktop products like Pro, ArcMap, ArcCatalog even some stand-alone scripts. While notebook and ArcGIS API for Python is a good technical combination for Portal/ArcGIS Online which basically supports the rest API...

Sorry, I know this is rather a comment than a practical solution.

Re: Import arcpy into Jupyter Nootebook

DanPatterson_Retired — Thu, 14 Sep 2017 03:21:29 GMT

Uses?

prototyping... teaching... many uses and it is not restricted to making maps.

Some examples and background and check the discussion ipnb and pdf there

Notebooks exist for R and Julia etc making a sort of one-interface option without the fluff of a full-fledged IDE

Arcpy is also embedded within the ArcGIS module in fact, if you don't have arcpy, you can still work with geometry since they expose access to shapely, and use Pandas for attribute access and processing.

Sadly, it still isn't incorporated into geonet, which would be nice, allowing people to test python code (for instance) with their own data online and maybe within a question thread

Re: Import arcpy into Jupyter Nootebook

LefterisKoumis — Thu, 14 Sep 2017 14:49:38 GMT

The jupyter notebook is the best IDE that it's available for developing/troubleshooting python scripts. Also you can easily modify existing geoprocessing tools in notebook to create REST services to be used in custom web apps. I don't even use Portal/ArcGIS Online.

Re: Import arcpy into Jupyter Nootebook

curtvprice — Thu, 14 Sep 2017 21:34:29 GMT

in python command window type:
conda config --set ssl_verify false
Then you will have no problems.

This is highly discouraged as it is a serious security risk, by passing https requirements set up by your organization. Better to set up a SSL certificate or use ssh authentication.

Re: Import arcpy into Jupyter Nootebook

LefterisKoumis — Thu, 14 Sep 2017 21:46:32 GMT

In my case working in an intranet environment, that's not an issue. You can just turn the ssl off temporarily, add the packages, and then turn it on back on.

Re: Import arcpy into Jupyter Nootebook

simoxu — Fri, 15 Sep 2017 01:06:22 GMT

I am very new to Jupyter Notebook, and I wrote less than 10 lines of code in it, so what I am saying is limited to my own knowledge.

I have to admit it looks amazing, it works like a magic with some executable code in a nice technical article. but I am not sure it's the best python IDE if it is an IDE at all. For me, Notebook is for presenting not for developing. I have a little more experience with PythonWin, PyScripter and WingIDE, I find these IDEs provide a developer far more powerful debugging tools. I may use notebook to document some of my python tools for ArcGIS Online and Portal.

additionally, I see Notebook as an ideal terminal to interact with web services that return tables, charts, images or maps that can be easily rendered in a browser, as the cmd window to many locally installed applications.

Thanks for any input to this discussion, I am learning...

Re: Import arcpy into Jupyter Nootebook

DanPatterson_Retired — Fri, 15 Sep 2017 01:52:55 GMT

check out 'spyder' is you are using ArcGIS Pro. And you can use IPython separately as well (my blog has a few posts)

Re: Import arcpy into Jupyter Nootebook

curtvprice — Fri, 15 Sep 2017 02:19:58 GMT

It doesn't sound very "intranet" if you can connect to the Conda repository.