topic Re: Adding notebook crashing ArcGIS in ArcGIS Pro Questions

Adding notebook crashing ArcGIS

Anonymous User — Fri, 09 Apr 2021 00:57:11 GMT

Hey, so I'm running into a problem that I cannot find much info on at the moment.

I am trying to add/open notebooks on ArcGIS Pro, and it keeps crashing ArcGIS Pro, claiming there is an application error.

I am using ArcGIS Pro v2.7.2. ArcPy environment is 3.6 (although python 3.9 is also installed on my PC for some reason). Anaconda says "Anaconda3"? Not sure how to find exact Anaconda version.

Anybody know what to do? I am considering uninstalling/re-installing everything, but my time is short.

Re: Adding notebook crashing ArcGIS

DanPatterson — Fri, 09 Apr 2021 01:02:41 GMT

You are going to have to make sure that the arcgis_pro environment is activated.

Your python 3.9 environment may be interfering with the required environment associated with arcgis pro.

It might be easier to uninstall the 3.9 environment until you can things figured out (or install it on another machine)

Re: Adding notebook crashing ArcGIS

Anonymous User — Fri, 09 Apr 2021 01:33:43 GMT

That probably makes sense. I am new to all this stuff so I am just figuring out how it all works.

However, this is the issue: I actually have a py3 environment with deep learning packages installed (I do have another thread on DL stuff, but the notebook issue is now a different topic). What I am trying to do is use the ArcGIS notebook to customize deep learning tools. So I need both environments installed at once? How do I achieve this?

Re: Adding notebook crashing ArcGIS

DanPatterson — Fri, 09 Apr 2021 01:38:41 GMT

Not sure why you need python 3.9, I don't see it listed as a supported version for arcgis (unless it changed recently).

If you have separate environments/clones, are you sure you are activating the correct one each time? ( I have to ask)

Re: Adding notebook crashing ArcGIS

Anonymous User — Fri, 09 Apr 2021 02:02:11 GMT

I uninstalled Python 3.9 anyway. I think Visual Studio Code got excited and downloaded it for me one day.

Anyway, this is what my environment looks like. This should be all from the Deep Learning 2.7 installer (https://github.com/Esri/deep-learning-frameworks).

EDIT: After looking at it, I'm not even sure if the DL package stuff is even installed. Weird, because it was still doing Deep Learning stuff... unless that added that into ArcGIS v2.7.

EDIT: I re-ran the installer but it is all the same. Still has keras and tensorflow packages so must be the deep learning one. I'm so confused because apparently the ArcGIS notebook is supposed to be an inhouse feature, not even connected to Jupyter (except in style and format).

Re: Adding notebook crashing ArcGIS

DanPatterson — Fri, 09 Apr 2021 02:00:09 GMT

K drive... local drive?

in any event, you seem to have a lot of duplicates listed in your package list.

This is the latest for arcgis. I wouldn't go to 1.8.5 yet since it is in pre-release

Files :: Anaconda.org

I can't compare your environment since I am on Pro 2.8 beta 1, but the duplicates in your package list certainly isn't good.

I just use Jupyter Notebook or JupyterLab unless I happen to be in ArcGIS Pro

Re: Adding notebook crashing ArcGIS

Anonymous User — Fri, 09 Apr 2021 02:42:14 GMT

Yes, k drive is local. I cloned the environment and it ended up with 284 installed packages, appears to have left out duplicates.

...and now suddenly notebook works in ArcGIS wow 😐

Must have been an issue with duplicate packages in the default environment. Pretty sure that happened when I did some PC upgrades and had to re-install Windows. Also ended up re-installing ArcGIS on a secondary drive I had it on, and it didn't uninstall properly. It all makes sense now.

Now I am curious about how arcpy works when using it in a Jupyter notebook in Chrome (I will be progressing towards this method later on with deep learning, for instance with Google Colabs).

Attached is an image of my trying to run code for training the model, and it doesn't want to recognize arcgis (with or with the first line "import arcgis"). Do I need to install arcgis packages into anaconda now?

Re: Adding notebook crashing ArcGIS

DanPatterson — Fri, 09 Apr 2021 02:46:33 GMT

if arcgis isn't in the environment you are working in, it needs to be installed there as well.

Re: Adding notebook crashing ArcGIS

Anonymous User — Fri, 09 Apr 2021 03:11:04 GMT

I see. I have one last question for you. I am trying to more or less follow this tutorial here (https://www.linkedin.com/pulse/machine-learning-object-detection-arcgis-houtan-emad?articleId=6678170107090472962). So the author uses the "show_results" command to show batch samples and what not. How do I display this in a notebook? Is there a different type of cell for this? I've been trying this in ArcGIS but it just spins out and crashes when I run these show_result steps. It is critical that I see the data throughout this process, hence why I am crash coursing this like Trinity learning to fly a helicopter from the Matrix.

Re: Adding notebook crashing ArcGIS

Anonymous User — Sun, 11 Apr 2021 01:29:58 GMT

I still have the previous issue. I think what is going on is that it is supposed to display the output in the notebook when I run it, but it isn't. When I run the line of code, a shell window pops up and quickly disappears. I suspect that this is the Conda shell that needs to be open when using Jupyter notebooks in browser, but for some reason it automatically closes when it opens in ArcGIS Pro. I don't know what to do about that.

EDIT: To be more clear, lines like "data.show_batch()" do/show nothing. There is no generated output cell. I have an RTX 3080, pytorch is using it, shouldn't be any hardware issue.

Re: Adding notebook crashing ArcGIS

DanPatterson — Sun, 11 Apr 2021 02:18:12 GMT

Esri/arcgis-python-api: Documentation and samples for ArcGIS API for Python (github.com)

If it associated with the api and deep learning and kin, the above may be a place to file an Issue or too look through current open and past closed issues to look for a similar case to yours

Re: Adding notebook crashing ArcGIS

Anonymous User — Sat, 01 May 2021 06:17:52 GMT

Had to take care of other business, but now I am back to this project. I am still being stonewalled at this step. I cannot get "data.show_batch()" to do anything. I have tried giving it parameters like "(rows=3)" and still nothing. This is essentially a new PC, new installs, same problem.

This is in the notebook IN ArcGIS Pro, and everything appears to be working up to this step. It is supposed to display to me samples of the image chips, but nothing. I really need to figure this out.

Here is an example project that shows what to expect: https://developers.arcgis.com/python/guide/feature-categorization/.

EDIT: After spending some time on it, and running a test (https://developers.arcgis.com/python/guide/install-and-set-up/), it seems like I have installation errors with python packages. Just great.

All of the Deep Learning packages are fine, that's not the issue. The issue seems to be that there are like 60+ packages that say they require an update. I created a cloned environment and everything. ArcGIS Pro refused to update the packages inside of options, did nothing like usual.

I did the update through the Python Command Prompt, which had two outcomes: nothing changed in the options where it still claimed those updates were available; and worst of all, the update itself in the python console required me to accept a few downgrades, which included one for the Jupyter notebook network. This led to ArcGIS Pro claiming it cannot connect to notebook servers, closing the notebooks.

So I assume this is where the problems are coming from. I just need to update these packages, despite AGP refusing to do it for no discernable reason.