nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Installing conda prerequisites error

MeshaSagram

Hello,

I am exploring the deep learning functions in ArcGIS Pro and have started following this tutorial: arcgis-python-api/detecting_swimming_pools_using_satellite_image_and_deep_learning.ipynb at master · Esri/arcgis-python-…

To get started with the arcgis.learn module in python, I need to install the prerequisites. The website says:

Data preparation, augmentation and model training workflows using arcgis.learn have a dependency on PyTorch and fast.ai deep learning libraries. They can be installed using conda as follows:
conda install -c fastai -c pytorch fastai=1.0.39 pytorch=1.0.0 torchvision

But when I enter that into my python window in Arc, I get a syntax error. I tried installing Anaconda and Git, and I entered this into the Anaconda Prompt and it seemed to install everything. But when I continue with the tutorial, I still get the message that it needs to be installed:

data = prepare_data(data_path, batch_size=32)
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\Mesha\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\lib\site-packages\arcgis\learn\_data.py", line 132, in prepare_data
_raise_fastai_import_error()
File "C:\Users\Mesha\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\lib\site-packages\arcgis\learn\_data.py", line 22, in _raise_fastai_import_error
raise Exception('This module requires fastai, PyTorch and torchvision as its dependencies. Install it using "conda install -c pytorch -c fastai fastai=1.0.39 pytorch=1.0.0 torchvision"')
Exception: This module requires fastai, PyTorch and torchvision as its dependencies. Install it using "conda install -c pytorch -c fastai fastai=1.0.39 pytorch=1.0.0 torchvision"

Is there anyone who can tell me what I need to change so that this works? I can't seem to find any resources online that address this. Thank you!

Find more posts tagged with

Accepted answers

All comments

DanPatterson_Retired

https://pro.arcgis.com/en/pro-app/help/analysis/image-analyst/install-deep-learning-frameworks.htm

Sandeep...

Does the online help need to be specific as to the ArcGIS Pro version?

If so, you or I should notify the documentation people through the link on that page. Let me know.

TomThompson1

Hi Sandeep Kumar‌,

Looks like ArcGIS Pro v2.5 was the key here. Once I updated, created a new clone, and used your command (conda install -c esri arcgis fastai pillow scikit-image --no-pin), I no longer receive module errors.

Thanks for your help! Thank you as well Dan Patterson.

Anonymous User

tom can you try this, after you import arcgis in the same notebook

import torch

also just to make sure ipython is working properly try this command in the python prompt

python -m ipykernel install --user

TomThompson1

Hi Sandeep Kumar,

I did as you suggested. Built a new clone and used the conda command you provided.

Same problems continue. Something to do with the import statements in the _data.py file. Occurs on the import of:

from fastai.vision.data import imagenet_stats, ImageItemList

Nothing is executed after this line in the _data.py and so my Python scripts leveraging the prepare_data() function fail, claiming that I do not have the required modules.

My next test is to update ArcGIS Pro to v2.5.0, as I'm at V2.4.3. Once updated I'll create another fresh clone and use the command you provided.

Tom

TomThompson1

Hey Dan Patterson,

Tested using the --no-pin and the documented solution to installing these modules:

conda install -c fastai -c pytorch fastai=1.0.54 pytorch=1.1.0 torchvision --no-pin

This did not resolve the problem.

Great idea though, I was hopeful. Thanks again for the suggestion.

Tom

Anonymous User

Hi Tom,

I see you are using ArcGIS Pro python command prompt, Create a new cloned environment and install the deep learning dependencies using this command

conda install -c esri arcgis fastai pillow scikit-image --no-pin

TomThompson1

Hi Dan Patterson‌,

I did try the --no-pin when installing the modules in my old environment and it did not resolve the problems.

I'll create a third environment and test it again just to make sure there were no dependency miss-matches.

Thanks for the suggestion,

Tom

TomThompson1

Some progress on this. I believe this issue is related to the _data.py file. Something, at least on my machine, is causing the import statements within the try/except to stop working.

Specifically, it is the import statement:

from fastai.vision.data import imagenet_stats, ImageItemList

Any statement defined after this line is skipped and fails, and so an exception is thrown and HAS_FASTAI will always equal false.

Interestingly, the interpreter throws no errors. It just exits and appears to have executed successfully. My debugger wasn't working, so I implemented some print statements to test.

<SPAN class="keyword token">try</SPAN><SPAN class="punctuation token">:</SPAN>
 <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"---_data.py Modules & Versions---"</SPAN><SPAN class="punctuation token">)</SPAN>
 <SPAN class="keyword token">import</SPAN> fastai
 <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"fastai installed at version: "</SPAN><SPAN class="punctuation token">,</SPAN>fastai<SPAN class="punctuation token">.</SPAN>__version__<SPAN class="punctuation token">)</SPAN>
 <SPAN class="keyword token">import</SPAN> torchvision
 <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"torchvision installed at version: "</SPAN><SPAN class="punctuation token">,</SPAN>torchvision<SPAN class="punctuation token">.</SPAN>__version__<SPAN class="punctuation token">)</SPAN>
 <SPAN class="keyword token">import</SPAN> torch
 <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"torch installed at version: "</SPAN><SPAN class="punctuation token">,</SPAN>torch<SPAN class="punctuation token">.</SPAN>__version__<SPAN class="punctuation token">)</SPAN>
 <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"Before Import from fastai.vision.data import imagenet_stats, ImageItemList"</SPAN><SPAN class="punctuation token">)</SPAN>
 <SPAN class="keyword token">from</SPAN> fastai<SPAN class="punctuation token">.</SPAN>vision<SPAN class="punctuation token">.</SPAN>data <SPAN class="keyword token">import</SPAN> imagenet_stats<SPAN class="punctuation token">,</SPAN> ImageItemList
 <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"After Import from fastai.vision.data import imagenet_stats, ImageItemList"</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

This is quite bizzare.

What do you guys think?

Tom

DanPatterson_Retired

did you try --no-pin in conda?

TomThompson1

Hey Sandeep Kumar,

I'm also seeing this issue with arcgis.learn. I've following the guide in Geospatial deep learning with | ArcGIS for Developers and installed the modules within a new environment successfully.

When running prepare_data() function from the learn module within Jupyter Notebooks, it throws the _raise_fastai_import_error(), claiming that it requires those modules listed in the original post. However, interestingly, when I run the _data.py file directly within VS Code, it succeeds and no exception is thrown.

I've confirmed that the environment I'm running is the same between my Jupyter Notebook & VS Code, AppData\Local\ESRI\conda\envs\arcgispro-py3-clone1. So I do not know why the exception occurs in Jupyter Notebooks, but does not in VS Code.

This problem I'm seeing may also be the root cause of why others experience this problem, so I'm posting here with these findings. I'll do some more debugging today and if I find the solution to my problem, I'll post a reply with the fix.

Tom Thompson, Esri Canada Technical Support.

NicholasPiper1

Sandeep,

It appears that arcgis deep-learning-essentials is no longer available through conda. Is there another location I can download it from?

-Nick

Vishnu_maheshVivek_nanda

The command 'conda install -c esri arcgis deep-learning-essentials --no-pin' solved my dependency issues for the "Use Deep Learning to Assess Palm Tree Health" tutorial.U

Anonymous User

Hi mesha,

You can try installing arcgis with all deep learning libraries in a clean environment. Here is the documentation on creating a new environment Python Package Manager—ArcPy Get Started | ArcGIS Desktop, after that you can use this command 'conda install -c esri arcgis deep-learning-essentials --no-pin' in the python command prompt.

MeshaSagram

Hi Sandeep,

Thank you for your reply. I looked through the land cover classification and it seems very helpful. I opened the Python Command Prompt under ArcGIS and ran 'conda install -c esri arcgis' and 'conda install -c pytorch -c fastai fastai=1.0.39 pytorch=1.0.0 torchvision'. They both installed successfully so I continued with the tutorial. I tried using the python window in ArcGIS Pro, IDLE (Python GUI) and Jupyter notebook but I'm getting the same error. I also checked in ArcGIS Pro under installed packages and I have fastai 1.0.39, pytorch 1.0.0 and torchvision 0.2.2 installed. I'm not sure how to move forward and continue with the tutorial.

data = prepare_data(data_path, batch_size=16)

---------------------------------------------------------------------------Exception                                 Traceback (most recent call last)<ipython-input-4-ddf06bba82c5> in <module>----> 1 data = prepare_data(data_path, batch_size=16)C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\learn\_data.py in prepare_data(path, class_mapping, chip_size, val_split_pct, batch_size, transforms, collate_fn, seed, dataset_type)    110     111     if not HAS_FASTAI:--> 112         _raise_fastai_import_error()    113     114     if type(path) is str:C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\learn\_data.py in _raise_fastai_import_error()     16      17 def _raise_fastai_import_error():---> 18     raise Exception('This module requires fastai, PyTorch and torchvision as its dependencies. Install it using "conda install -c pytorch -c fastai fastai=1.0.39 pytorch=1.0.0 torchvision"')     19      20 def _bb_pad_collate(samples, pad_idx=0):Exception: This module requires fastai, PyTorch and torchvision as its dependencies. Install it using "conda install -c pytorch -c fastai fastai=1.0.39 pytorch=1.0.0 torchvision"

Anonymous User

Mesha Sagram‌

The best way to install these dependencies is documented here Install and set up | ArcGIS for Developers, this will install all the dependencies you need for deep learning. Further, if you need to train models you may also want to install jupyter notebook in the same environment, you need not install anaconda separately for that. I hope that helps and do reply here if you need some more information, also we have a wealth of samples like this one Land Cover Classification using Satellite Imagery and Deep Learning | ArcGIS for Developers .

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.