topic Re: Object detection with ArcGIS API job failed error in ArcGIS API for Python Questions

Object detection with ArcGIS API job failed error

TaehyunYoon1 — Sun, 27 Jun 2021 20:02:53 GMT

Purpose: I want to detect and count objects from downloaded map images.

Map data: I use a high-resolution google earth map image with ArcGIS pro.

Model: I used a single-shot detector. I trained the model with a labeled image that I did through ArcGIS pro.

References:

https://developers.arcgis.com/python/sample-notebooks/detecting-swimming-pools-using-satellite-image-and-deep-learning/

https://developers.arcgis.com/python/guide/object-detection/

Problems and Question (4 questions)

When I save my model, the '.zip' file does not appear. The Models folder has (ModelCharacteristics folder, ArcGISobjectDetector python file, model_metrics chrome HTML Document, .dlpk, emd, and .pth files). When I followed the references above, they used the '.zip' file for 'gis.content.add' function.

Instead of the “.zip” file, I used a “.dlpk” file for “gis.content.add” function.

I shared the ".tiff" image file to ArcGIS online content from ArcGIS pro web-share

I followed references, but it did not work. It notices me only “job failed.” I could not figure out what is the problem.

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Mon, 28 Jun 2021 07:14:15 GMT

It's not possible to run the deep learning models in ArcGIS Online. You basically have 3 options:

ArcGIS Enterprise with ArcGIS Image Server
ArcGIS Pro with the Image Analyst extension
ArcGIS Python API (dependent on model type)

The sample notebook you are following has the following in the prerequisites section:

This sample demonstrates how to do export training data and model inference using ArcGIS Image Server. Alternatively, they can be done using ArcGIS Pro as well.

If you don't have either Image Server or Pro + Image Analyst, there are prediction (detection) functions in the ArcGIS Python API for some models. SingleShotDetector does have one:

https://developers.arcgis.com/python/api-reference/arcgis.learn.toc.html#arcgis.learn.SingleShotDetector.predict

ssd.predict(image_path, threshold=0.5, nms_overlap=0.1, return_scores=False, visualize=False, resize=False)

It returns a List of xmin, ymin, width, height of predicted bounding boxes on the given image.

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Mon, 28 Jun 2021 20:29:13 GMT

I appreciate your prompt response Tim!!

I am working on ArcGIS Python API. Although I don’t know what the Image Analyst extension is, I also use the ArcGIS pro I purchased.
Although I was supposed to use ArcGIS Pro for this project, I faced a GPU prerequisite problem. For this reason, I am working on my school’s computing resource center server with ArcGIS Python API.
I labeled rectangular boxes on the training dataset through ArcGIS Pro and trained a deep learning model on ArcGIS Python API.
I do not fully understand how to use “ssd.predict” command. Do I have to use it after I train my model?
Please let me know where I can get the sample code for using “ssd.predict”?
Actually, I am a Ph.D. student in a different field. I only want to get data through object detection of satellite image data. If you have any better suggestions for this purpose, It will great help for me.

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Mon, 28 Jun 2021 23:11:22 GMT

Yes after training you can run the predict function straight away:

from arcgis.learn import SingleShotDetector, prepare_data data_path = r'<path>\ImageChips' data = prepare_data(data_path) ssd = SingleShotDetector(data) ssd.lr_find() ssd.fit(5, lr=1e-2) ssd.show_results() ssd.plot_losses() ssd.average_precision_score() ssd.save(r'<path>\<model>',save_inference_file=True) listresults=ssd.predict(image_path, threshold=0.5, nms_overlap=0.1, return_scores=True, visualize=False, resize=False)

To load the saved model from disk and predict you should be able to do:

from arcgis.learn import SingleShotDetector ssd = SingleShotDetector.from_model(r'<path_to_model_emd_file>') listresults=ssd.predict(image_path, threshold=0.5, nms_overlap=0.1, return_scores=True, visualize=False, resize=False)

The threshold parameter is the important one - the example above will only return detection over 50% confidence.

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Thu, 01 Jul 2021 20:45:46 GMT

Thank you Tim,

Is it possible to visualize as .tiff image?

Also, can I count detected objects?

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Fri, 02 Jul 2021 20:37:35 GMT

I faced a different problem that has not been a problem so far.
I am working on esri_learn deep learning dependencies.
The CUDA error below has not appeared before, even last night.
I re-installed dependencies, but it did not work.
Do you have any idea what the problem is?

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Fri, 02 Jul 2021 20:38:21 GMT

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Sat, 03 Jul 2021 01:20:10 GMT

It is a list, so the length of the list should be how many objects were detected - do for the above code:

numobjects=len(listresults)

Unfortunately to see the bounding boxes you would have to take the xmin, ymin, width and height and create your own polygons. One of the advantages of using the ArcGIS Pro tools is that they do all that work for you.

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Sat, 03 Jul 2021 01:22:07 GMT

This could be indicating that your graphics card may not be supported. What model is your card?

There's a fairly long discussion here about the error:

https://github.com/pytorch/pytorch/issues/31285

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Sat, 03 Jul 2021 02:07:34 GMT

How did they do this visualization? this is from the reference notebooks above.

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Sat, 03 Jul 2021 02:08:29 GMT

I work on virtual machine and I use K40.

I have never met this issue before.

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Sat, 03 Jul 2021 02:24:37 GMT

Have you changed anything in the environment recently? According to the following page, K40 support was removed in pytorch 1.3. The latest versions of ArcGIS are using pytorch 1.4.

https://github.com/pytorch/pytorch/issues/30532#

Maybe try finding an environment with a newer GPU - you should probably see if there's anyone in your schools IT department who could help.

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Sat, 03 Jul 2021 02:26:13 GMT

They were using the ArcGIS Image Server to do the detect_objects function, which outputs polygons directly. Unfortunately the predict function can't do that.

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Sat, 03 Jul 2021 21:12:46 GMT

Hello Tim,
I appreciate that you are willing to help me.
I did not change the environment. I re-install "arcgis_learn" just in case, and I identified the version of PyTorch.

https://github.com/pytorch/pytorch/issues/31285

Do you have an idea of what it means that "build from source"?

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Sun, 04 Jul 2021 15:51:15 GMT

Tim,

I will have zoom meeting with the developer in our school tomorrow for figuring out GPU and PyTorch problems.

I have two questions.

1. Can I update or install a specific version of PyTorch on conda-esri environment?

2. If I purchase ArcGIS Enterprise, it is possible for me just to follow the references above?

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Sun, 04 Jul 2021 22:03:37 GMT

1. Yes you should be able to do it via the python command line: conda install -c esri pytorch=<version>. There is no guarantee that this will work however, as the esri python environment is very complicated with numerous modules.

Ask the developer if there is any way to get access to a different GPU that is supported.

Another workaround to consider is to force arcgis.learn to use the CPU instead of the GPU. It will be a lot slower but should work. See here: How force Pytorch to use CPU instead of GPU?

2. ArcGIS Enterprise + Image Server is very expensive (many thousands of $$) and complicated to setup. It would be much simpler to use ArcGIS Pro with the Image Analyst extension. Find out if your school has a license for Esri products, otherwise you may be able to get a Student License for $100\year: ArcGIS for Student Use

Re: Object detection with ArcGIS API job failed error

Tim_McGinnes — Sun, 04 Jul 2021 22:06:05 GMT

It means to get the actual source code of pytorch, modify it to add the support for your GPU back in, then recompile it back into a Python module. It sounds difficult to achieve.

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Sun, 04 Jul 2021 22:12:05 GMT

I am already subscribing student License for $100/year. However, since I need to use a high-speed GPU, I have to work on a server offered by my school. I mean, I can work with Jupyter-notebook and ArcGIS python API.
I will ask the account manager of our school whether I can use ArcGIS Enterprise with an institute account.
Does ArcGIS Enterprise contain an Image Server? If I can use ArcGIS Enterprise, can I also use Image Server? or is it separate software?

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Sun, 04 Jul 2021 22:15:38 GMT

But I still feel it is weird. I have used it in the same environment before Friday morning. I changed nothing, rather I re-installed arcgis_learn. But your suggested link above was posted in 2019.

Re: Object detection with ArcGIS API job failed error

TaehyunYoon1 — Wed, 11 Aug 2021 18:54:20 GMT

Hello Tim,

When I use ssd.predict with visualize=True, can I make the result picture bigger with better resolution?