Purpose: I want to detect and count objects from downloaded map images. Map data: I use a high-resolution google earth map image with ArcGIS pro. Model: I used a single-shot detector. I trained the model with a labeled image that I did through ArcGIS pro. References: https://developers.arcgis.com/python/sample-notebooks/detecting-swimming-pools-using-satellite-image-and-deep-learning/ https://developers.arcgis.com/python/guide/object-detection/ Problems and Question (4 questions) * When I save my model, the '.zip' file does not appear. The Models folder has (ModelCharacteristics folder, ArcGISobjectDetector python file, model_metrics chrome HTML Document, .dlpk, emd, and .pth files). When I followed the references above, they used the '.zip' file for 'gis.content.add' function. * Instead of the “.zip” file, I used a “.dlpk” file for “gis.content.add” function. * I shared the ".tiff" image file to ArcGIS online content from ArcGIS pro web-share * I followed references, but it did not work. It notices me only “job failed.” I could not figure out what is the problem.

But I still feel it is weird. I have used it in the same environment before Friday morning. I changed nothing, rather I re-installed arcgis_learn. But your suggested link above was posted in 2019.

I am already subscribing student License for $100/year. However, since I need to use a high-speed GPU, I have to work on a server offered by my school. I mean, I can work with Jupyter-notebook and ArcGIS python API. I will ask the account manager of our school whether I can use ArcGIS Enterprise with an institute account. Does ArcGIS Enterprise contain an Image Server? If I can use ArcGIS Enterprise, can I also use Image Server? or is it separate software?

nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Object detection with ArcGIS API job failed error

TaehyunYoon1

Purpose: I want to detect and count objects from downloaded map images.

Map data: I use a high-resolution google earth map image with ArcGIS pro.

Model: I used a single-shot detector. I trained the model with a labeled image that I did through ArcGIS pro.

References:

https://developers.arcgis.com/python/sample-notebooks/detecting-swimming-pools-using-satellite-image-and-deep-learning/

https://developers.arcgis.com/python/guide/object-detection/

Problems and Question (4 questions)

When I save my model, the '.zip' file does not appear. The Models folder has (ModelCharacteristics folder, ArcGISobjectDetector python file, model_metrics chrome HTML Document, .dlpk, emd, and .pth files). When I followed the references above, they used the '.zip' file for 'gis.content.add' function.

Instead of the “.zip” file, I used a “.dlpk” file for “gis.content.add” function.

I shared the ".tiff" image file to ArcGIS online content from ArcGIS pro web-share

I followed references, but it did not work. It notices me only “job failed.” I could not figure out what is the problem.

タグ付けされた投稿をもっと見る

Accepted answers

All comments

TaehyunYoon1

Hello Tim,

When I use ssd.predict with visualize=True, can I make the result picture bigger with better resolution?

Tim_McGinnes

Have you changed anything in the environment recently? According to the following page, K40 support was removed in pytorch 1.3. The latest versions of ArcGIS are using pytorch 1.4.

https://github.com/pytorch/pytorch/issues/30532#

Maybe try finding an environment with a newer GPU - you should probably see if there's anyone in your schools IT department who could help.

TaehyunYoon1

I work on virtual machine and I use K40.

I have never met this issue before.

Tim_McGinnes

This could be indicating that your graphics card may not be supported. What model is your card?

There's a fairly long discussion here about the error:

https://github.com/pytorch/pytorch/issues/31285

TaehyunYoon1

I faced a different problem that has not been a problem so far.
I am working on esri_learn deep learning dependencies.
The CUDA error below has not appeared before, even last night.
I re-installed dependencies, but it did not work.
Do you have any idea what the problem is?

TaehyunYoon1

Thank you Tim,

Is it possible to visualize as .tiff image?

Also, can I count detected objects?

Tim_McGinnes

Yes after training you can run the predict function straight away:

from arcgis.learn import SingleShotDetector, prepare_data
data_path = r'<path>\ImageChips' 
data = prepare_data(data_path)
ssd = SingleShotDetector(data)
ssd.lr_find()
ssd.fit(5, lr=1e-2)
ssd.show_results()
ssd.plot_losses()
ssd.average_precision_score()
ssd.save(r'<path>\<model>',save_inference_file=True)
listresults=ssd.predict(image_path, threshold=0.5, nms_overlap=0.1, return_scores=True, visualize=False, resize=False)

To load the saved model from disk and predict you should be able to do:

from arcgis.learn import SingleShotDetector
ssd = SingleShotDetector.from_model(r'<path_to_model_emd_file>')
listresults=ssd.predict(image_path, threshold=0.5, nms_overlap=0.1, return_scores=True, visualize=False, resize=False)

The threshold parameter is the important one - the example above will only return detection over 50% confidence.

TaehyunYoon1

I appreciate your prompt response Tim!!

I am working on ArcGIS Python API. Although I don’t know what the Image Analyst extension is, I also use the ArcGIS pro I purchased.
Although I was supposed to use ArcGIS Pro for this project, I faced a GPU prerequisite problem. For this reason, I am working on my school’s computing resource center server with ArcGIS Python API.
I labeled rectangular boxes on the training dataset through ArcGIS Pro and trained a deep learning model on ArcGIS Python API.
I do not fully understand how to use “ssd.predict” command. Do I have to use it after I train my model?
Please let me know where I can get the sample code for using “ssd.predict”?
Actually, I am a Ph.D. student in a different field. I only want to get data through object detection of satellite image data. If you have any better suggestions for this purpose, It will great help for me.

Tim_McGinnes

It's not possible to run the deep learning models in ArcGIS Online. You basically have 3 options:

ArcGIS Enterprise with ArcGIS Image Server
ArcGIS Pro with the Image Analyst extension
ArcGIS Python API (dependent on model type)

The sample notebook you are following has the following in the prerequisites section:

This sample demonstrates how to do export training data and model inference using ArcGIS Image Server. Alternatively, they can be done using ArcGIS Pro as well.

If you don't have either Image Server or Pro + Image Analyst, there are prediction (detection) functions in the ArcGIS Python API for some models. SingleShotDetector does have one:

https://developers.arcgis.com/python/api-reference/arcgis.learn.toc.html#arcgis.learn.SingleShotDetector.predict

ssd.predict(image_path, threshold=0.5, nms_overlap=0.1, return_scores=False, visualize=False, resize=False)

It returns a List of xmin, ymin, width, height of predicted bounding boxes on the given image.

会話に参加する

サインインしたメンバーは投稿、更新のフォローなどができます。初めてですか？無料アカウントを登録してください。

クイックリンク

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.