Compute Accuracy For Object Detection Error

308
2
07-28-2021 10:03 PM
Stevohu
New Contributor II

G'day.

I have trained a deep learning model to detect Grey Headed Flying Foxes camping in trees using both the 'export training data for deep learning' and 'train deep learning model' tool. The model can detect a large portion of bats (still needs more training) however I would like to run the 'Compute accuray for object detection' in order to determine the accuracy of the model. But when I run the tool I receive the following error message:

"ERROR 999999: Something unexpected caused the tool to fail. Contact Esri Technical Support (http://esriurl.com/support) to Report a Bug, and refer to the error help for potential solutions or workarounds.
Failed to execute (ComputeAccuracyForObjectDetection)."

Here are my parameters for the tool:

Detected Objects: DSC05728_Detected_Objects

Ground Truth Features: DSC05728_labels 

Outpute Accuracy Table: C:\ArcGIS_Pro_Machine_Learning\RGB_Training_Project.gdb\DSC05728_Detected_objects_Acc

Output Accuracy Report: C:\ArcGIS_Pro_Machine_Learning\DSC05728_Detected_objects_Acc.pdf

Detected Class Value Field: GHFF

Ground Truth Class Value Field: GHFF

Minimum Intersection Over Union: 0.5

Mask Features: N/A

Extent: Default

 

If anyone has any idea on how to fix the error that would be much appreciated

All my ArcGIS files are being saved into the same folder called ''ArcGIS_Pro_Machine_Learning"

Below are screenshots of my attribute tables and the image in question.

Stevohu_0-1627534859000.png

Stevohu_1-1627534866633.png

Stevohu_2-1627534907523.png

 

 

0 Kudos
2 Replies
Tim_McGinnes
Occasional Contributor III

That's a cool use of deep learning.

In your tool results is there anything in the Messages section that may point to the problem?

Do you get this error on all your photos & datasets, or just this one?

If you set the Detected Class Value Field to "Class" and the Ground Truth Class Value Field to "Classname" does it still error?

I wonder if it is some sort of geometry issue when it is trying to calculate the overlaps. If you export just a few detection polygons and corresponding truth polygons does it still error? Are there any issues identified if you run the Check Geometry tool over the datasets?

Stevohu
New Contributor II

Thanks for the reply! My Supervisor and I found the issue finnally! We found that the deep learning detected objects did not have a coordinate system attached to them, while the labels had "WGS_1984_Web_Mercator_Auxiliary_Sphere". We fixed this by Exporting the Detected Objects with the same Coordinate System as the labels. We were then able to run the Compute Accuracy Tool and got some results.

But to answer your suggestions:

The messages had the same error message as errors.

Error was ocurring on all images and datasets

Check Geometery would export no results (Most likely due to the fact that the detected objects did not have a coorindate system)

0 Kudos