"Compute Accuracy For Object Detection" does not find any "True Positives"

[rachbauer]

Hello everyone!

I encountered a problem with the Tool "Compute Accuracy For Object Detection" that does not make any sense to me. Maybe someone of you has any idea about this:

I created a MaskRCNN Model and used it to detect objects in a single image (for testing purposes). I want to see how well this model performs, which is why I use ground truth data of 50 images to compare my detection to (ground truth data covers the single image i used). I can clearly see, that some of my detections (pink) overlap with the ground truth data from that specific image (highlighted in cyan):

However, when i use "Compute Accuracy For Object Detection" it only shows false_positives and false_negative:

If anyone has any idea, it would be of great help! Thanks 🙂

[PavanYadav]

@rachbauer I am wondering if you tried different values for the Minimum Intersection Over Union (IoU) parameter. 

https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/how-compute-accuracy-for-objec...

https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/compute-accuracy-for-object-de...

FYI, We have a dedicated board for ArcGIS Image Analyst Questions. Here you may get answers sooner on imagery related workflows.

Cheers!
Pavan

Pavan Yadav | Product Engineer - Raster/Imagery team

THE SCIENCE OF WHERE ®

[rachbauer]

Hi Pavan,

I already tried to change the IoU Value. However, it did not change the results :(. 

Thanks for the hint with the ArcGIS Image Analyst Questions Link. I guess i will post my Problem there as well 🙂  

[PavanYadav · Accepted solution]

This issue has been resolved by making sure both the Ground Truth Features, and the Detect Features contain the same class values. For example, if your Ground Truth Features have the class value "car" and the Detect Features has the class value "cars", the tool will treat them as two different classes.