"Compute Accuracy For Object Detection" does not find any "True Positives"

193
2
04-19-2024 03:47 AM
Labels (1)
rachbauer
New Contributor II

Hello everyone!

I encountered a problem with the Tool "Compute Accuracy For Object Detection" that does not make any sense to me. Maybe someone of you has any idea about this:

I created a MaskRCNN Model and used it to detect objects in a single image (for testing purposes). I want to see how well this model performs, which is why I use ground truth data of 50 images to compare my detection to (ground truth data covers the single image i used). I can clearly see, that some of my detections (pink) overlap with the ground truth data from that specific image (highlighted in cyan):

rachbauer_0-1713523395364.png

However, when i use "Compute Accuracy For Object Detection" it only shows false_positives and false_negative:

rachbauer_1-1713523472533.png

 

If anyone has any idea, it would be of great help! Thanks 🙂

0 Kudos
2 Replies
PavanYadav
Esri Contributor

@rachbauer I am wondering if you tried different values for the Minimum Intersection Over Union (IoU) parameter. 

https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/how-compute-accuracy-for-objec...

https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/compute-accuracy-for-object-de...

FYI, We have a dedicated board for ArcGIS Image Analyst Questions. Here you may get answers sooner on imagery related workflows.

Cheers!
Pavan

Pavan Yadav | Product Engineer - Raster/Imagery team

THE SCIENCE OF WHERE ®

0 Kudos
rachbauer
New Contributor II

Hi Pavan,

I already tried to change the IoU Value. However, it did not change the results :(. 

Thanks for the hint with the ArcGIS Image Analyst Questions Link. I guess i will post my Problem there as well 🙂  

0 Kudos