topic Re: "Compute Accuracy For Object Detection" does not find any "True Positives" in ArcGIS Pro Questions

"Compute Accuracy For Object Detection" does not find any "True Positives"

rachbauer — Fri, 19 Apr 2024 10:47:35 GMT

Hello everyone!

I encountered a problem with the Tool "Compute Accuracy For Object Detection" that does not make any sense to me. Maybe someone of you has any idea about this:

I created a MaskRCNN Model and used it to detect objects in a single image (for testing purposes). I want to see how well this model performs, which is why I use ground truth data of 50 images to compare my detection to (ground truth data covers the single image i used). I can clearly see, that some of my detections (pink) overlap with the ground truth data from that specific image (highlighted in cyan):

However, when i use "Compute Accuracy For Object Detection" it only shows false_positives and false_negative:

If anyone has any idea, it would be of great help! Thanks 🙂

Re: "Compute Accuracy For Object Detection" does not find any "True Positives"

PavanYadav — Mon, 06 May 2024 17:52:59 GMT

@rachbauer I am wondering if you tried different values for the Minimum Intersection Over Union (IoU) parameter.

https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/how-compute-accuracy-for-object-detection-works.htm

https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/compute-accuracy-for-object-detection.htm

FYI, We have a dedicated board for ArcGIS Image Analyst Questions. Here you may get answers sooner on imagery related workflows.

Cheers!
Pavan

Pavan Yadav | Product Engineer - Raster/Imagery team

THE SCIENCE OF WHERE ®

Re: "Compute Accuracy For Object Detection" does not find any "True Positives"

rachbauer — Tue, 07 May 2024 10:30:17 GMT

Hi Pavan,

I already tried to change the IoU Value. However, it did not change the results :(.

Thanks for the hint with the ArcGIS Image Analyst Questions Link. I guess i will post my Problem there as well 🙂

Re: "Compute Accuracy For Object Detection" does not find any "True Positives"

PavanYadav — Mon, 17 Jun 2024 16:33:08 GMT

This issue has been resolved by making sure both the Ground Truth Features, and the Detect Features contain the same class values. For example, if your Ground Truth Features have the class value "car" and the Detect Features has the class value "cars", the tool will treat them as two different classes.