GeoAI SAM

prasanthkrishnavarman

Ich habe das neue Text SAM (Segment Anything Model), das im Esri India Living Atlas verfügbar ist, verwendet, um Gebäude aus einem Satellitenbild mit 0,3 m Auflösung mithilfe des Textbefehls "Buildings" zu erkennen. Das Modell hat jedoch nur wenige Gebäude erkannt. Wie kann die Erkennungsgenauigkeit des Text SAM Modells verbessert werden? Gibt es außerdem eine Möglichkeit, das SAM Modell für bessere Ergebnisse feinzujustieren? <\/SPAN><\/SPAN><\/P>

SwastikaDas

The issue you're encountering may be due to the varying sizes of buildings in the satellite imagery. For instance, in an urban context, there are buildings of small, medium, and large footprints.  Although deep learning models are typically trained on multiple imagery resolutions, the variation in building sizes can pose challenges. To improve detection, try manually adjusting the cell size in the environments tab of Detect Objects Using Deep Learning tool between 0.1 to 0.5. This should enhance detection across all building sizes. For more details, refer to this blog post: "https://www.esri.com/arcgis-blog/products/arcgis-pro/analytics/multiresolution-object-detection-with-text-sam/?srsltid=AfmBOoohMVcSgbSg-K_J2jtp9HCdvsALOdiEeKT02Ss-d15y2ZU_Pk6L"
Regarding your second question, yes, the SAM model can be fine-tuned. The SamLoRA model, a variation of SAM now available in ArcGIS, introduces trainable layers called Low-Rank Adaptation (LoRA) to the frozen image encoder of SAM. You can train the SamLoRA model to detect specific features of interest for more accurate results.