Using pre-trained deep learning models with declassified satellite imagery

Question

Hello everybody.

I am a PhD student  trying to apply ESRI's pretrained deep learning models (SAM and/or Agricultural Field Delineation) to declassified satellite imagery, specifically Corona or Hexagon low-resolution mapping camera images.

In a different forum I was told that as these are single-band images, I would need to add texture to them (e.g. integrating Landsat bands to them) to make them multiband images for this type of analysis.  Which I did.  I was also advised that utilising a DEM that corresponds to my study location and approximate time period (of the imagery) would improve my results.  So, I found the appropriate DEM and clipped it to my study area.  A different expert said that the deep learning is more effective when DEM-derived products are also included in this analysis, specifically slope and curvature.

I now have 4 different raster images: the textured declassified image, an SRTM DEM, slope and curvature.  I uploaded them individually to ArcGIS Online to experiement with the aforementioned deep learning packages.  I tried both packages on just the textured image and on a composite band image.  And received error messages every single time.  I'm not an experienced GIS-user so it is possible that I have made some dumb mistakes in preparing my images for this type of analysis.  But at this point, I'm not sure where to even start troubleshooting.

Has anybody here ever successfully used one of these pre-trained models  on this type of declassified imagery? Or heard of anybody who has been able to do so?  If so, I would appreciate any advice, contacts, workflows, recommended reading, etc. in order to move forward.  This data preparation is only a small (although potentially invaluable) part of my total research but I need to be extremely careful to not get bogged down in lengthy, time-consuming tasks (e.g., accumulating individual training samples)...or anything too complicated for somebody that doesn't know coding or in-depth GIS programming.

Thank you, in advance, for any help!

EMK · Answer

Thank you everybody for your answers!  I have read most of these links before but I will look back through them to make sure that I haven't missed anything.  My textured Corona image IS a three band (colour) image.  Texture was added to the original b/w image in Google Earth Engine, following the advice of Ujaval Gandhi of Spatial Thoughts, by combining it with the appropriate Landsat imagery.  I'm currently attempting the actual deep learning experimentation with ArcGIS Online as I've tried this with ArcGIS Pro and even though I have a decent laptop, I'm just a bit above the minimum limits of required processing power for anything deep learning related.  It will work but ties up my laptap for hours, which isn't very practical.  All DL libraries are already installed and compatible with my current version of Pro.  My university is currently allowing me credits for ArcGIS Online (as I need to work remotely and don't have access to high-spec computers) as long as I'm reasonable in what I use.

I use Google Earth Engine or ArcGIS Pro for the other image prep/processing tasks.  And I did make a composite band image using the textured image (1 band?), slope (2nd band?) and curvature (3rd band?) but I may need to doublecheck that everything was actually 8 bit.  Thank you for reminding me about that.  I'll also look into the Managing Labels documentation...but up until now, I've held off on training my own model due to time constraints.

Again, thank you for all the advice.  I'll go back to troubleshooting, reading and experimenting.  And if something DOES finally work, I'll let you know 🙂

BobBooth1 · Answer

I also suggest using ArcGIS Pro, rather than ArcGIS Online. This tutorial should help you get set up:

https://learn.arcgis.com/en/projects/get-ready-for-deep-learning-in-arcgis-pro/

RVirk · Answer

"I now have 4 different raster images: the textured declassified image, an SRTM DEM, slope and curvature.  I uploaded them individually to ArcGIS Online to experiement with the aforementioned deep learning packages.  I tried both packages on just the textured image and on a composite band image."

It seems you still have a raster image which has a single band, minus the texture declassified image where you may have only 2 bands - texture + b/w. [Corona is a single band b/w imagery]. This still does not fit the pre-trained model requirements!