Select to view content in your preferred language

Support adding cloud optimized GeoTIFFs by URL in Pro

1942
11
01-19-2023 10:22 AM
Status: Open
Labels (1)
PeterWiringa
Occasional Contributor

Allow users to add rasters by URL in ArcGIS Pro. We have S3 buckets of imagery (cloud optimized GeoTIFFs) that are exposed over https. We aren't able to give someone the URL to the raster and have them add the layer directly. Instead, they have to create a cloud storage connection and the browse to it. It would be convenient to be able to add http/s accessible COGs directly, e.g. add this example COG as a map layer using only its URL.

https://ss6imagery.arcgisonline.com/imagery_sample/landsat8/Bolivia_LC08_L1TP_001069_20190719_MS.tif...

 

Adding URL to rasterAdding URL to rasterUnable to add since it's not a serviceUnable to add since it's not a service

11 Comments
SimonSchütte_ct

Take a look at the Optimize Rasters Tool -> Raster Proxies:
https://github.com/Esri/OptimizeRasters
"OptimizeRasters can generate raster proxies to simplify access to raster data stored on cloud or network
storage.
Raster proxies are small pointer files, stored on local file systems, that contain minimal metadata and
reference much larger raster data files stored remotely. A user can work efficiently with collections of s
mall raster proxy files, using them in ArcGIS as if they were conventional raster files."
From: https://raw.githubusercontent.com/Esri/OptimizeRasters/master/Documentation/OptimizeRasters_UserDoc....

Luke_Pinner

Another workaround is this quick and dirty python toolbox:

Add remote COG to ArcGIS Pro by URL (GitHub Gist)

PeterWiringa

Thanks, @SimonSchütte_ct and @Luke_Pinner . We're coming at this from a more exploratory need, with various users throughout our institution (students, faculty, researchers) able to check one or a few rasters with minimal effort and no expectation of installed software or toolboxes; there's a lot of inconsistency across our users and an out-of-the-box method (like QGIS offers) is preferred, but the workaround are appreciated.

For a quick-and-dirty PYT, that's pretty slick.

Luke_Pinner

Quick and dirty as in there's no doco, testing or error handling...  Should work on the majority of remote COGs (but not wacky ones like these NASA GIMMS's COG products)

MiltonSolano

Hi Folks,

I support his idea as well; having hundreds of drone imagery in a STAC catalog or individual COG's URLs able to open directly into AGP would be awesome. If QGIS offers it, AGPcan do it better.

MJ

MattWilkie3

Thank you @Luke_Pinner that worked perfectly for my present scenario.

@SimonSchütte_ctSeems a bit buggy? Or maybe Canada's STAC are using a different version syntax. Either way, below STAC didn't work for me and the Add_Cog.pyt did. I leave it for someone else to troubleshoot this time. 😉

Luke_Pinner

@MattWilkie3 that STAC works well for me in QGIS. I had to change the endpoint to just "https://datacube.services.geo.ca/stac/api/", not the full url listed in the link you posted (https://datacube.services.geo.ca/stac/api/search?collections=mrdem-30).  I haven't tried in ArcGIS Pro though.

 

Luke_Pinner_0-1733906121543.png

 

SimonSchütte_ct

@MattWilkie3 as Luke_Pinner  writes, you need to change the endpoint.
However, I get a "Failed to add data, unsupported data type" error when I add the data to the map...
SimonSchtte_ct_0-1733908588285.png

 

MattWilkie3

huh, thanks for pointing out the url change needed. Doesn't work for me in Qgis or Pro though. Pro says "Network Error: cannot acesss ..." and Qgis is "Connections is not a valid STAC API". Might be our corporate firewall? It's a bit zealously tuned. Browser visit is fine though.

MattWilkie3_0-1733932114684.pngMattWilkie3_1-1733932141858.png