idea Support adding cloud optimized GeoTIFFs by URL in Pro in ArcGIS Pro Ideas

Support adding cloud optimized GeoTIFFs by URL in Pro

PeterWiringa — Thu, 19 Jan 2023 19:25:12 GMT

Allow users to add rasters by URL in ArcGIS Pro. We have S3 buckets of imagery (cloud optimized GeoTIFFs) that are exposed over https. We aren't able to give someone the URL to the raster and have them add the layer directly. Instead, they have to create a cloud storage connection and the browse to it. It would be convenient to be able to add http/s accessible COGs directly, e.g. add this example COG as a map layer using only its URL.

https://ss6imagery.arcgisonline.com/imagery_sample/landsat8/Bolivia_LC08_L1TP_001069_20190719_MS.tiff

Adding URL to rasterUnable to add since it's not a service

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

SimonSchütte_ct — Fri, 20 Jan 2023 07:24:58 GMT

Take a look at the Optimize Rasters Tool -> Raster Proxies:
https://github.com/Esri/OptimizeRasters
"OptimizeRasters can generate raster proxies to simplify access to raster data stored on cloud or network
storage. Raster proxies are small pointer files, stored on local file systems, that contain minimal metadata and
reference much larger raster data files stored remotely. A user can work efficiently with collections of small raster proxy files, using them in ArcGIS as if they were conventional raster files."
From: https://raw.githubusercontent.com/Esri/OptimizeRasters/master/Documentation/OptimizeRasters_UserDoc.pdf

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

Luke_Pinner — Fri, 20 Jan 2023 08:31:56 GMT

Another workaround is this quick and dirty python toolbox:

Add remote COG to ArcGIS Pro by URL (GitHub Gist)

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

PeterWiringa — Mon, 23 Jan 2023 16:55:45 GMT

Thanks, @SimonSchütte_ct and @Luke_Pinner . We're coming at this from a more exploratory need, with various users throughout our institution (students, faculty, researchers) able to check one or a few rasters with minimal effort and no expectation of installed software or toolboxes; there's a lot of inconsistency across our users and an out-of-the-box method (like QGIS offers) is preferred, but the workaround are appreciated.

For a quick-and-dirty PYT, that's pretty slick.

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

Luke_Pinner — Tue, 24 Jan 2023 04:36:08 GMT

Quick and dirty as in there's no doco, testing or error handling... Should work on the majority of remote COGs (but not wacky ones like these NASA GIMMS's COG products)

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

MiltonSolano — Thu, 29 Aug 2024 20:27:27 GMT

Hi Folks,

I support his idea as well; having hundreds of drone imagery in a STAC catalog or individual COG's URLs able to open directly into AGP would be awesome. If QGIS offers it, AGPcan do it better.

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

SimonSchütte_ct — Fri, 25 Oct 2024 09:16:23 GMT

@MiltonSolano STAC catalogs are now supported in ArcGIS Pro 3.2+, here you can find sample datasets: Landsat Collection 2 Level-2 | Planetary Computer or GitHub - Esri/arcgis-for-mpc: Documentation and examples for ArcGIS for Microsoft Planetary Computer

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

MattWilkie3 — Tue, 10 Dec 2024 15:53:16 GMT

Thank you @Luke_Pinner that worked perfectly for my present scenario.

@SimonSchütte_ctSeems a bit buggy? Or maybe Canada's STAC are using a different version syntax. Either way, below STAC didn't work for me and the Add_Cog.pyt did. I leave it for someone else to troubleshoot this time. 😉

https://open.canada.ca/data/en/dataset/18752265-bda3-498c-a4ba-9dfe68cb98da

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

Luke_Pinner — Wed, 11 Dec 2024 08:41:44 GMT

@MattWilkie3 that STAC works well for me in QGIS. I had to change the endpoint to just "https://datacube.services.geo.ca/stac/api/", not the full url listed in the link you posted (https://datacube.services.geo.ca/stac/api/search?collections=mrdem-30). I haven't tried in ArcGIS Pro though.

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

SimonSchütte_ct — Wed, 11 Dec 2024 09:21:43 GMT

@MattWilkie3 as Luke_Pinner writes, you need to change the endpoint.
However, I get a "Failed to add data, unsupported data type" error when I add the data to the map...

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

MattWilkie3 — Wed, 11 Dec 2024 15:49:19 GMT

huh, thanks for pointing out the url change needed. Doesn't work for me in Qgis or Pro though. Pro says "Network Error: cannot acesss ..." and Qgis is "Connections is not a valid STAC API". Might be our corporate firewall? It's a bit zealously tuned. Browser visit is fine though.

Re: Support adding cloud optimized GeoTIFFs by URL in Pro

SimonSchütte_ct — Thu, 12 Dec 2024 07:10:39 GMT

@MattWilkie3 In ArcGIS Pro select "New STAC Connection" instead. "Add STAC Connection" is used to select an already created ArcGIS STAC Connection file. (And for QGIS try the STAC API Browser extension)