topic Re: Importing Raster Data in .NET Maps SDK Questions

Importing Raster Data

MichaelGibson2 — Tue, 12 May 2020 16:15:19 GMT

I am surprised to find that ArcGIS runtime only supports a very limited set of raster formats: Add raster data—ArcGIS Runtime SDK for .NET | ArcGIS for Developers

Supported raster formats
ArcGIS Runtime supports a subset of raster file formats that ArcGIS Desktop supports. The raster file formats ArcGIS Runtime supports include the following:
ASRP/USRP
CRF
DTED0, 1, 2
GeoTIFF
HFA
HRE
IMG
JPEG
JPEG 2000
MrSID, generations 2, 3, and 4
NITF
PNG
RPF (CIB)
RPF (CADRG)
SRTM1, 2
Mobile mosaic datasets

I'm trying to import an ASCII grid format Esri ASCII raster format—Help | Documentation

Which is basically an ascii text file, which looks like:

NCOLS xxx NROWS xxx XLLCENTER xxx YLLCENTER xxx CELLSIZE xxx NODATA_VALUE xxx row 1 row 2 ... row n

Having a brief look around, I find only a few threads of help. :Importing ASCII raster files

04-Nov-2016 07:32
Hi,

In the current v10.2.X release we don't have a specific raster data type or layer to handle these, you'll need to use the Local Server and a Geoprocessing Package to convert the ASCII raster into another raster format and then use the result map service to render that. In the upcoming v100.0 release we have added a raster layer which can reference raster files on disk. Here's the list of supported types: Add raster data—ArcGIS Runtime SDK for .NET (Quartz Beta) | ArcGIS for Developers.

If your app regularly has data coming in in ASCII format then you can still use the LocalServer to convert to one of the supported types above.

For more info on the Local Server see Work with local services—ArcGIS Runtime SDK for .NET | ArcGIS for Developers

Which I'm a bit confused about... It is not possible to process a conversion in memory, or is the only way currently to convert the file and open the new converted file, as this would seem terribly inefficient.

Is there no way to create a raster object and pass it the memory, and use something else to actually load these files?

many thanks

Mike

Re: Importing Raster Data

MichaelBranscomb — Thu, 14 May 2020 00:59:46 GMT

Hi,

The answer might depend on your workflow, or that of your users e.g. Is this a one-time import of raster data into another format or do users of your app regularly open ascii rasters from disk?

If you're building an app with WPF then you could use the ArcGIS Runtime Local Server. This will support all the raster formats of ArcGIS Pro / ArcMap. You could read/render the dataset from disk via a LocalMapService or use a LocalGeoprocessingService to import/convert the raster data between formats.

Thanks

Mike

Re: Importing Raster Data

MichaelGibson2 — Thu, 14 May 2020 13:57:08 GMT

Thanks for your reply.

I think there will be two main questions/uses I'm thinking of: the first being that we will often need to load the ASCII formats, and the second I'm considering an animation by showing a number of raster one after another, for which I have the data in memory, and again it would seem fairly inefficient to send it to the disk only to be reloaded.

I'm currently using an encapsulated WPF form within my .NET windows forms app; which intend to migrate up to WPF at some point soon. Having a bit of look around ArcGIS Runtime Local Servers, and LacalMapServices, and LocalGepprocessingServices doesn't look too simple; Could you give a quick example for the purpose of 1. loading an ASCII file 2. passing data?

Many Thanks

Mike

Re: Importing Raster Data

MichaelBranscomb — Thu, 14 May 2020 23:25:12 GMT

Are you using the 2D MapView or 3D SceneView?

Thanks

Re: Importing Raster Data

MichaelGibson2 — Fri, 15 May 2020 09:42:19 GMT

2D initially, although its certainly interesting to consider the 3D options.

many thanks

Re: Importing Raster Data

MichaelGibson2 — Mon, 25 May 2020 13:23:54 GMT

So I found a work around for the time being, whereby for loading the ASCII, I'll just use GDAL to convert it to a GeoTiff format. Although this seems terribly inefficient.

For the animation, that would be even more inefficient it would seem.

I had a quick look at the LocalServer and LocalMapService, but this would seem you need to have users install and run the separate program that is the LocalServer? Is this correct?
Is no way to pass it the data, if I've already loaded them with something else like GDAL, or lets say generated them?

many thanks

Re: Importing Raster Data

MichaelBranscomb — Mon, 25 May 2020 18:10:37 GMT

Hi,

The latest release (100.8) added support for 'animation' of raster data in the 3D scene view with Image Overlays. Bringing that to the 2D map view is on the roadmap for a future release.

Regarding Local Server, that's an additional component/SDK that you as the developer install on your dev machine and incorporate the capabilities into your app then you include the Local Server pieces you need when you deploy the app to your users.

How many raster datasets would you like to animate and what's the image size approx?

Thanks

Mike

Re: Importing Raster Data

MichaelGibson2 — Tue, 26 May 2020 13:32:11 GMT

Thanks for your continued support Michael Branscomb‌

It would seem that 'animation' presumes you have all the images before the animation begins...

In actual fact, I have a flood modelling system, for which I'd like to show the outputs, and because of this I won't have the rasters until they are produced by the model.

Thanks for clarifying the localServer a bit more. Would the local server be able to load the the ASCII files into data and pass that to the map, which would be quicker and more effecient than converting them with GDAL.

I'm still trying to get the colours right in another post, but again because this will be model output, the size and number of rasters could vary. Although the number of rasters, would mainly depend on what the system can push through in a given time, thus my questions of the efficiency of loading/converting/passing data etc.

Cheers muchly

Re: Importing Raster Data

MichaelBranscomb — Tue, 26 May 2020 21:02:07 GMT

The Local Server component provides a wide range of functionality and a lot of flexibility through geoprocessing services that execute python scripts. But with that comes the overhead of hosting and executing the local service which may not be significant but does mean it's typically not as fast as executing functionality that is entirely within the API / client-side (good examples being the visual analysis and image overlays which are highly optimized API-level features).

Local Server may be an option for you though - it broadly supports the same range of raster formats as ArcGIS Pro (because it's built from the same codebase): Raster file formats—ArcGIS Pro | Documentation.

Do the raster datasets have a time aspect to them?

Thank

Mike

Re: Importing Raster Data

MichaelGibson2 — Thu, 28 May 2020 13:42:23 GMT

Thanks again Michael Branscomb‌

Yes the rasters do have a time element, as its a flood scenario. Although at present I'm mainly worrying about creating the animation through a series of time slice rasters.

So can the LocalServer (or maybe LocalMapService) pass the data to the map for the purposes of such an animation?

I don't supposed you could provide some code snippets to do this relatively simple procedure?

I guess I'll need at how to implement the local server/local map service to do this.

cheers

Re: Importing Raster Data

MichaelBranscomb — Mon, 01 Jun 2020 22:39:23 GMT

Hi,

Here's a sample on adding a raster dataset to a Local Map Service: arcgis-runtime-samples-dotnet/src/WPF/ArcGISRuntime.WPF.Viewer/Samples/Local Server/DynamicWorkspaceRaster at v100.7.0 ·…

We have actually just removed that sample from the master branch because it's typically not the recommended workflow today (since Runtime natively supports reading raster data). But Local Server is still a valid workflow when the Runtime doesn't support the format you need.

You could try combining that approach with TimeExtent: arcgis-runtime-samples-dotnet/src/WPF/ArcGISRuntime.WPF.Viewer/Samples/MapView/ChangeTimeExtent at master · Esri/arcgis-…

Thanks

Mike

Re: Importing Raster Data

RobBever — Wed, 15 Jul 2020 05:04:43 GMT

I haven't tried it yet, but it looks like using generic raster images where you have corner data from some other source (not embedded) is doable now (in SceneView only). If you look here:

Add image overlays—ArcGIS Runtime SDK for .NET | ArcGIS for Developers

You can see that in 100.8.0 there's now ImageFrame, which takes a RuntimeImage and either an Envelope or a Polygon. So you can load your regular (non-georeferenced) image into a RuntimeImage and then put that in an ImageFrame with whatever corners you want, either as an Envelope rectangle or even a 4-point polygon. Then you can put that in an ImageOverlay and you should be all set.

I think you'd have to write your own translator from world file (or whatever source of corner data for your image) to Envelope or set of points, but I think that's a fairly standard conversion. But you should now be able to load your image with world file.

I want to do it too, and I haven't tried it yet, so let me know if it works.

Re: Importing Raster Data

MichaelGibson2 — Tue, 21 Dec 2021 16:54:31 GMT

It would appear that my work around using GDAL to convert the ASCII grid into a geoTiff has stopped working...
Upon closer inspection it appear that 100.8 stopped reading the spatial reference (projection) of my converted geoTiff. At this point I don't know if its GDAL or ArcGis Runtime, but I didn't expect either to change without updating the version.

I wonder if there are any updates in this area?