topic Re: Identify Pixel Value From Raster Catalog in ArcGIS REST APIs and Services Questions

Identify Pixel Value From Raster Catalog

RyanCoodey — Mon, 06 Dec 2010 23:05:55 GMT

I never could understand why, but ArcMap has never been able to identify pixel values from rasters in a catalog, only stand alone raster datasets (there is a request for this at ideas.arcgis.com). This is the same functionality in ArcGIS Server and REST...

I had posted this similar question in the Silverlight/WPF forums over a month ago, but didn't find a solution: http://forums.arcgis.com/threads/16335-Raster-Catalog-Identify-Image-s-Pixel-Value-(And-Legend-Not-Showing-)?p=51011#post51011

Our users really need this functionality and since it is more a limitation of the REST API, I thought I would ask here...

- From what I can see there is no way in REST to get access to an individual raster in the catalog, is this true?
- Is there no way to trick the REST API to treat the catalog layer as a standalone raster? I am assuming REST can do an identify for pixel values on a raster dataset, please correct me if I am wrong.
- Is there no way to get access to the underlying connection info of the layer (SDE Feature Class)? Then I could perform some ArcObjects in my WPF application on it.
- Any other ideas?

Thanks a lot for any help!!!

Re: Identify Pixel Value From Raster Catalog

RaviNarayanan — Tue, 14 Dec 2010 15:53:01 GMT

At 10.0 Image Service supports Identify. Can this data be published as an image service?

http://help.arcgis.com/en/arcgisserver/10.0/apis/rest/isidentify.html

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Tue, 14 Dec 2010 16:03:03 GMT

At 10.0 Image Service supports Identify. Can this data be published as an image service?

http://help.arcgis.com/en/arcgisserver/10.0/apis/rest/isidentify.html

Thanks a lot for the reply Ravi!

Here is the problem, we would ideally like to publish as an image service, but for the following reasons, we cannot:
- Raster Catalogs cannot be published as an image service.
- Mosaic Datasets can, and they can point to a Raster Catalog, but they do not support classified renderers, which we need... These are not just aerial photos but continuous rate of change data grids. Maybe I am mistaken here?
- Mosaic Datasets seem a little funky with how they support date formats for time-aware content, but if I could work out the above issue I would look into this more.

So, I guess my problem also could be, how do I apply a classified renderer to mosaic dataset (in my Silverlight application)

Thanks again!

Re: Identify Pixel Value From Raster Catalog

WenxueJu — Wed, 15 Dec 2010 18:17:05 GMT

Ryan,

In this case, you want to identify original value (single-band) but want to render it to RGB in display. This goal can be achieved by using Raster Functions. Here are a few options and online resources:

(1) If the source data is 8-bit (0-255), you can specify a colormap function --- either on top of the mosaic dataset (its function tab) or in your REST request (through Silverlight API ArcGISImageServiceLayer.RenderingRule).
(2) If the source data is not 8-bit (e.g. temperature data), you may apply arithmetic function first (to manipulate data on-the-fly) before inserting colormap function.

Because these raster functions are applied on top of the mosaic, individual rasters in the mosaic dataset are intact; identify operation will return a RGB value of the mosaic result (after all the processing) and single-band pixel value of each raster at the identify location. Here is an example (case 2 --- temperature data)

http://sampleserver3.arcgisonline.com/ArcGIS/rest/services/World/Temperature/ImageServer/identify?geometry=90%2C40&geometryType=esriGeometryPoint&mosaicRule=&pixelSize=&f=html

Regards,
Wenxue

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Wed, 15 Dec 2010 19:24:09 GMT

Wenxue,

Thanks a LOT for that information... This sounds like it will work just fine for us. I will see what we can do! Thanks again!

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Wed, 15 Dec 2010 21:03:41 GMT

Ok, got a Mosaic dataset setup... but I think I have hit a road block:

1) Looking into making a color map (clr or act) file... it seems to want a color for EACH value and only supports 8-bit/256 integers. Our rasters in the catalog are 32-bit floating point, so there are THOUSANDS of values and this is unfeasible. That is why we have a classified renderer on it and not a unique value renderer in ArcMap. Can value "ranges" be specified in a color map?

2) I'm a little confused about time, we have a start and end time in a date field, but what do we choose for the "Time Value Format"? I'm used to putting dates in the format of MM/DD/YYYY but there are no options for that (they all have the year first)... and this is a date field, so it should know the format of it I would think... do I even need to set this?

Thanks!

Re: Identify Pixel Value From Raster Catalog

WenxueJu — Fri, 17 Dec 2010 00:35:32 GMT

1) Colormap doesn't support mapping a range of values. The workaround is to apply stretch function or arithmetic function (to stretch/squeeze to unsigned 8 bit) and then apply colormap function. This is what's applied to this temperature service:
http://sampleserver3.arcgisonline.com/ArcGIS/rest/services/World/Temperature/ImageServer
2) "Time Value Format" is applied when you use a string/number to represent date. You don't need to specify "Time Value Format" when it's a date field.

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Mon, 20 Dec 2010 16:20:37 GMT

1) Colormap doesn't support mapping a range of values. The workaround is to apply stretch function or arithmetic function (to stretch/squeeze to unsigned 8 bit) and then apply colormap function. This is what's applied to this temperature service:
http://sampleserver3.arcgisonline.com/ArcGIS/rest/services/World/Temperature/ImageServer
2) "Time Value Format" is applied when you use a string/number to represent date. You don't need to specify "Time Value Format" when it's a date field.

Thanks a lot Wenxue!

Still a bit confused with number 1. Could you please explain a little more? So I applied a stretch function, but the values in the raster go from -39 to 15... I tried using the strech to convert this to 0 to 255, but not real sure if that is what you are suggesting and how to properly do it if so. Also I'm not real sure how to then take this and map it into a color map. For example, -39 to - 30 range and map it into 0 - 255? Do I have to calculate a percentage of the range and then get that same percentage of 0 - 255, which would be something like 0 - 40?

Not sure what to do with the Arithmetic approach either, again I assume I need to map -39 to 0 and 15 to 255... but not sure how, sorry.

*EDIT* Also, after applying a color map, ArcMap only seems to show the RGB values with the identify tool... am I doing something wrong?

Thanks for all the great help so far!!!

Re: Identify Pixel Value From Raster Catalog

WenxueJu — Wed, 22 Dec 2010 15:22:16 GMT

For range manipulation, you can do one of the following (assuming your input is from -39 to 15):
1. Arithmetic function (right click mosaic dataset in catalog window --> function tab --> insert on top of mosaic function): Choose "Plus" as operation, and use -39 constant value for Raster2. Results are "shifted" to positive range 0 - 54. You can have 55 colors now. If you're satisfied (You can have another arithmetic "times" to make it 0-254 etc if necessary), change the output type of the function (general tab) to unsigned 8 bit, then insert your colormap (a clr file ranged from 0 to 54 or else).
2. Stretch function (right click mosaic dataset in catalog window --> function tab --> insert on top of mosaic function): Choose "Min-Max" type, manually type in the desired output min/max (e.g. 0/54, 0/254, etc), then manually type in the input raster's statistics min/max (standarddeviation and mean are not needed for min-max stretch) --- in this case it's -39/15. It's easier to use it in your case compared to Arithmetic function. Change the output type of the function (general tab) to unsigned 8 bit, then insert your colormap.

Currently ArcGIS Server always convert colormap to RGB for display, so you don't have to insert ColormapToRGB function.

ArcMap's identify tool shows only one value: the value at current identify location after ALL on-the-fly processing, that is, after mosaic --- stretch ---colormap, so you'll have a RGB value. It's the system's limitation not to show values from individual rasters (before mosaic). If you make a REST/SOAP request, you'll find values of individual rasters as shown in the url of winter temperature service in previous post.

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Thu, 23 Dec 2010 12:59:55 GMT

Wenxue,

Thank you so much for all the help! I got the mosaic dataset setup and it looks good. I just gotta get it setup in my Silverlight app now and test it out there. But I assume it will work are you said. Thanks a lot!

Re: Identify Pixel Value From Raster Catalog

WenxueJu — Thu, 30 Dec 2010 21:24:05 GMT

You are very welcome. Happy new year and enjoy coding!

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Wed, 05 Jan 2011 23:57:28 GMT

Well, I got the identify all working to get the pixel values and the time slider seems to be working with the mosaic too... but I realized there is another issue:

I had a raster from the original raster catalog with its classified renderer next to a raster in the new mosaic dataset (which btw references the same catalog) and I noticed the colors are a bit different, close, but different. I triple checked the stretch function and the colormap file and it seems to all be correct as I would expect and as we discussed above.

I have tried a number of changes to the mosaic settings without luck. Such as only allowing one raster to be draw, not allowing mosaicing... The output from the colormap function is 8-bit unsigned and I am using 32-bit RGB colors in the color map, ex. 211 255 190... Is this a problem? I tried changing the output of the colormap function to 32-bit unsigned, but that made everything all black.
I don't think it is a problem with the bit depth though or any of the applied functions, because when I do an identify in ArcMap on an area that should be a certain color, it will show the RGB value which might be for green but there is actually red on the screen. And there are pixels nearby that are indeed this same green that they should be.

Any ideas? Hoping it�??s a simple setting I missed?

Thanks a lot!

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Fri, 07 Jan 2011 14:36:16 GMT

Ok, I solved that problem... it was indeed my colormap... the maping values were off by one.

Now I am having some troubles working out identifying the pixel for only the currently visible raster (based off time). Would be nice if the image service identify took a time extent. Only way I can see to do this is in the mosaicRule to either set the FIDs to the visible raster or set the Where clause on the date fields. Problem with this is in the Silverlight app I do not have access to the visible rasters info or its time field names...

Re: Identify Pixel Value From Raster Catalog

RaviNarayanan — Tue, 18 Jan 2011 15:45:54 GMT

Ryan,

Image service Identify operation currently does not support time. We are planning to add this in 10.1.

thanks
Ravi

Re: Identify Pixel Value From Raster Catalog

RyanCoodey — Tue, 18 Jan 2011 16:07:21 GMT

Good news, thanks a lot ravi!

For the time being I am making a seperate Query operation with the TimeExtent to get the OID of the visible feature and then plugging it in the MosaicRule.

*EDIT* Another issue with the Identify on a mosaic dataset is that it does not obey the transformations assigned to the mosaic. Visually the images are showing right, but when performing an identify they are off... i posted about this issue already here: http://forums.arcgis.com/threads/20948-Image-Service-Identify-Not-Obeying-Transformations

Thanks again!

Re: Identify Pixel Value From Raster Catalog

RaviNarayanan — Mon, 31 Jan 2011 00:40:37 GMT

Thank you for reporting this. We have bug logged for Image Server to investigate this issue.

Another issue with the Identify on a mosaic dataset is that it does not obey the transformations assigned to the mosaic. Visually the images are showing right, but when performing an identify they are off... i posted about this issue already here: http://forums.arcgis.com/threads/209...ransformations

Re: Identify Pixel Value From Raster Catalog

SteveLi — Tue, 12 Apr 2011 19:47:39 GMT

In this thread, there is a identify sample privided by Wenxue.

http://sampleserver3.arcgisonline.com/ArcGIS/rest/services/World/Temperature/ImageServer/identify?geometry=90%2C40&geometryType=esriGeometryPoint&mosaicRule=&pixelSize=&f=html

It takes > 40sec to run. Is there a way to speed up the identify operation? I know it's against over 1000 layers. I am trying to add a chart to summary temprature change at a spot, it's taking too long to have a good user experience.

Thanks.

Re: Identify Pixel Value From Raster Catalog

AndreasWalter1 — Mon, 31 Oct 2016 14:31:33 GMT

Hey Ravi,

are there any news to the problems with the identify function for Image Server and Raster Catalog for version 10.4?

Thanks in advance!