topic Re: Convert 16bit to 8bit Tifs (Hope to Batch) in Data Management Questions

Convert 16bit to 8bit Tifs (Hope to Batch)

City_ofNorth_Bay — Wed, 25 Aug 2010 13:33:55 GMT

The Export Raster Data Tool (accessed through right click - Data - Export Data in ArcView) allows the user to select the "Use Renderer" option. This option seems to convert my 16bit tifs into 8bit tifs properly. Problem is I cannot use this tool in a Model to repeat it multiple times.

Any Ideas?
Thanks in advance.

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

StephanieLeusink — Tue, 22 May 2012 19:20:23 GMT

I have also run into this and am looking for a way to use the Export Raster Data Tool (accessed through right clicking on the raster in ArcMap and selecting Data - Export Data) either in ModelBuilder or through a python script. I have 50+ 16bit tifs that I need to convert to 8bit, and this tool has produced the best results so far.

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

CarrieDavis — Tue, 22 May 2012 20:31:59 GMT

Hi

The "use render" option will save the current raster renderer settings to an exported raster dataset. So, it is useful if you would like to set a particular stretch and have the exported raster display as this stretch by default. This option is not available in a geoprocessing tool, but the option to change the raster�??s pixel depth is available through the Data Management > Copy Raster tool.

Copy Raster ArcGIS Resource center help doc:
http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#//001700000094000000

Copy Raster can be batched by right clicking on the tool and selecting �??Batch�?� or in model builder by inserting the Iterate Rasters tool. With version 10, the Copy Raster tool may also be batched in python using arcpy.ListRasters. For example:
[ATTACH=CONFIG]14530[/ATTACH]

Or if in 9.3 use arcgisscripting. The script sample is available in the Copy Raster help document for 9.3 at http://webhelp.esri.com/arcgisdesktop/9.3/body.cfm?id=1913&pid=1912&topicname=Copy%20Raster%20(Data%20Management)&tocVisable=0.

Hope this helps! Carrie D.

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

StephanieLeusink — Tue, 22 May 2012 20:52:37 GMT

Thanks for the response Carrie.

I'm currently using the Export Raster Data because the "User Renderer" and "Force RGB" check boxes are producing the results I need. It sounds like I can't access these options any other way, besides right-clicking on each image individually.

It would be wonderful if these options could be built into a tool that can be accessed in a model or through python. From my searching for solutions online, it sounds like there are a few others who would find this useful too!

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

CarrieDavis — Tue, 22 May 2012 21:36:35 GMT

Hi SLeusink ,

Do your Tiffs have colormaps? If so the Copy Raster tool does have a parameter that will convert colormaps to RGB.

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

StephanieLeusink — Tue, 22 May 2012 21:55:43 GMT

No, there are no colormaps present. They are 16bit tiffs with 4 bands present, and within ArcMap, on the Symbology tab of the raster properties, I'm setting the Red, Green, and Blue channels to the band combination that I want to display and then using the Export Raster Data tool to convert it to 3 band, 8bit tiffs. It would be great if I could write a script that would loop through all the rasters in the TOC and export them using the same settings, instead of doing each separately.

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

CarrieDavis — Tue, 22 May 2012 22:59:29 GMT

I'm sure there is a way to do this using ArcObjects. That's a different forum. There is a quick way to do a similar procedure batch style with model builder. Below is a print screen of a set of tools linked in model builder that will iterate, create a raster layer with your specified band combo and then copy the layer as a 3 band raster.

[ATTACH=CONFIG]14537[/ATTACH]

I just tested this real quick on some local data I have that is an 8 band raster and was able to specify an output raster as 3 band with combo of 1,3,4. This raster was saved as an 8 bit unsigned integer. This required the use of three tools; Iterate Raster, Make Raster layer, and Copy Raster. Iterate Raster is inserted into the model to loop through a workspace and perform a function on each raster within the workspace. Then I set the band combination in the Make Raster layer tool (Type in the band numbers in the "Bands" parameter and select the + button to add).

[ATTACH=CONFIG]14538[/ATTACH]

Use the Raster Layer as input into the Copy Raster tool. The output may be specified to a particular folder as \\servername\outputRas\%Name%

I realize it might take some inital time to familarize yourself with these tools, but they may be helpful down the road.

Iterate Rasters (Model Builder)
http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#//00400000000z000000.htm

Make Raster Layer
http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#//00170000006t000000

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

StephanieLeusink — Wed, 23 May 2012 15:06:42 GMT

Hi Carrie,

I've tried your model, and it looks like the Make Raster Layer will work to choose the bands I want, but the Copy Raster tool is not able to properly rescale the pixel values from 16bit to 8bit. It even says so in the Tool Help:

"The pixel type parameter determines the bit depth of the output raster dataset. There is rescaling of the raster values when a different pixel type is chosen. If the pixel type is demoted (lowered), the raster values outside the valid range for that pixel depth will be truncated and lost."

So, when I go from a false-color 16bit tiff to an 8bit tiff with Copy Raster, my image is completely lost (see first 2 attachments).

For some reason, the Export Raster Data tool within ArcMap is able to properly rescale the values for all three bands so that the resulting 8bit image looks almost identical to the original 16bit image, which is what I'm looking for (see second 2 attachments).

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

EricRice — Wed, 23 May 2012 15:46:54 GMT

The Export Raster Data Tool (accessed through right click - Data - Export Data in ArcView) allows the user to select the "Use Renderer" option. This option seems to convert my 16bit tifs into 8bit tifs properly.

I'm just going to throw this out there for everyone. There is no conversion from 16 bit data to 8 bit data using the Export Dialog. However, using the options "Use Renderer" and "Force RGB", there is a conversion from 16 bit data to an 8 bit picture of your data which is why it looks nearly identical. Its similar to taking a screenshot. Was this your goal?

Why do you want to go from 16 bit to 8 bit?

Best Regards,
Eric

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

StephanieLeusink — Wed, 23 May 2012 17:25:57 GMT

I need my imagery to be 8bit because of compatibility issues with other data.

If this Export Dialog just produces a screenshot, which you seem to imply is not the correct way to do things, then what process would you suggest using to convert 16bit to 8bit while retaining the look/detail of the original imagery?

And how is the 8bit output that I'm getting from the Export Dialog tool inaccurate? I'm not really familiar with the technical side of imagery formats and bit depth, but it seems to be producing the results I need.

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

CarrieDavis — Thu, 24 May 2012 20:38:22 GMT

Hi Leusink,

What version and license level, ex. ArcView, Editor or Info of the software are you working with? As of version 10, Copy Raster will not rescale the data value range. This option is available as of 10.1. If you are working with data for example that has a valid pixel range of 0-1116, this range will be cut off at 255 if you set the pixel Type to 8 bit unsigned. You will need to rescale your data first. There are methods available to rescale your data depending on the version, license level, and extensions . As of version 10, with ArcEditor or Info you have the option to use a mosaic dataset to set your imagery to 8 bit. Would you mind elaborating on the compatibility issue and the purpose for converting the 16 bit imagery to 8 bit? Thank you.

Carrie

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

EricRice — Fri, 25 May 2012 14:24:39 GMT

Here is the forumula to rescale your data.

rescaled grid = [(grid - min value from grid) * (max scale value - min scale value) / (max value from grid - min value from grid)] + min scale value

-Eric

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

StephanieLeusink — Fri, 25 May 2012 15:42:35 GMT

I have access to both ArcView and ArcInfo levels of 9.3, along with Spatial Analyst. We are in the process of getting ArcGIS 10, but it has not been rolled out by our IT department. I do have access to a machine with 10, but I can't heavily rely on it yet, so the new mosaic dataset isn't a solution quite yet.

Eric, I tested the formula you gave me, and it produces results that are almost idential to what the Export Dialog produces. The only differences are from rounding because the export dialog produced an 8bit unsigned integer tiff and therefore cannot contain decimals. That leads me to believe that the Export Dialog does in fact rescale the imagery correctly.

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

suzannegunn2 — Mon, 28 May 2012 17:43:39 GMT

Here is the forumula to rescale your data.

rescaled grid = [(grid - min value from grid) * (max scale value - min scale value) / (max value from grid - min value from grid)] + min scale value

-Eric

Hi Eric,

How/where can I use this formula to "batch convert" hundreds of TIFFs?

Thanks!
Suzanne

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

EricRice — Tue, 05 Jun 2012 15:00:59 GMT

Suzanne,

You can use Python scripting and/or the Raster Calculator to perform map algebra. For multiband data you must do the math on each band then recomposite them back into a new multiband raster using the Composite Bands tool. If you can wait for 10.1 (tentatively shipping June 7th) you can just run the Copy Raster tool in a loop using the new option "Scale Pixel Values".

Best,
Eric

Re: Convert 16bit to 8bit Tifs (Hope to Batch)

EricRice — Tue, 05 Jun 2012 15:09:32 GMT

I have access to both ArcView and ArcInfo levels of 9.3, along with Spatial Analyst. We are in the process of getting ArcGIS 10, but it has not been rolled out by our IT department. I do have access to a machine with 10, but I can't heavily rely on it yet, so the new mosaic dataset isn't a solution quite yet.

Eric, I tested the formula you gave me, and it produces results that are almost idential to what the Export Dialog produces. The only differences are from rounding because the export dialog produced an 8bit unsigned integer tiff and therefore cannot contain decimals. That leads me to believe that the Export Dialog does in fact rescale the imagery correctly.

Stephanie,

Carrie and I have been doing some testing and in 10.0 and in 10.1 we are not getting results from Data Export that are the result of the formula. We did not test 9.3 though. If I can back up for one second to clear the 'screenshot' comment up - For single band data like an elevation layer, the Use Renderer option is essentially the 'screenshot' I mentioned. For multiband, the image is in 8 bit space for monitor display, which is why you get an 8 bit output when choosing that option- and no it is not a 'screenshot'. Very sorry for confusing that earlier.

I'm interested in knowing what bands are displayed at the time of export. What stretch is being used? What sensor did this data come from? Carrie and I have been testing WorldView2 data. If you haven't already exported your rasters manually, please see my comment above (to Suzanne) for how to do it in batch. Since you're on 9.3, Python is your route (See SOMA tool) since the raster calculator is not a geoprocessing tool in that version.

Best Regards,
Eric