Weird Values after Raster calculator

2128
1
02-06-2013 12:45 AM
RobNaitachal
New Contributor
Hi,

I have two questions:

I have been provided with a raster representing a digitimal elevation model. The input raster is of integer type with elevation values given in cm. I used the 'Mosaic to new raster' tool to convert the raster into 32 bit float (is there an easier way to do that) and afterwards the raster calculator with a simple 'grid / 100' expression.

The problem is, that there are some weird values in the new raster data. For example the number 40553 has been recalculated to 405.529999. Is there any operation correct the values?
0 Kudos
1 Reply
DanPatterson_Retired
MVP Emeritus
It is a floating point precision if you don't need the decimals try casting an "int" or "round" around the expression