AnsweredAssumed Answered

Rounding with with raster calculator

Question asked by fallingdog on Nov 2, 2016
Latest reply on Nov 2, 2016 by Dan_Patterson

I would like to round some elevation values to the nearest 100th in my a set of rasters. 

 

I would like to walk through the numbers for one cell.

 

1) raster_0 * 100 + 0.5

179.519989 * 100 + 0.5 = 17952.498047

2) Int(raster)

Int(17952.498047) = 17952

3) Float(raster)

Float(17952) = 17952.000000

4) raster / 100

17952.000000 / 100 = 179.520004

 

What is up with the 4 in the millionths place?

 

Raster properties.

Outcomes