topic Re: polygon to raster data type and pixel value issue in Data Management Questions https://community.esri.com/t5/data-management-questions/polygon-to-raster-data-type-and-pixel-value-issue/m-p/117254#M6689 <HTML><HEAD></HEAD><BODY><SPAN>Hi Luke....</SPAN><BR /><BR /><SPAN>I had come to the same conclusion, i.e. it doesnt really matter, but the article addresses why, so thanks for replying...I am enlightened!</SPAN><BR /><BR /><SPAN>Lucy.</SPAN></BODY></HTML> Sun, 22 May 2011 23:59:04 GMT LucyHardy 2011-05-22T23:59:04Z polygon to raster data type and pixel value issue https://community.esri.com/t5/data-management-questions/polygon-to-raster-data-type-and-pixel-value-issue/m-p/117252#M6687 <HTML><HEAD></HEAD><BODY><SPAN>I am trying to convert a polygon feature class (stored in file gdb) to a raster (using the polygon to raster conversion tool in ArcToolbox)�?�.the field in the polygon feature class which I am using to assign the pixel value has only 5 unique values (12, 0.2, 2.68, 0.6 and 0.16) �??the field data type is float, precision set to 3.</SPAN><BR /><BR /><SPAN>When I convert to raster the pixel values with decimal places convert from 3 digits to 10 digits and the value alters e.g. 2.68 becomes 2.680000067 �?? I need it to be exactly 2.68�?�. I know that the source feature class value is correct because if I change the field properties to display the value with 10 decimal places 2.68 become 2.6800000000.</SPAN><BR /><BR /><SPAN>I have tried various creative ways to end up with a floating point raster with the correct values (e.g. creating a field as integer type and multiplying the value by 100 to remove the decimal, creating&nbsp; raster with pixel values as integer and dividing it by a constant floating point raster with value 100.00) but always end up with the 2.680000067.</SPAN><BR /><BR /><SPAN>Any ideas?&nbsp; Thanks</SPAN><BR /><BR /><SPAN>Lucy.</SPAN></BODY></HTML> Fri, 13 May 2011 03:03:36 GMT https://community.esri.com/t5/data-management-questions/polygon-to-raster-data-type-and-pixel-value-issue/m-p/117252#M6687 LucyHardy 2011-05-13T03:03:36Z Re: polygon to raster data type and pixel value issue https://community.esri.com/t5/data-management-questions/polygon-to-raster-data-type-and-pixel-value-issue/m-p/117253#M6688 <HTML><HEAD></HEAD><BODY><SPAN>Have read of this: </SPAN><A href="http://docs.python.org/tutorial/floatingpoint.html">floating point issues</A><SPAN>. It's for python, but it's one of the best floating point representation articles I've come across.</SPAN><BR /><BR /><SPAN>Basically don't worry about it.</SPAN></BODY></HTML> Fri, 20 May 2011 03:07:22 GMT https://community.esri.com/t5/data-management-questions/polygon-to-raster-data-type-and-pixel-value-issue/m-p/117253#M6688 Luke_Pinner 2011-05-20T03:07:22Z Re: polygon to raster data type and pixel value issue https://community.esri.com/t5/data-management-questions/polygon-to-raster-data-type-and-pixel-value-issue/m-p/117254#M6689 <HTML><HEAD></HEAD><BODY><SPAN>Hi Luke....</SPAN><BR /><BR /><SPAN>I had come to the same conclusion, i.e. it doesnt really matter, but the article addresses why, so thanks for replying...I am enlightened!</SPAN><BR /><BR /><SPAN>Lucy.</SPAN></BODY></HTML> Sun, 22 May 2011 23:59:04 GMT https://community.esri.com/t5/data-management-questions/polygon-to-raster-data-type-and-pixel-value-issue/m-p/117254#M6689 LucyHardy 2011-05-22T23:59:04Z