problem with random rounding in feature class table

456
1
09-27-2011 09:02 AM
GregoryWhitaker
New Contributor II
Hello,

Has anyone experienced problems with a field that randomly rounds and pads numbers on only certain rows? Stranger still is that the rounding doesn't even seem to make sense. For instance, I entered "48.9" and instead of getting "48.900000", I got "48.900002". Also, some records don't get padded or rounded at all. when I entered 42.75, I got 42.75. Then in the row immediately following, I entered 43.05 and I got 43.0499999. I have set my field to Float with 6 decimal places which has worked for me before when entering this kind of data.

Is this a bug, or have I just overlooked something? Any help would be appreciated.

-Greg
Tags (2)
0 Kudos
1 Reply
MarkEllis
New Contributor II
This reflects the nature of the data. Can't recall the exact explanation, but using floating point numbers is what this shows.  Your solution to set the number of decimal points is the answer.  The values are accurate, but displayed based on the width of the field.
0 Kudos