topic Re: Table scale and precision in Geoprocessing Questions

Table scale and precision

ayllaBAK — Tue, 09 Jun 2015 09:09:48 GMT

Hi,

I have a problem. I need to not have decimal places after number (field type is double). Whenever I work with data in ArcGIS 10.1 and later load that same data in any other program I've got 11 decimal places after round number. That creates a problem in other programs. I tried to save my data by converting with Feature class to feature class and manually correct the scale and precision to 0 but again when I upload data to old ArcView I have 11 decimal places. How can I restrict/limit my field data to 0 decimal places. I

Thank you for your help.

Re: Table scale and precision

JayantaPoddar — Tue, 09 Jun 2015 10:36:27 GMT

Hi Aylla,

You can add a new field (Datatype: LONG). Just write the fieldname in the Field Calculator within Int() function.

e.g. Field_Long = Int([Field_Double])

Re: Table scale and precision

NeilAyres — Tue, 09 Jun 2015 10:56:45 GMT

And, if you didn't want to simply truncate your double into an integer you could do this :

Field_Long = Int([Field_Double] + 0.5)

Re: Table scale and precision

SepheFox — Tue, 09 Jun 2015 15:36:45 GMT

It is not necessary to convert to integer when calculating the long type field equal to the double or float field. In fact, if you simply calculate it as Field_long = Field_double, the numbers will be rounded correctly..

Re: Table scale and precision

NeilAyres — Wed, 10 Jun 2015 07:36:47 GMT

Sephe,

spot on!