topic Summary Statistics: Why do output tables have duplicate case field values? in Geoprocessing Questions

Summary Statistics: Why do output tables have duplicate case field values?

KeremGungor — Sun, 14 Jun 2015 23:13:00 GMT

Hello,

I am an ArcGIS 10.2.1 user. Recently, I used summary statistics tool to obtain mean values for each unique `water quality parameter` measured on different days at various monitoring stations. The input table is fairly large, it has approximately 2 million rows. I used the field that has the names of the `water quality parameters` as case field in order to obtain the mean for each unique parameter. When I checked the output table, I noticed that some parameters were duplicated. Having observed this unexpected result, I decided to use frequency tool to check whether a similar duplication would also occur with this tool or not. The frequency output table also included duplicate `water quality parameter` rows. I attach the screen capture of the first output table delivered by `summary statistics` tool to this post.

Re: Summary Statistics: Why do output tables have duplicate case field values?

DanPatterson_Retired — Sun, 12 Dec 2021 00:58:44 GMT

I am assuming you highligted those manually and the red boxes don't necessarily represent the full string contents.

So...have you checked for trailing space? The eyes are deceiving

For example...in Python

>>> a = "abcde "
>>> print a
abcde
>>>
>>> b = a.rstrip()
>>> print b
abcde

a and b differ in that 'a' has a trailing space and 'b' doesn't

see lstrip, strip and rstrip in the python literature...there are equivalents for VB

Re: Summary Statistics: Why do output tables have duplicate case field values?

DanPatterson_Retired — Sun, 14 Jun 2015 23:57:59 GMT

You should move this thread to Geoprocessing where it will get a broader audience

Re: Summary Statistics: Why do output tables have duplicate case field values?

OwenEarley — Tue, 16 Jun 2015 00:24:43 GMT

This can be a common issue with text fields. You could possibly get around it using a domain based field if the number of options is not excessive.

Re: Summary Statistics: Why do output tables have duplicate case field values?

KeremGungor — Tue, 16 Jun 2015 19:00:53 GMT

I used strip function in Calculate Field tool and duplication problem went away.