topic Re: Is there a token for everything EXCEPT SHAPE@ in Python Questions

Is there a token for everything EXCEPT SHAPE@

StormwaterWater_Resources — Mon, 17 Jun 2013 14:06:25 GMT

This has to be a common task: using cursors, copy all the non-shape related data from one feature to another feature in a different FC (possibly with a different geometry type).

For example, I can use CreateFeatureclass_management to create a point FC from a line FC with all of the same attribute fields except the shape. I'd like to use cursors to copy the data, but I can't do a straight copy if the geometry is different between FCs. I'd like to use the .firstpoint and .lastpoint methods to copy the shape, but then do a straight copy of all the other fields. Do I have to go through all the effort of using Describe to find the shape field name, and then loop over all the fields except shape, or is there a token for: AllFieldsExceptShape@ ? Perhaps a better more general question is: is the list of tokens in the arcpy.da web pages complete, or are there other tokens out there?

(the point of this is to create my own version of "Feature Vertices To Points", so using that tool can't be a part of the answer to this question).

Re: Is there a token for everything EXCEPT SHAPE@

MathewCoyle — Mon, 17 Jun 2013 14:23:56 GMT

Why not just create a table view?

Edit: Even with this method you should remove the shape field explicitly. You can remove by geometry type field instead of name if that is easier for you.

Re: Is there a token for everything EXCEPT SHAPE@

Anonymous User — Sat, 11 Dec 2021 11:03:28 GMT

You can get all the fields except for the Shape and other geometry pretty easily:

types = ['OID','Geometry']
other_geom = ['shape_area','shape_length']

field_list = [f.name for f in arcpy.ListFields(in_fc)
              if f.type not in types
              and f.name.lower() not in other_geom]

Since you cannot update/insert OID's (these are automatically populated) you have to exclude this as well for an insert cursor. You also would not need to include the shape length/area either since these are also automatically calculated (in geodatabse feature classes, not shapefiles).

Re: Is there a token for everything EXCEPT SHAPE@

StormwaterWater_Resources — Mon, 17 Jun 2013 15:08:43 GMT

You can get all the fields except for the Shape and other geometry pretty easily:

[... see below]

Thank you Caleb, that's easier than I was thinking it would be. I had originally thought I would end up looking through field names, but I didn't think about checking for the type as well. That helps, and it bypasses the Describe I thought I'd have to use.

Re: Is there a token for everything EXCEPT SHAPE@

Anonymous User — Mon, 17 Jun 2013 15:26:19 GMT

"are there other tokens besides what's listed on the help pages?" and/or "is there a EVERYTHINGBUTSHAPE@ token?".

Unfortunately, there is no everything but shape token. That is the complete list of tokens listed on the Search Cursor page. However, The 'SHAPE@' token allows you to access all the geometry options shown [url=http://resources.arcgis.com/en/help/main/10.1/index.html#//018z00000070000000]here[/url]

I did recently write a function for a field list comprehension. By default it will list all the fields except for the OID and Shape fields since these are usually the ones you wouldn't need. I also have it set up to get the field objects OR just the field names plus a handful of other options. Here is the code for this if you are interested; I have found it very useful.

def GetFieldList(in_fc, list_all=False, plus_oid=False, return_shape=False, other_geom=False, return_object=False, exclude_fields=[]):     type_list = ['OID','Geometry']     Exclude = ['shape_area','shape_length']     if list_all:         other_geom=True         plus_oid=True         return_shape=True     if plus_oid:         type_list.remove('OID')     if return_shape:         type_list.remove('Geometry')     if other_geom:         Exclude = []     if len(exclude_fields) > 0:         for ex_f in exclude_fields:             Exclude.append(ex_f.lower())                  # return either field names or field objects       if return_object:         field_list = [f for f in arcpy.ListFields(in_fc)                       if f.type not in type_list                       and f.name.lower() not in Exclude]     else:         field_list = [f.name for f in arcpy.ListFields(in_fc)                       if f.type not in type_list                       and f.name.lower() not in Exclude]     return field_list

By default, it will list all fields except OID and the Shape if you just use the "in_fc" parameter like this:

in_fc = r'path\to_your\featureClass'  fields = GetFieldList(in_fc)

And, to answer your original question for everything except shape, you could use the above function like this:

in_fc = r'path\to_your\featureClass'  # Get all but shape fields = GetFieldList(in_fc, plus_oid=True, other_geom=True)

EDIT: Never mind on the change I made, I confused myself and was wrong.

Re: Is there a token for everything EXCEPT SHAPE@

StormwaterWater_Resources — Mon, 17 Jun 2013 15:29:40 GMT

Why not just create a table view?

I've used table views in Model Builder, but I've never used them in arcpy. I'm not sure if I'm understanding how, or why actually, I'd use a table view in this case. When I've used table views in MB I've used them to get a handle on a table currently open in my ArcMap session. If I already have a search cursor open in my Python script why would I use table view. Can you elaborate on your example?

Re: Is there a token for everything EXCEPT SHAPE@

StormwaterWater_Resources — Mon, 17 Jun 2013 15:51:58 GMT

Thank you Caleb. That is indeed a useful and simple (in a good way) function. Furthermore it solves the root problem of my original thread: "Does CreateFeatureclass_management preserve field order?" (http://forums.arcgis.com/threads/86784-Does-CreateFeatureclass_management-preserve-field-order). Because I can use a list of named fields which can include all fields, I don't have to worry about the order (for which I was uncertain that the "*" in the cursors would preserve).

Re: Is there a token for everything EXCEPT SHAPE@

Anonymous User — Sat, 11 Dec 2021 11:03:31 GMT

Why are you calling, what seems to be an exclusion list, "Keep"?

I added an exclude part so you can pass in a list of fields you want to exclude (that are not an OID, shape, or shape_length/area). So for example:


    test = r'C:\TEMP\test2.gdb\roads'
    exclude = ['NAME1', 'TYPE1', 'Label1',' Display']

    # Test plus OID and exclude fields and return as objects    
    for field in GetFieldList(test,plus_oid=True,return_object=True,exclude_fields=exclude):
        print field.name, field.type, field.length

EDIT: I wanted to add a better explanation here...So by default the function will list all fields not found in the field_type list or in the original Exclude list which is by default, the shape_length and shape_area if applicable. So when you add a list to the exclude_list parameter, it will append each field name you add to that (not case sensitive since it is all converted to lower()) to the original Exclude list. If the other_geom parameter is set to True, it will clear the "keep" list so it will list the shape_area/shape_length fields and fields to be excluded could still be added to the list if the user chooses.

At this point, I was just adding all the options I could think of that I would want to use, may be a little bit of an overkill but there are times that I do not want the OID's, shape field, other geometry, and just one or two regular fields from a table which is why I added that part.

Re: Is there a token for everything EXCEPT SHAPE@

ChrisSnyder — Sat, 11 Dec 2021 11:03:33 GMT

is there a token for: AllFieldsExceptShape@?

Maybe I didn't follow everything written above, but I have always used "*" to denote all the fields (except for SHAPE). So for example, if I want all the field AND SHAPE:

>>> searchRow = arcpy.da.SearchCursor(myFC, ["SHAPE@","*"]).next()
>>> searchRow
(<Polygon object at 0x2b713f0[0x2b68e80]>, 1, (1216836.715736469, 112885.83942983788), None, 5723.961799418091, 395403.18030676956, 1)

but if I just want the non-geometry fields:

>>> searchRow = arcpy.da.SearchCursor(myFC, ["*"]).next()
>>> searchRow
(1, (1216836.715736469, 112885.83942983788), None, 5723.961799418091, 395403.18030676956, 1)

Note that "*" will always return the centroid x,y coordinate pair... that's the (1216836.715736469, 112885.83942983788) part... but just not the entire geometry object.

Re: Is there a token for everything EXCEPT SHAPE@

Anonymous User — Sat, 11 Dec 2021 11:03:36 GMT

Maybe I didn't follow everything written above, but I have always used "*" to denote all the fields (except for SHAPE). So for example, if I want all the field AND SHAPE:
>>> searchRow = arcpy.da.SearchCursor(myFC, ["SHAPE@","*"]).next()
>>> searchRow
(<Polygon object at 0x2b713f0[0x2b68e80]>, 1, (1216836.715736469, 112885.83942983788), None, 5723.961799418091, 395403.18030676956, 1)
but if I just want the non-geometry fields:
>>> searchRow = arcpy.da.SearchCursor(myFC, ["*"]).next()
>>> searchRow
(1, (1216836.715736469, 112885.83942983788), None, 5723.961799418091, 395403.18030676956, 1)
Note that "*" will always return the centroid x,y coordinate pair... that's the (1216836.715736469, 112885.83942983788) part... but just not the entire geometry object.

Wow, I did not know that using ['*'] would return all but shape...I must have missed that in the documentation. Thanks for pointing that out Chris!

Re: Is there a token for everything EXCEPT SHAPE@

StormwaterWater_Resources — Sat, 11 Dec 2021 11:03:38 GMT

The project that prompted this thread (as well as: Does CreateFeatureclass_management preserve field order) was to rewrite Esri's FeatureVerticesToPoints so that I didn't need an Advanced license to use that one tool. I figured I'd go ahead and post that here. I'd love to hear critiques, I know there are better ways of doing things.

I'm posting two scripts. The first is my version of FeatureVerticesToPoints, and the second is a slightly modified version of Caleb1987's GetFieldList which I found very useful (and I expect to use it in the future as well). Many thanks to Caleb1987 and mzcoyle for comments on this and the other thread.

One final point before the code. I'm excluding fields *named* GlobalID, because the field.type value from ListFields for guid is broken. It lists as "SmallInteger" which it is most certainly not.

import arcpy, sys, os
from MyModules import GetFieldList

inFC      = arcpy.GetParameterAsText(0)     # Input  Feature Class  (feature)
PtFC      = arcpy.GetParameterAsText(1)     # Output Feature Class  (point)
pLocation = arcpy.GetParameterAsText(2)     # Which end?  [ start | end ]
##overwrite = arcpy.GetParameterAsText(3)     # Boolean to control the overwrite of the output (not part of Esri's version)

# WARNING!   Existing feature class is automatically overwritten
if arcpy.Exists(PtFC):
    arcpy.Delete_management(PtFC)

PtFCpath   = os.path.dirname(  PtFC )
PtFCname   = os.path.basename( PtFC )

arcpy.CreateFeatureclass_management( PtFCpath, PtFCname, "POINT", inFC, "DISABLED", "DISABLED", inFC )

# ASSERT:  The following two returns from GetFieldList should be identical
insertFields = GetFieldList(PtFC)
searchFields = GetFieldList(inFC)

insertFields.insert(0,"SHAPE@XY")    # new points will get an XY tuple, not a geometry object
searchFields.insert(0,"SHAPE@")      # get the geometry *object* to get properties of it
cShape = 0

newPoints = arcpy.da.InsertCursor(PtFC, insertFields)

if ( pLocation == "START" ):

    srcFeatures = arcpy.da.SearchCursor(inFC, searchFields)
    for feature in srcFeatures:
        point = feature[cShape].firstPoint
        xy    = (point.X, point.Y)
        newPoints.insertRow( (xy,) + feature[1:] )
    
elif ( pLocation == "END"   ):

    srcFeatures = arcpy.da.SearchCursor(inFC, searchFields)
    for feature in srcFeatures:
        point = feature[cShape].lastPoint
        xy    = (point.X, point.Y)
        newPoints.insertRow( (xy,) + feature[1:] )

##elif ( pLocation == ""   ):      # Other options can be included here to more completely mimic the Esri tool
else:
    arcpy.AddMessage("Unknown point location entered.  Please enter START or END.    Aborting!")
    sys.exit(1)

del newPoints
arcpy.RefreshActiveView()

Slightly modified version of Caleb1987's GetFieldList:

import arcpy

def GetFieldList(in_fc, list_all=False, return_oid=False, return_shape=False, return_other_geom=False, return_object=False, exclude_fields=[]):
    Exclude_Types = ['Blob','Geometry','Guid','OID','Raster']
    Exclude       = ['shape_area','shape_length','globalid','shape.len']
    if list_all:
        return_other_geom=True
        return_oid=True
        return_shape=True
    if return_oid:
        Exclude_Types.remove('OID')
    if return_shape:
        Exclude_Types.remove('Geometry')
    if return_other_geom:
        Exclude = []
    if len(exclude_fields) > 0:
        for ex_f in exclude_fields:
            Exclude.append(ex_f.lower())
            
    # return either field names or field objects  
    if return_object:
        field_list = [f for f in arcpy.ListFields(in_fc)
                      if f.type not in Exclude_Types
                      and f.name.lower() not in Exclude]
    else:
        field_list = [f.name for f in arcpy.ListFields(in_fc)
                      if f.type not in Exclude_Types
                      and f.name.lower() not in Exclude]
    return field_list

Re: Is there a token for everything EXCEPT SHAPE@

KenCarrier — Sat, 11 Dec 2021 11:03:41 GMT

This might be a little easier to read and or manage for limiting the return of certain field types and names.

import arcpy, os, sys
    
def Main():
    src = "" #Enter path to data here
    for field in fieldS:
        if field.type == 'Geometry' or field.type == 'OID' or 'shape' in str(field.name).lower():
            pass
        else:
            print field.name
          
if __name__=="__main__":
    Main()

This might fall more in line with what you were originally trying to do

import arcpy, os, sys
    
def Main():
    src = "" # Insert Path to data here
    excludeList = ['Geometry','OID','Raster','Guid','Blob']
    fieldS = arcpy.ListFields(src)
    field_list = []
    for field in fieldS:
        if any(field.type in s for s in excludeList) or 'shape' in str(field.name).lower():
            pass
        else:
            field_list.append(field.name)
    print field_list
    return field_list
          
if __name__=="__main__":
    Main()