nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

How to setup BATCH process for my Script.

ChristopherClark1

Ok, I have the following python script which migrates and maps fields and the values of those fields into a target Feature Class.

# Import arcpy module import arcpy  arcpy.env.workspace = "G:\ChrisGIS\WDFW_NWIFC_EVENT_17100101.gdb" arcpy.env.overwriteOutput = "True"                def GetFieldMappings(inputFC, targetFC, dico):     field_mappings = arcpy.FieldMappings()     field_mappings.addTable(inputFC)      for input, output in dico.iteritems():         field_map = arcpy.FieldMap()         field_map.addInputField(inputFC, input)                 field = field_map.outputField                 field.name = output         field_map.outputField = field         field_mappings.addFieldMap(field_map)         del field, field_map      return field_mappings  #Variables inputFC = "WDFW_CHFA_2HEM_evt_1" targetFC = "WDFW_CHFA_2HEM_evt_olay_1"  dico = {'Permanent_Identifier': 'Permanent_ID',                 'STRM_NAME':        'LLID_STRM_NAME',     'DATE_SRVY': 'SOURCE_DATE',     'SPPCODE': 'SPECRCODE',     'SRC_AGENCY': 'SOURCE_AGENCY',     'SRC_WHO': 'SOURCE_WHO'}      Mapper = GetFieldMappings(inputFC, targetFC, dico) # Process: Append arcpy.Append_management(arcpy.env.workspace+"\\"+inputFC, arcpy.env.workspace+"\\"+targetFC,"NO_TEST",Mapper)

I have several feature classes to run this script on. AN exmaple of the Feature Classes that I need to run my script on are :

WDFW_CCT_2HEM_evt_olay
WDFW_CHFA_2HEM_evt_olay
WDFW_CHMF_2HEM_evt_olay
WDFW_CHSP_2HEM_evt_olay
WDFW_CHSU_2HEM_evt_olay
WDFW_COHO_2HEM_evt_olay
WDFW_DBT_2HEM_evt_olay
WDFW_KOK_2HEM_evt_olay
WDFW_RBT_2HEM_evt_olay
WDFW_SOCK_2HEM_evt_olay

These feature classes are represented in several geodatabases (see image)
[ATTACH=CONFIG]20670[/ATTACH]
I could simply go to each individual geodatabase and run the script for each featureclass in that geodatabase. This however seems redundant and I would like to figure out how to batch my scrip or automate this process. All geodatabases are located in one working directory.

I appreciate any help or advice!

HUC_8gdb.png

Najděte více příspěvků označených jako

Accepted answers

Anonymous User

I sent you a private message with my email info. I'll take a look at it.

All comments

MichalisAvraam

...
So, I could not solve this issue. I decided to remove that gdb from my workspace (temporarily) and try to run the script on what remained in the workspace. Well that failed as well with the resulting error :

Runtime error <class 'arcgisscripting.ExecuteError'>: ERROR 000278: Failed on input OID 1, could not write value â?? â?? to output field SOURCE_DATE Failed to execute (Append).

Did you ever figure out this error? I keep getting it too on a similar process running the Merge tool.

ChristopherClark1

Caleb, thanks for all the hardwork, time, and advice. It finally worked. Completely automated!

Very much appreciated!

Anonymous User

I sent you a private message with my email info. I'll take a look at it.

ChristopherClark1

I keep getting a few errors. I was able to resolve one of them but the other two are giving me a hard time. For some reason when I run the script it starts working in the first gdb. After it has successfully created a few "olay" tables it hangs up and gives me the error

Runtime error <type 'exceptions.RuntimeError'>: FieldMappings: Error in adding table to field mappings

For some reason a olay table is created (CHSU). The odd thing is this "CHSU" feature class does not exist in the gdb. Therefore when the script tries to add the original table into the field mappings object it crashes and delivers the above error.

So, I could not solve this issue. I decided to remove that gdb from my workspace (temporarily) and try to run the script on what remained in the workspace. Well that failed as well with the resulting error :

Runtime error <class 'arcgisscripting.ExecuteError'>: ERROR 000278: Failed on input OID 1, could not write value â?? â?? to output field SOURCE_DATE Failed to execute (Append).

Caleb, I could easily zip up 2 or 3 gdb if you wanted to recreate these errors. I am really stumped on the first one. the CHSU feature class does exist is some of the other gdb in my workspace. Is my listFCS = arcpy.ListTables("WDFW*evt") argument making a list for all the tables no matter what gdb they are in? If so this is the error. There are many times where the tables in one gdb are the same as another, but there are some tables (like the CHSU ones) that may only occur in 9 out of 10 gdb or 5 out of 20 etc.. In other words if this argument is the issue do I need to change it so it makes a list of tables for each gdb?

Anonymous User

Haha, I am a man indeed. I think I know why you got an error. We actually do need to include a test to exclude those tables that end in '_olay' because it will keep looping through the ws (as new tables are created) and create tables that end in '_olay_olay' etc. These tables will cause an error since they will not have the original field names in them when they get passed into the GetFieldMappings().

Also, we needed to have a dummy template just so that the append tool would work properly. When the field names don't match you have to use NO_TEST, as you already knew, but the fields will not be appended if they do not already exist in the table and the fields that are matched through the field map would not actually be inserted into the table. Essentially you would be appending the fields to a table with only an OID field which will not work.

This was a tricky one though. I had never worked with field mappings before. Here is the optimal solution:

# Import arcpy module
import arcpy, sys, traceback
arcpy.env.overwriteOutput = True
from os import path as p

def GetFieldMappings(fc_in, fc_out, dico):

    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(fc_in)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(fc_in, input)        
        field = field_map.outputField      
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings
  

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
        'STRM_NAME':'LLID_STRM_NAME',
 'DATE_SRVY': 'SOURCE_DATE',
 'SPPCODE': 'SPECRCODE',
 'SRC_AGENCY': 'SOURCE_AGENCY',
 'SRC_WHO': 'SOURCE_WHO'}


template = r'C:\gdblooptest\template\template.gdb\Template_table'
arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"

for ws in arcpy.ListWorkspaces("*", "FileGDB"):
    arcpy.env.workspace = ws
    listFCS = arcpy.ListTables()
    for inputFC in listFCS:
        if not inputFC.endswith('_olay'):
            targetFC = inputFC +"_olay"
            # Process: Append
            if arcpy.Exists(targetFC):
                arcpy.Delete_management(targetFC)
                print 'deleted %s' %targetFC
            arcpy.CreateTable_management(ws, targetFC, template)
            Mapper = GetFieldMappings(inputFC, targetFC, dico)
            arcpy.Append_management(inputFC,targetFC,'NO_TEST',Mapper)
            print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))
print 'done'

ChristopherClark1

Caleb, You are the Man (or woman?)!! Thanks! I ran it once real quick and got a new error which I know how to correct. One of the fields in my template table only has 50 characters max and some of the values in the original table under that same field are 100 characters, so I think I just have to change that and it will work. But, I have to go to dinner with some folks, bummer, I hate to wait!

But I will correct the field character value when i get home and run this.

Why did we have to have a template table??

Thanks for helping me this entire day. Our thread rules!

Anonymous User

Alright, I got it! I went back to the append instead of merge. I created a dummy table in a gdb in a different location than the original workspace with the new field names (the values in the 'dico' dictionary). I then used that as a template for the create table (for targetFC) and appended the inputFCs to the targetFCs.

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p

def GetFieldMappings(fc_in, fc_out, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(fc_in)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(fc_in, input)        
        field = field_map.outputField      # Missing underscore  
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
        'STRM_NAME':'LLID_STRM_NAME',
 'DATE_SRVY': 'SOURCE_DATE',
 'SPPCODE': 'SPECRCODE',
 'SRC_AGENCY': 'SOURCE_AGENCY',
 'SRC_WHO': 'SOURCE_WHO'}

template = r'C:\gdblooptest\template\template.gdb\Template_table'    
##arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
    arcpy.env.workspace = ws
    listFCS = arcpy.ListTables()
    for inputFC in listFCS:
        targetFC = inputFC +"_olay"
        # Process: Append
        arcpy.CreateTable_management(ws, targetFC, template)
        Mapper = GetFieldMappings(inputFC, targetFC, dico)
        arcpy.Append_management(inputFC,targetFC,'NO_TEST',Mapper)
        print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

Here is a shot of the template dummy table
[ATTACH=CONFIG]20675[/ATTACH]

Here is the original table ( I just added some random values)
[ATTACH=CONFIG]20676[/ATTACH]

And here is the targetFC table after appended:
[ATTACH=CONFIG]20677[/ATTACH]

tab2.png

tab1.png

temp.png

ChristopherClark1

Thanks Caleb for the loads of help. If you want, I can send you a zip file with a sample of my data. I wonder why I am getting a create table error and you are not. I will work more with it. The field mapping object is pretty awesome and useful once it is figured out. It was pretty complex for me.

Here are some links that helped me out :

http://forums.arcgis.com/threads/33060-field-mapping-in-python-for-ArcGIS-10

http://blogs.esri.com/esri/arcgis/2012/08/30/field-mapping-and-python-scripting/

send me a message if you want me to email me some of my data.

Thanks again!

Anonymous User

I have made some dummy gdb's with your table names and the input fields from the dico. I am able to get it to go through all the tables and merge, but there is a problem with your GetFieldMappings() function since the field names aren't changing in the targetFCs. I am trying to figure it out, I have never worked with field mappings objects before. I'll post the full code if I can figure it out.

ChristopherClark1

I think I have it correct now, but when I execute the code

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, targetFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
 listFCS = arcpy.ListTables("WDFW*evt")
 arcpy.env.workspace = ws
 for inputFC in listFCS:
  outTab = r'in_memory\%s_2' %inputFC
  targetFC = inputFC +"_olay"   
  Mapper = GetFieldMappings(inputFC, targetFC, dico)
  # Process: Append
  arcpy.CreateTable_management(ws, outTab)
  arcpy.Merge_management([p.join(ws,inputFC),outTab],p.join(ws,targetFC),Mapper)
  print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

I get this error

Runtime error <class 'arcgisscripting.ExecuteError'>: ERROR 999999: Error executing function. Failed to execute (CreateTable).

ChristopherClark1

Wait, I figured out that error also....my bad. Starting to get sloppy and not have the 'sharp eyes'

ChristopherClark1

I had missed that variable. Once I add it I get another error :

Runtime error <class 'arcgisscripting.ExecuteError'>: Failed to execute. Parameters are not valid. ERROR 000732: Input Datasets: Dataset G:\ChrisGIS\COMBO_fishdist_events\WDFW_NWIFC_EVENT_17100102.gdb\WDFW_CCT_2HEM_evt;in_memory\WDFW_CCT_2HEM_evt_2 does not exist or is not supported Failed to execute (Merge).

I am starting to get pretty lost 🙂

Anonymous User

Runtime error 'outTab' not defined.

arcpy.Merge_management([p.join(ws,inputFC), outTab],p.join(ws,targetFC),Mapper)

I tried to change it to outTable, and got the same error.

arcpy.Merge_management([p.join(ws,inputFC), outTable],p.join(ws,targetFC),Mapper)

I also removed outTab all together but then I get this error

Runtime error <class 'arcgisscripting.ExecuteError'>: ERROR 000605: Output WDFW_CCT_2HEM_evt_olay already exists within G:\ChrisGIS\COMBO_fishdist_events\WDFW_NWIFC_EVENT_17100102.gdb. Failed to execute (Merge).

did you set up this variable in the 'in_memory' workspace?

outTab = r'in_memory\%s_2' %inputFC

ChristopherClark1

Runtime error 'outTab' not defined.

arcpy.Merge_management([p.join(ws,inputFC),outTab],p.join(ws,targetFC),Mapper)

I tried to change it to outTable, and got the same error.

arcpy.Merge_management([p.join(ws,inputFC),outTable],p.join(ws,targetFC),Mapper)

I also removed outTab all together but then I get this error

Runtime error <class 'arcgisscripting.ExecuteError'>: ERROR 000605: Output WDFW_CCT_2HEM_evt_olay already exists within G:\ChrisGIS\COMBO_fishdist_events\WDFW_NWIFC_EVENT_17100102.gdb. Failed to execute (Merge).

Anonymous User

Maybe it would be better to use Merge instead, it also supports field mappings. I also removed the targetFC parameter from the GetFieldMappings() function. Try this:

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
    arcpy.env.workspace = ws
    listFCS = arcpy.ListTables("WDFW*evt")
    for inputFC in listFCS:
        outTab = r'in_memory\%s_2' %inputFC
        targetFC = inputFC +"_olay"   
        # Process: Append
        Mapper = GetFieldMappings(inputFC, dico)
        arcpy.CreateTable_management(ws, outTab))
        arcpy.Merge_management([p.join(ws,inputFC),outTab],p.join(ws,targetFC),Mapper)
        print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

ChristopherClark1

The olay tables that get created only have Object ID field. Nothing else is copying over. Now I am really confused... seems as if the append is not really appending???

Anonymous User

Okay, I added the create table and here are some results

Appended "WDFW_CCT_2HEM_evt" to "WDFW_CCT_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Appended "WDFW_CHFA_2HEM_evt" to "WDFW_CHFA_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Appended "WDFW_CHMF_2HEM_evt" to "WDFW_CHMF_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Appended "WDFW_CHSP_2HEM_evt" to "WDFW_CHSP_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Runtime error <type 'exceptions.RuntimeError'>: FieldMappings: Error in adding table to field mappings

How can this error come to pass after a few tables have already been appended?
After I got these results I went into ArcCatalog and check the geodatabase it was working in and there were no _olay tables. I am assuming this is because the script hit the error before it finished?

Hmmm...I am not sure, that is a good question! It looks like the code is correct now since it worked on several tables before crashing. Do the other olay tables look okay? Maybe on the table where it crashed on does not have all the same fields in your 'dico' variable? Do you know which table it crashed on? If so, I would look at that table and see if there are differences between that one and the others.

If this is not the case perhaps my only other idea is maybe a schema lock?

ChristopherClark1

Okay, I added the create table and here are some results

Appended "WDFW_CCT_2HEM_evt" to "WDFW_CCT_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Appended "WDFW_CHFA_2HEM_evt" to "WDFW_CHFA_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Appended "WDFW_CHMF_2HEM_evt" to "WDFW_CHMF_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Appended "WDFW_CHSP_2HEM_evt" to "WDFW_CHSP_2HEM_evt_olay" in WDFW_NWIFC_EVENT_17100102.gdb
Runtime error <type 'exceptions.RuntimeError'>: FieldMappings: Error in adding table to field mappings

How can this error come to pass after a few tables have already been appended?
After I got these results I went into ArcCatalog and check the geodatabase it was working in and there were no _olay tables. I am assuming this is because the script hit the error before it finished?

Anonymous User

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, targetFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
 listFCS = arcpy.ListTables("WDFW*evt")
 arcpy.env.workspace = ws
 for inputFC in listFCS:
  targetFC = inputFC +"_olay"   
  Mapper = GetFieldMappings(inputFC, targetFC, dico)
  # Process: Append
  arcpy.Append_management(p.join(ws,inputFC), p.join(ws,targetFC),"NO_TEST",Mapper)
  print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))
After running this script I am again getting this error :

Runtime error <class 'arcgisscripting.ExecuteError'>: Failed to execute. Parameters are not valid. ERROR 000732: Target Dataset: Dataset G:\ChrisGIS\COMBO_fishdist_events\WDFW_NWIFC_EVENT_17100102.gdb\WDFW_CCT_2HEM_evt_olay does not exist or is not supported Failed to execute (Append).

I feel like I am close, but I do not understand why WDFW_NWIFC_EVENT_17100102.gdb\WDFW_CCT_2HEM_evt_olay cannot be found when it is supposed to be created. This is also the 2nd geodatabase in my list, so it seems like it goes through WDFW_NWIFC_EVENT_17100101 without generating any errors.....

Look at my last post about creating the table before appending.

ChristopherClark1

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, targetFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
 listFCS = arcpy.ListTables("WDFW*evt")
 arcpy.env.workspace = ws
 for inputFC in listFCS:
  targetFC = inputFC +"_olay"   
  Mapper = GetFieldMappings(inputFC, targetFC, dico)
  # Process: Append
  arcpy.Append_management(p.join(ws,inputFC), p.join(ws,targetFC),"NO_TEST",Mapper)
  print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

After running this script I am again getting this error :

Runtime error <class 'arcgisscripting.ExecuteError'>: Failed to execute. Parameters are not valid. ERROR 000732: Target Dataset: Dataset G:\ChrisGIS\COMBO_fishdist_events\WDFW_NWIFC_EVENT_17100102.gdb\WDFW_CCT_2HEM_evt_olay does not exist or is not supported Failed to execute (Append).

I feel like I am close, but I do not understand why WDFW_NWIFC_EVENT_17100102.gdb\WDFW_CCT_2HEM_evt_olay cannot be found when it is supposed to be created. This is also the 2nd geodatabase in my list, so it seems like it goes through WDFW_NWIFC_EVENT_17100101 without generating any errors.....

Anonymous User

Actually, I just realized... If the olay tables do not exist beforehand you will get an error because append works on only existing features. You should use the CreateTable_management tool to create the table first right above the append.

Try this:

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, targetFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
    arcpy.env.workspace = ws
    listFCS = arcpy.ListTables("WDFW*evt")
    for inputFC in listFCS:
        targetFC = inputFC +"_olay"   
        Mapper = GetFieldMappings(inputFC, targetFC, dico)
        # Process: Append
        arcpy.CreateTable_management(ws, targetFC))
        arcpy.Append_management(p.join(ws,inputFC), p.join(ws,targetFC),"NO_TEST",Mapper)
        print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

Anonymous User

Thanks for the quick replies Caleb. When I try to run the last script you provided I keep getting a syntax error on line 34 which reads

if inputFC[-5:] != "_olay"

what is the error?

Do I have to exclude the olay files? I do not have any olays in my geodatabases to start, after running the script there will be tables name ***_olay. I thought when I make my FeatureClass.list tables the append will only be run on the values found in that list. If this is the case there are no _olay tables, as they are only created when I run my script. It may seen confusing from the earlier posts b/c I cleaned out all the tables name **_olay.

No, sorry, that was a mistake by me. I saw that and realized it wasn't necessary and took it out. Your code *should* work once you put the last 3 lines inside the for loop so the code ends like this:

    for inputFC in listFCS:
        targetFC = inputFC +"_olay"   
        Mapper = GetFieldMappings(inputFC, targetFC, dico)
        # Process: Append
        arcpy.Append_management(p.join(ws,inputFC), p.join(ws,targetFC),"NO_TEST",Mapper)
        print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

ChristopherClark1

Thanks for the quick replies Caleb. When I try to run the last script you provided I keep getting a syntax error on line 34 which reads

if inputFC[-5:] != "_olay"

what is the error?

Do I have to exclude the olay files? I do not have any olays in my geodatabases to start, after running the script there will be tables name ***_olay. I thought when I make my FeatureClass.list tables the append will only be run on the values found in that list. If this is the case there are no _olay tables, as they are only created when I run my script. It may seen confusing from the earlier posts b/c I cleaned out all the tables name **_olay.

Anonymous User

"Runtime error <class 'arcgisscripting.ExecuteError'>: Failed to execute. Parameters are not valid. ERROR 000732: Target Dataset: Dataset G:\ChrisGIS\COMBO_fishdist_events\WDFW_NWIFC_EVENT_17100101.gdb\WDFW_CCT_2HEM_evt_olay does not exist or is not supported Failed to execute (Append)."

I think you were almost there. The indentation for the append needed to be in line with the for loop (otherwise it would not create an input and target fc since it was outside the loop where the tables are listed).

So the input will look like this?
WDFW_CCT_2HEM_evt

and the output will look like this?
WDFW_CCT_2HEM_evt_olay

If those are the correct names, this code should work with the corrected indentation.

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, targetFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
    arcpy.env.workspace = ws
    listFCS = arcpy.ListTables("WDFW*evt")
    for inputFC in listFCS:
        targetFC = inputFC +"_olay"   
        Mapper = GetFieldMappings(inputFC, targetFC, dico)
        # Process: Append
        arcpy.Append_management(p.join(ws,inputFC), p.join(ws,targetFC),"NO_TEST",Mapper)
        print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

ChristopherClark1

Thanks for the help Caleb! I cleaned up my gedodatabases, and modified the your script to reflect my changes. Now, in a given GeoDatabase I have File geodatabase tables such as :

WDFW_CCT_2HEM_evt
WDFW_CHFA_2HEM_evt
WDFW_CHMF_2HEM_evt
WDFW_COHO_2HEM_evt
WDFW_KOK_2HEM_evt

These are going to be the InputFC for my field mapping and append processes. Here is the code I am trying to run. I get this error every time and do not understand why. ERROR :

"Runtime error <class 'arcgisscripting.ExecuteError'>: Failed to execute. Parameters are not valid. ERROR 000732: Target Dataset: Dataset G:\ChrisGIS\COMBO_fishdist_events\WDFW_NWIFC_EVENT_17100101.gdb\WDFW_CCT_2HEM_evt_olay does not exist or is not supported Failed to execute (Append)."

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, targetFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS\COMBO_fishdist_events"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
 listFCS = arcpy.ListTables("WDFW*evt")
 arcpy.env.workspace = ws
 for inputFC in listFCS:
  targetFC = inputFC +"_olay"   
  Mapper = GetFieldMappings(inputFC, targetFC, dico)
 # Process: Append
 arcpy.Append_management(p.join(ws,inputFC), p.join(ws,targetFC),"NO_TEST",Mapper)
 print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

Any ideas?

Anonymous User

WDFW_CHFA_2HEM_evt_1-------WDFW_CHFA_2HEM_evt_olay_1
WDFW_CCT_2HEM_evt_1--------WDFW_CCT_2HEM_evt_olay_1
WDFW_CHMF_2HEM_evt_1-------WDFW_CHMF_2HEM_evt_olay_1
WDFW_CHSP_2HEM_evt_1-------WDFW_CHSP_2HEM_evt_olay_1
WDFW_COHO_2HEM_evt_1-------WDFW_COHO_2HEM_evt_olay_1
WDFW_KOK_2HEM_evt_1---------WDFW_KOK_2HEM_evt_olay_1

The long way would be to change my workspace each time to the correct GDB then run my script for each InputFC. The list above for example would have me run the script 6 times. Each time I would edit the variables : inputFC and targetFC.

Trying to automate this is proving a nightmare!

If these really are the field names for FCs in each GDB, it can be easy to set the input and targets. Programming the inputs and outputs is a lot easier than you think if the same names exist in each GDB. Try this:

# Import arcpy module
import arcpy
arcpy.env.overwriteOutput = True
from os import path as p
        
def GetFieldMappings(inputFC, targetFC, dico):
    field_mappings = arcpy.FieldMappings()
    field_mappings.addTable(inputFC)

    for input, output in dico.iteritems():
        field_map = arcpy.FieldMap()
        field_map.addInputField(inputFC, input)        
        field = field_map.outputField        
        field.name = output
        field_map.outputField = field
        field_mappings.addFieldMap(field_map)
        del field, field_map

    return field_mappings

#Variables
dico = {'Permanent_Identifier': 'Permanent_ID',
                'STRM_NAME':        'LLID_STRM_NAME',
    'DATE_SRVY': 'SOURCE_DATE',
    'SPPCODE': 'SPECRCODE',
    'SRC_AGENCY': 'SOURCE_AGENCY',
    'SRC_WHO': 'SOURCE_WHO'}

arcpy.env.workspace = r"G:\ChrisGIS"
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
    arcpy.env.workspace = ws
    for fc in arcpy.ListFeatureClasses():
        if fc[-6:] != 'olay_1':
            inputFC = fc
            targetFC = fc[:-1] + 'olay_1'   
            Mapper = GetFieldMappings(inputFC, targetFC, dico)
            # Process: Append
            arcpy.Append_management(p.join(ws,inputFC), p.join(ws,targetFC),"NO_TEST",Mapper)
            print 'Appended "{0}" to "{1}" in {2}'.format(inputFC, targetFC, p.basename(ws))

EDIT: I added the part in red. I forgot to add this when I originally posted the code. This is to exclude the target features when looping through each GDB (since you only need the ones that end in 'evt_1' as inputFC's).

ChristopherClark1

I messed around with Calebs suggestion and could not get it to work properly.

Notice in my script I have a input FC and a Target FC. In every GDB there will be several paired Input and target FC (1 pair for each species). For example here is a list of FCs found in one gdb. Every inputFC and its targetFC for my script in this gdb would be :

InputFC: ---------------------------TargetFC:

WDFW_CHFA_2HEM_evt_1-------WDFW_CHFA_2HEM_evt_olay_1
WDFW_CCT_2HEM_evt_1--------WDFW_CCT_2HEM_evt_olay_1
WDFW_CHMF_2HEM_evt_1-------WDFW_CHMF_2HEM_evt_olay_1
WDFW_CHSP_2HEM_evt_1-------WDFW_CHSP_2HEM_evt_olay_1
WDFW_COHO_2HEM_evt_1-------WDFW_COHO_2HEM_evt_olay_1
WDFW_KOK_2HEM_evt_1---------WDFW_KOK_2HEM_evt_olay_1

The long way would be to change my workspace each time to the correct GDB then run my script for each InputFC. The list above for example would have me run the script 6 times. Each time I would edit the variables : inputFC and targetFC.

Trying to automate this is proving a nightmare!

ChristopherClark1

Will try this evening. Thanks Caleb!

Anonymous User

Yes, you can use the ListWorkspaces().

http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#//000v0000001w000000

arcpy.env.workspace = r'some\path'
for ws in arcpy.ListWorkspaces("*", "FileGDB"):
    arcpy.env.workspace = ws
    for fc in arcpy.ListFeatureClasses('WDFW*'):
         # paste your code here
         # do stuff

Připojte se k diskusi

Přihlášení členové mohou přispívat, sledovat aktualizace a další. Jste tu noví? Zaregistrujte si bezplatný účet.

Rychlé odkazy

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.