topic Re: Batch Processing in Model Builder - Delete rows then Append in Geoprocessing Questions

Batch Processing in Model Builder - Delete rows then Append

SanhitaChatterjee1 — Thu, 25 Feb 2016 23:21:38 GMT

I am trying to delete rows from multiple feature classes with prefix TCEMaster_* (such as TCEMaster_Centerline, TCEMaster_Fence etc.) in TCEMaster.SDE ----then append the feature classes with data from another sde. Names of the feature classes in Input dataset is without the prefix (such as Centerline, Fence etc.).

My ultimate goal is to run a script/batch file routinely.

Should I use modelbuilder with Iterator and then export to python or a script in python. I am not much of an expert in python. See attached what I got started in modelbuilder. I have also attached a screenshot of the databases exported to FGDB for testing purposes. Target dataset is TCEMaster in test_TCE.gdb and input dataset is R0007199 in test.gdb.

Any help will be highly appreciated.

Re: Batch Processing in Model Builder - Delete rows then Append

MichaelVolz — Thu, 25 Feb 2016 23:50:55 GMT

Start with model builder for 1 feature class and then export out to python. Python has some great tools for iterating.

Re: Batch Processing in Model Builder - Delete rows then Append

SanhitaChatterjee1 — Mon, 29 Feb 2016 19:46:23 GMT

Can you please tell me what parameter is missing here in the python iterator?

Input dataset is Temp_test.gdb\\R0007199

Target dataset is test_TCE.gdb\TCEMaster

Target dataset has a wildcard TCEMaster_*

Both datasets have same schema- only difference is the wildcard in target dataset.

# Import arcpy module

import arcpy

arcpy.env.workspace = "C:\Users\sc\Desktop\test\test_TCE.gdb\TCEMaster"

fcs = arcpy.ListFeatureClasses("TCEMaster_*")

Inputdataset = "C:\\Users\\sc\\Desktop\\test\\Temp_test.gdb\\R0007199"

Targetdataset = "C:\Users\sc\Desktop\test\test_TCE.gdb\TCEMaster"

# Process: Append

for fc in Inputdataset:

arcpy.Append_management(fc, fcs, "TEST", "", "")

Re: Batch Processing in Model Builder - Delete rows then Append

MichaelVolz — Mon, 29 Feb 2016 19:52:41 GMT

Do you want to process all feature classes in a file geodatabase?

Or are you trying to process all feature classes in a specific feature dataset in a file geodatabase?

Re: Batch Processing in Model Builder - Delete rows then Append

SanhitaChatterjee1 — Mon, 29 Feb 2016 19:57:05 GMT

Specific feature dataset "TCEMaster" and all FCs in this feature dataset

Re: Batch Processing in Model Builder - Delete rows then Append

MichaelVolz — Mon, 29 Feb 2016 20:33:08 GMT

# Process: Append

for fc in Inputdataset:

arcpy.Append_management(fc, fcs, "TEST", "", "")

Instead of for fc in Inputdataset:

for fc in arcpy.ListFeatureClasses('*','All',Inputdataset):

Re: Batch Processing in Model Builder - Delete rows then Append

BlakeTerhune — Mon, 29 Feb 2016 20:54:42 GMT

Are those TCE feature classes versioned? If not, using truncate is faster than delete rows.

Also, if you want to run this as a scheduled job, you'll need to use Python.

Re: Batch Processing in Model Builder - Delete rows then Append

SanhitaChatterjee1 — Mon, 29 Feb 2016 20:56:11 GMT

Thanks Michael.

It works if I do not have a wildcard set (such as without "TCEMaster_*" in target dataset). When I have the wildcard defined I get an error:

File "C:/Users/sc/Desktop/test/Append_Iterator_Export_Test.py", line 25, in <module>

for fc in arcpy.ListFeatureClasses('*','All',Inputdataset):

TypeError: 'NoneType' object is not iterable

This is what I have now:

# Import arcpy module

import arcpy

arcpy.env.workspace = "C:\Users\sc\Desktop\test\test_TCE.gdb\TCEMaster"

fcs = arcpy.ListFeatureClasses("TCEMaster_*")

Inputdataset = "C:\\Users\\sc\\Desktop\\test\\Temp_test.gdb\\R0007199"

Targetdataset = "C:\Users\sc\Desktop\test\test_TCE.gdb\TCEMaster"

# Process: Append

for fc in arcpy.ListFeatureClasses('*','All',Inputdataset):

arcpy.Append_management(fc, fcs, "TEST", "", "")

Re: Batch Processing in Model Builder - Delete rows then Append

MichaelVolz — Mon, 29 Feb 2016 21:02:14 GMT

Are you trying to access multiple feature datasets in your code and then all feature classes in all the feature datasets?

Or do you just want to iterate all feature classes in one feature dataset?

Re: Batch Processing in Model Builder - Delete rows then Append

SanhitaChatterjee1 — Mon, 29 Feb 2016 21:19:21 GMT

Michael, It is all feature classes in one dataset.

Re: Batch Processing in Model Builder - Delete rows then Append

MichaelVolz — Mon, 29 Feb 2016 21:39:56 GMT

Then if the code without the wildcard runs without error, that should do the trick for you. Now if you want to automate this, just add the python script to Windows Task Scheduler.

Re: Batch Processing in Model Builder - Delete rows then Append

SanhitaChatterjee1 — Mon, 29 Feb 2016 21:44:18 GMT

Actually I will have to copy data to a dataset with "TCEMaster_*" prefix on all feature classes. I will have to use the wildcard.

Re: Batch Processing in Model Builder - Delete rows then Append

MichaelVolz — Mon, 29 Feb 2016 22:16:40 GMT

What version of ArcGIS are you working in?

Re: Batch Processing in Model Builder - Delete rows then Append

SanhitaChatterjee1 — Mon, 29 Feb 2016 22:17:54 GMT

10.2.1

Re: Batch Processing in Model Builder - Delete rows then Append

MichaelVolz — Mon, 29 Feb 2016 22:36:14 GMT

Maybe it has something to do with the naming convention of feature classes within feature datasets where you need to specify both in the path.

Can you put in some print statements to check that the path to your input data and output data are correct with respect to the feature dataset and feature classes within the feature dataset?

I put a wildcard into my script which worked, so I don't think it's the wildcard that is the problem here. I'm thinking it does not see any objects with the name you are specifying because you might not be including the feature dataset portion of the path.