Copying GDB Features to existing SDE Features

Question

I am trying to clear existing records in a list of SDE features and then copy duplicate (but updated) GDB records into those same SDE features.  Looking for advice on how to set up the loop through both lists within the append tool so each GBD feature is copied into its respective SDE feature.  The code below throws the error "ValueError: too many values to unpack".

SDEFeatures = [CBTSDE + "REF.SDE.NamedRMA", CBTSDE + "REF.SDE.NamedSMA", CBTSDE + "REF.SDE.OR_State_Type", CBTSDE + "REF.SDE.RdRt",
               CBTSDE + "REF.SDE.RMA", CBTSDE + "REF.SDE.Road_Easement", CBTSDE + "REF.SDE.Road_Gates", CBTSDE + "REF.SDE.Road_Type",
               CBTSDE + "REF.SDE.RoadRouteNamed", CBTSDE + "REF.SDE.SMA", CBTSDE + "REF.SDE.Stream_Fish_Barrier", CBTSDE + "REF.SDE.Stream_Fish_Use",
               CBTSDE + "REF.SDE.Stream_Flow_Regime", CBTSDE + "REF.SDE.Stream_Size", CBTSDE + "REF.SDE.Stream_StateType", CBTSDE + "REF.SDE.StreamRouteNamed", CBTSDE + "REF.SDE.StrRt"]
GDBFeatures = [CBTGDBp + "NamedRMA", CBTGDBp + "NamedSMA", CBTGDBp + "OR_State_Type", CBTGDBp + "RdRt", CBTGDBp + "RMA", CBTGDBp + "Road_Easement",
               CBTGDBp + "Road_Gates" + CBTGDBp + "Road_Type", CBTGDBp + "RoadRouteNamed", CBTGDBp + "SMA", CBTGDBp + "Stream_Fish_Barrier",
               CBTGDBp + "Stream_Fish_Use", CBTGDBp + "Stream_Flow_Regime", CBTGDBp + "Stream_Size", CBTGDBp + "Stream_StateType", CBTGDBp + "StreamRouteNamed", CBTGDBp + "StrRt"]

# Empty and Reload SDE feature
if current_status == 'YES':
    print 'Processing empty and reload SDE feature'
    for items in SDEFeatures:
        arcpy.DeleteRows_management(items)
    for (GDBitems, SDEitems) in (GDBFeatures, SDEFeatures):    
        arcpy.Append_management(GDBitems, SDEitems, "NO_TEST", "", "")
    print 'NetAcresCurrent SDE feature has been updated.'
else:
    print 'NetAcresCurrent SDE feature has NOT been updated.'

forestknutsen1 · Answer

My favorite pattern for this sort of stuff is to use a cvs file with named tuples. That way you can mange the paths in Excel. And you can get access to the "csv fields" with a dot operator within your python code.

python

from collections import namedtuple
import csv

with open('features.csv') as features:
    reader = csv.DictReader(features)
    Data = namedtuple('Data', reader.fieldnames)
    feature_paths = [Data(**x) for x in reader]
for feature_path in feature_paths:
    print feature_path.source
    print feature_path.target

csv file

source,target
source_path_1,target_path_1
source_path_2,target_path_2
source_path_3,target_path_3

forestknutsen1 · Answer

You can zip your lists to get around that error:

source = ['x', 'y', 'z']
target = ['a', 'b', 'c']

for a, b in zip(source, target):
    print a
    print b

Anonymous User · Answer

We do something similar for migrating data to test servers and I'll echo @forestknutsen1's suggestion of using a dictionary.

We use a list of featureclass names from a text file that we use to create the src_paths and dst_paths by iterating over the list and creating the path strings. We also track last edit times and check if the dataset is older/newer/same or different feature counts and handle it accordingly so we also have a lot more key:value entries.

The fc name would replace the 'fc_name' key in the dictionary below and is used for status/ error messages (omitted here):

fc_dict = {'fc_name': {'src_path': 'path to src fc', 'dst_path': 'path to dest fc'}, ... }

# then iterate over it:

for fc, fcPaths in fc_dict.items():
    if arcpy.Exists(fcPaths['dst_path']):
        arcpy.DeleteFeatures_management(dst_path)
        arcpy.Append_management(src_path, dst_path, "NO_TEST")

You could make the paths when you create the dictionary/ iterating over the list of featureclass names.

fc_dict = {}

source_path = r'path to the source db\dataset.SDE.'
dest_path = r'path to the dest db'

for fc_name in ['fc1', 'fc2', 'fc3', ...]:
   fc_dict[fc_name] = {'src_path': os.path.join(source_path, fc_name}, 'dst_path': os.path.join(dest_path, 'REF.SDE.' + fc_name)}