Copy Feature Class to new DB

kapalczynski — Tue, 21 Mar 2023 11:33:39 GMT

I am moving Feature Classes up our stack. Some of these have attachments, Editor Tracking, Archiving some dont

When I use COPY in my python script it disables Archiving and as such screws up the Attribute indexes on Feature Class and the accompanying Attachments etc.

I am trying to find the best way to fix everything the COPY has disconnected/disabled/destroyed. I could DIABLE Editor Tracking and attachments and then ENABLE Editor Tracking then Attachments then Archiving.

When I go to publish in Survey123 (referencing this FC in Portal that resides on my oracle server, NOT hosted) I am still getting errors that "The Supports ApplyEdits with Global IDs parameter is set to false"

I am now up in the stack where I no longer have access to the DBs. And all the examples I am seeing are to rebuild indexes with the tool etc.... I do not have access to modify them via Catalog or Pro VERY FRUSTRATING...

Is there a process that I can run that actually copies the Feature Classes, attachments, other configs etc to a new DB that actually works?

Any thoughts would be appreciated.

Re: Copy Feature Class to new DB

BlakeTerhune — Tue, 21 Mar 2023 19:51:58 GMT

Maybe Geodatabase Replication is what you need.

Re: Copy Feature Class to new DB

kapalczynski — Thu, 23 Mar 2023 00:48:32 GMT

This is how I did it...

COPY feature classes
Set Permissions
Deleted Indexes made on GLOBALID
Create New indexes with SAME name on GLOBAL ID
Enable Archiving

Hope this helps someone out...

This has eliminated the error I was getting when only a copy was done... they key is to rebuild the broken indexes and enabling archiving..

layers_to_Copy variable is a dictionary that provides the From and To datasets to copy

layers_to_Index variable is a dictionary that defines the layers and attribute tables to delete and rebuild indexes on

user_permissions_toSet variable is a dictionary that defines the users to set permissions for...the first part of the dictionary alerts the script to whether or not is a view or edit user... the second apart is the actual user name

# -*- coding: utf-8 -*- # ----------------------------------------------------------------------------------------------------------- # Feature Class migration from One DB to Another - Permissions, Index Rebuild, Archving Enabled # Created on: 2023-03-22 # Description: # This script will migrate Feature Classes from one Db to Another for those included in 'layers_to_Copy' # Permissions will be granted to those in the Dictionary below 'user_permissions_toSet' # Indexes for GlobalID will be deleted and recreated on the FCs in the Dictionary 'layers_to_Index' # Finally Archiving will be enabled on the New Feature Classes for those included in 'layers_to_Copy' # # THIS SCRIPT ASSUMES: # That the users used to set permissions will have VIEW or EDIT in their names # VIEW and EDIT keys are used to determine wether they are given view or edit permissions # ----------------------------------------------------------------------------------------------------------- # --Import arcpy module-------------------------------------------------------------------------------------- import arcpy import json import sys # --Variables to modify-------------------------------------------------------------------------------------- layers_to_Copy = { "Database Connections\\GIS_DATA@_From.sde\\GIS_DATA.SDE_FC1": "Database Connections\\GIS_DATA@_To.sde\\GIS_DATA.SDE_FC1", "Database Connections\\GIS_DATA@_From.sde\\GIS_DATA.SDE_FC2": "Database Connections\\GIS_DATA@_To.sde\\GIS_DATA.SDE_FC2" } layers_to_Index = { "FC1": "Database Connections\\GIS_DATA_To.sde\\GIS_DATA.SDE_FC1", "FC1Attach": "Database Connections\\GIS_DATA_To.sde\\GIS_DATA.SDE_FC1__ATTACH", "FC2": "Database Connections\\GIS_DATA_To.sde\\GIS_DATA.SDE_FC2", "FC2Attach": "Database Connections\\GIS_DATA_To.sde\\GIS_DATA.SDE_FC2__ATTACH" } # Define the User Accounts that need to be given permissions user_permissions_toSet = { "VIEW": "ViewUser", "EDIT": "EditUser", "VIEW": "gis_guest" } # ------------------------------------- # -----DONT EDIT BELOW THIS LINE -------------------------------------------------------------------------------- # ------------------------------------- # -----COPY------------------------------------------------------------------------------------------------------ def verifyFCAbsent(): print("") print("VERIFY DATASETS DO NOT EXIST IN NEW DB") print("") for layer in layers_to_Copy.keys(): fromFeatureClass = layer toFeatureClass = layers_to_Copy[layer] fc = toFeatureClass if arcpy.Exists(fc): print(fc) print("This Feature Class already exists, Exiting the Program") sys.exit() def copyFeatures(): print("-------------------------------------------") print("process - COPYING FEATURES") for layer in layers_to_Copy.keys(): fromFeatureClass = layer toFeatureClass = layers_to_Copy[layer] print("Starting to copy " + fromFeatureClass) print("To new location " + toFeatureClass) # Loop and Copy Feature Class to new Database arcpy.Copy_management(fromFeatureClass, toFeatureClass) print("Finished Copying " + fromFeatureClass + " to its new location") print("") print("-------------------------------------------") def changePrivileges(): print("") print("process - GRANTING PERMISSIONS") print("") count = 0 for layer in layers_to_Copy.keys(): fromFeatureClass = layer toFeatureClass = layers_to_Copy[layer] for user in user_permissions_toSet.keys(): userName = user userToSet = user_permissions_toSet[user] #print(toFeatureClass) if "VIEW" in user: print(userToSet) arcpy.ChangePrivileges_management(toFeatureClass, userToSet, "GRANT","") print("-View Permissions Granted " + "to " + toFeatureClass) if "EDIT" in user: print(userToSet) arcpy.ChangePrivileges_management(toFeatureClass, userToSet, "GRANT","GRANT") print("-Edit Permissions Granted " + "to " + toFeatureClass) print("---------") print("Priviliges are granted moving on") print("-------------------------------------------") print("Script completed, exiting....") # -----INDEXES------------------------------------------------------------------------------------------------------ def rebuildIndexes(): print("") for layer in layers_to_Index.keys(): fromFeatureClass = layer toFeatureClass = layers_to_Index[layer] listIndexes(toFeatureClass) print("Script Completed") def listIndexes(p_toFeatureClass): featureclass = p_toFeatureClass # Get list of indexes for roads.shp and print properties indexes = arcpy.ListIndexes(featureclass) for index in indexes: for fieldname in index.fields: listofIndexes = [] indexname = index.name ascending = index.isAscending isUnique = index.isUnique fieldname = fieldname.name listofIndexes.append(featureclass) listofIndexes.append(indexname) listofIndexes.append(ascending) listofIndexes.append(isUnique) listofIndexes.append(fieldname) if fieldname == "GLOBALID": infoIndexes(featureclass,listofIndexes) else: print("this is a SHAPE doing nothing") print("") def infoIndexes(featureclass,listofIndexes): print("GLOBALID Index Processing") pfeatureClass = featureclass arrayIndexes = listofIndexes featurename = str(arrayIndexes[0]) indexname = str(arrayIndexes[1]) ascending = arrayIndexes[2] isUnique = arrayIndexes[3] fieldName = str(arrayIndexes[4]) print(featurename) print(" " + str(indexname)) print(" " + str(ascending)) print(" " + str(isUnique)) print(" " + str(fieldName)) print("") deleteIndexes(pfeatureClass,featurename,indexname,fieldName) def deleteIndexes(pfeatureClass,deleteIndexesFeatureName,deleteIndexesName,deleteIndexesFieldName): rfeatureClass = pfeatureClass deleteIndexFeatureName = deleteIndexesFeatureName deleteIndexName = deleteIndexesName deleteFieldName = deleteIndexesFieldName print("-----------") print("Deleting FC index : {0}".format(rfeatureClass)) print("Deleting Index : {0} on field {1}".format(deleteIndexName,deleteFieldName)) print("") arcpy.RemoveIndex_management(rfeatureClass, [deleteIndexName]) rebuildingIndexes(rfeatureClass,deleteIndexFeatureName,deleteIndexName,deleteFieldName) def rebuildingIndexes(rfeatureClass,deleteIndexFeatureName,deleteIndexName,deleteFieldName): ffeatureClass = rfeatureClass rebuildIndexFeatureName = deleteIndexFeatureName rebuildIndexName = str(deleteIndexName) rebuildFieldName = deleteFieldName print("Rebuilding FC : {0}".format(ffeatureClass)) print("Rebuiling Index : {0} on field {1}".format(rebuildIndexName,rebuildFieldName)) print("-----------") arcpy.AddIndex_management(ffeatureClass, ["GLOBALID"], rebuildIndexName, "UNIQUE", "ASCENDING") # -----ARCHIVING------------------------------------------------------------------------------------------------------ def enableArchiving(): print("") for layer in layers_to_Copy.keys(): fromFeatureClass = layer toFeatureClass = layers_to_Copy[layer] turnonArchiving(toFeatureClass) print("Script Completed") def turnonArchiving(p_toFeatureClass): print("") print("process - ARCHIVING REVIEW") rebuildArchiveFC = p_toFeatureClass print("---Enabling Archiving on " + rebuildArchiveFC) arcpy.management.EnableArchiving(rebuildArchiveFC) print("---DONE - Enabling Archiving on " + rebuildArchiveFC) if __name__ == '__main__': # Verify Feature Classes do not exist in new DB verifyFCAbsent() ## Copy Features copyFeatures() ## Grant Priviliges changePrivileges() # REBUILDING INDEXES rebuildIndexes() # ENABLE ARCHIVING enableArchiving()

topic Re: Copy Feature Class to new DB in Python Questions

Copy Feature Class to new DB

Re: Copy Feature Class to new DB

Re: Copy Feature Class to new DB