Latest Contributions by ChristalHigdon

‎02-02-2018

Related, I would like to display the attribute table from one of the layers in my map and have it filter on view extent. There's a widget in Web App Builder that does this but this is the only thing missing from Dashboard for me to make full use of it. Thank you!

‎05-25-2016

It's a regular Toolbox. I am trying a pyt now and it's .........running. Hasn't moved past the check if the output file GDB exists (which it does) in over 20 minutes, so I'm not very hopeful that a Python Toolbox would make a difference.

‎05-25-2016

I found it, looks neat. I will check it out. Thanks!

‎05-25-2016

‎05-25-2016

I am wondering if anyone has experienced a dramatic difference in the time it takes to execute a Python script as a script tool vs. directly in Python or Pythonwin IDE? I run my script in Pythonwin (Python 2.7.8, 32-bit) and it takes about 17 minutes but when I run the same script as a script tool in ArcCatalog (version 10.3.1) Elapsed Time: 7 hours 39 minutes 44 seconds. That is an incredible difference and I'm wondering what the issue is. This is in our Citrix environment so the programs are not running on my desktop PC but on a Citrix Blade. What I thought was a script that provides a workable solution is not if when I distribute it in a toolbox, it takes magnitudes longer to run (like all day). I have a script that does the following (I can post the fullcode if that might be helpful, though it is fairly long and this is a general question): Summary: Creates one-way replicas to a file gdb from our corporate Enterprise (Oracle) SDE instance to our data center filing system and then pushes it out to our Network Attached Storage device using Robocopy and then sends an email of the log file. Steps: Initiates logging module to logfile logging.basicConfig(level=logging.INFO, format=' %(asctime)s|%(levelname)-8s|%(message)s', datefmt='%Y-%m-%d %H:%M:%S', filename=LOGFILE_NAME, filemode='w') Checks SDE inputs for replication requirements (datasets are versioned and feature classes/tables contain GlobalIDs) if schema == "S_R10_CNF" and str(child.isVersioned) == 'False': logging.info("Child {0} is not Registered as versioned".format(child.Name)) logging.info("Attempting to register...") try: arcpy.RegisterAsVersioned_management(child.Name, "NO_EDITS_TO_BASE") logging.info("Registered {0} as Versioned successfully".format(child.Name)) except Exception as e: logging.warning("Unable to Register As Versioned due to Exception: {0}".format(e.message)) logging.warning("{0} is NOT registered as versioned and will NOT be replicated".format(child.Name)) and from collections import defaultdict myDict = defaultdict(list) for fc in arcpy.ListFeatureClasses("","",ds): gid = arcpy.ListFields(fc,"",field_type="GlobalID") if not gid: myDict[ds].append(fc) for tb in arcpy.ListTables('S_R10_CNF.*'): gid = arcpy.ListFields(tb,"",field_type="GlobalID") if not gid: print('{0} is missing GLOBALID in Table {1}'.format(tb)) myDict['TABLE'].append(tb) for i in myDict: logging.info("{0} is missing GlobalIDs! Attempting to add them...".format(i)) try: if i == "TABLE": arcpy.AddGlobalIDs_management([myDict]) else: arcpy.AddGlobalIDs_management(i) logging.info("Added GlobalIDs to Dataset: {0}".format(i)) except Exception as e: logging.warn("Unable to add GlobalIDs to dataset {0} \n due to Exception: {1}".format(i, e.message)) logging.warn("The following do not have GlobalIDs and will not be replicated: {0}".format(i)) for val in myDict: printmsg(val) logging.warn(val) Creates the output file GDB if it doesn't already exist if not arcpy.Exists(gdbName): arcpy.CreateFileGDB_management(outPath, gdbName) logging.info("Created target child GDB " + gdbName) Generates a name for the Replica based on the dataset name replicaName = replicaBase + "_NAS1Way" truncLen = 32 - len("_NAS1Way") if len(replicaName) > 32: #replica name can only be 32 characters or less or replica will fail with a vague error message replicaName = "{0}_NAS1Way".format(replicaBase[0:truncLen]) Checks if the replica exists already, if so it synchronizes and copies metadata, if not, it creates the replica # Check replica names in both parent and child replicaList = [x.name.partition(".")[2] for x in arcpy.da.ListReplicas()] replicaListGDB = [x.name for x in arcpy.da.ListReplicas(outGDB)] if replicaName in replicaList: try: if replicaName in replicaListGDB: arcpy.SynchronizeChanges_management(outGDB, "DBO."+replicaName, arcpy.env.workspace, "FROM_GEODATABASE2_TO_1") logging.info("Synchronized One Way Replica for: {1}".format(replicaName, DS)) else: logging.warn("Replica Name {0} found in parent SDE but not in child GDB".format(replicaName)) logging.warn(" Unregister replica {0}, delete child data, and run again!".format(replicaName)) except Exception as e: logging.error("Unable to synchronize replica {0}\n due to Exception: {1}".format(replicaName,e.message)) try: arcpy.env.workspace = outGDB status='Synchronizing metadata for {0}'.format(DS) logging.info(status) if DS == "CNFTables": for item in features: arcpy.MetadataImporter_conversion(os.path.join(parentGDB,item), item.split(".")[1]) else: for item in features: arcpy.MetadataImporter_conversion(os.path.join(parentGDB,DS,item), os.path.join(DS.split(".")[1],item.split(".")[1])) except Exception as e: logging.error("Unable to synchronize metadata {0}\n due to Exception: {1}".format(replicaName,e.message)) else: try: arcpy.env.workspace = parentGDB status='Creating 1 Way Replica for {0}'.format(DS) arcpy.CreateReplica_management(featureList, "ONE_WAY_REPLICA", outGDB, replicaName, "FULL", "", "ALL_ROWS", "", "GET_RELATED") logging.info("Created One Way Replica for: {0}".format(DS)) logging.info(" Replica is named: {0}".format(replicaName)) logging.info(" With data: ") for f in features: logging.info(" {0}".format(f)) except Exception as e: logging.error("Unable to create replica for dataset {0}\n due to Exception: {1}".format(DS,e.message)) Calls Robocopy through subprocess module to copy the file GDB over to the NAS drive subprocess.call(r'NET USE Z: /del') subprocess.call(r'NET USE Z: {0} /user:<username> pwd'.format(destPath)) status='Pushing replica GDB changes to NAS Drive '.format(destPath) logging.info(status) subprocess.call(["robocopy", gdbPath, "Z:", "*.*", "/e", "/z", "/dcopy:T", "/purge", "/xo", "/xf", "*.lock", "{0}".format(os.path.join(gdbPath, "robocopy_log.txt")), "/fft", "/log:{0}".format(os.path.join(gdbPath, "robocopy_log.txt")), "/tee"]) Sends an email of the log file mailserver.starttls() mailserver.ehlo() mailserver.sendmail(fromEmail, toEmailList, msg) mailserver.close() The slowest parts of the script seem to be running arcpy.SynchronizeChanges_management when it's in a Toolbox Script Tool, even when there are NO changes to synchronize! The box is checked to Run Python Script in Process. I am looking into using multiprocessing as there are 16 cores on the Citrix server in order to run some of the checks and creating replicas to speed things up. Does anyone have any idea why the same script takes ridiculously longer as a Script Tool than directly in Python without the ArcGIS overhead? Any tips would be greatly appreciated!

‎11-03-2015

It fails. The message is Cannot acquire a lock [GDB_Items] and fails. (screen shot attached) I went back to my script and tested for locks... none of the input datasets or feature classes had locks on them, but the newly created output file geodatabase did, even though when I went into the folder, there were no '.lock' files in there. I have tried creating it through ArcCatalog ahead of time, and then closing Catalog, as well as creating the output gdb in the 'browse to' dialog in the wizard. I have tried through the Distributed Geodatabase toolbar in ArcMap and gotten the attached error. I have tried running the CreateReplica tool through ArcToolbox, and gotten error 000582. I have tried running CreateReplica through the Python window within ArcMap, failed with error 000582. I have tried running my Python Script through PythonWin (like usual), failed with error 000582. I have tried running my Python script through the python interpreter via command line, failed with error 000582. I have tried creating the output geodatabase on our shared NAS drive (ultimately the goal), failed with error 000582. I have tried creating the output geodatabase on my C: drive, and sometimes get error 000582 and sometimes (when I make a new replica name that has never before been used) it occasionally works. I was just wondering if anyone else had the same problems going from Workgroup SDE (SQL Server Express 2012) one way to file geodatabase and could possibly offer a solution. I'm about out of ideas to try.

‎10-30-2015

Thanks for your reply and ideas. Unfortunately, the results are the same. I wish it were that easy! I have tried that before and included the archiving because I was going to experiment with using archiving and comparing to not using it. I had a theory that in trying to reuse the same replica name (after unregistering from both parent and child and deleting the child gdb), that possibly something behind-the-scenes was not getting deleted or cleared properly when the Unregister happened. So I tried it with a brand new, never before used replica name and the above suggestion of taking off the last four parameters, to no avail. I agree that the documentation is far from complete and I wasn't sure if the archiving flag was optional or not. The default is not to use it anyway, so I just left it off. I have tried everything I could think of. Curious that it did work going from our Workgroup SDE server to file geodatabases on my C: Drive using a new replica name, but if I unregister and delete the output/child gdbs and try again, it will fail with ERROR 000582. Also, I just tried with a new and unique replica name from our Workgroup SDE to the external NAS drive (connected as UNC path with admin credentials) and got the same ERROR 000582. It seems like I have tried every possible thing that could be the issue and am no closer to figuring out what is causing the problem. Does anyone know of a way to tell why it's failing at this point?: Traceback (most recent call last): File "C:\Program Files (x86)\ArcGIS\Desktop10.2\arcpy\arcpy\management.py", line 800, in CreateReplica retval = convertArcObjectToPythonObject(gp.CreateReplica_management(*gp_fixargs((in_data, in_type, out_geodatabase, out_name, access_type, initial_data_sender, expand_feature_classes_and_tables, reuse_schema, get_related_data, geometry_features, archiving), True))) File "C:\Program Files (x86)\ArcGIS\Desktop10.2\arcpy\arcpy\geoprocessing\_base.py", line 498, in <lambda> return lambda *args: val(*gp_fixargs(args, True)) ExecuteError: ERROR 000582: Error occurred during execution.

‎10-28-2015

I am still having trouble with this. I am using: ArcGIS 10.2.2 with Python 2.7 (installed through ArcGIS) Windows 7 64-bit machine SQL Server Express 2012 (Workgroup SDE, NOT Enterprise) Pythonwin site-package for Python 2.7 I am using the 32-bit Python interpreter: PythonWin 2.7.5 (default, May 15 2013, 22:43:36) [MSC v.1500 32 bit (Intel)] on win32. Below is the Traceback from the arcpy.CreateReplica_management line in my script: Traceback (most recent call last): File "C:\WorkSpace\tools\scripts\CreateTNF1WayReplica\R10Create1wayReplica2fGDBNAS_10_2.py", line 157, in makeReplica arcpy.CreateReplica_management(featureList, "ONE_WAY_REPLICA", outGDB, replicaName, "FULL", "PARENT_DATA_SENDER", "ALL_ROWS", "", "", "", "DO_NOT_USE_ARCHIVING") File "C:\Program Files (x86)\ArcGIS\Desktop10.2\arcpy\arcpy\management.py", line 803, in CreateReplica raise e ExecuteError: ERROR 000582: Error occurred during execution. So I stepped through in the debugger and stepped into the management.py script and also into the _base.py from there. Here is the point that the error occurs: Traceback (most recent call last): File "C:\Program Files (x86)\ArcGIS\Desktop10.2\arcpy\arcpy\management.py", line 800, in CreateReplica retval = convertArcObjectToPythonObject(gp.CreateReplica_management(*gp_fixargs((in_data, in_type, out_geodatabase, out_name, access_type, initial_data_sender, expand_feature_classes_and_tables, reuse_schema, get_related_data, geometry_features, archiving), True))) File "C:\Program Files (x86)\ArcGIS\Desktop10.2\arcpy\arcpy\geoprocessing\_base.py", line 498, in <lambda> return lambda *args: val(*gp_fixargs(args, True)) ExecuteError: ERROR 000582: Error occurred during execution. I stepped through the gp_fixargs and at line 40 of _base.py, my args turned into new_args as follows: ['"C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.ProjectArea;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.TMCompartment;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.ActivityPoint;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.CoverType;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.ValueComparisonUnit;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.ActivityPolygon;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.ActivityLine;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.CoverType_Topology;C:\\WorkSpace\\temp\\CreateReplicas\\inputs\\Activities.sde\\Activities.DBO.Activities\\Activities.DBO.VCU_TMComp_Topology"', 'ONE_WAY_REPLICA', '\\\\199.131.000.000\\TNFRef\\GISData\\Activities.gdb', 'Activities_1WayRO2NAS', 'FULL', 'PARENT_DATA_SENDER', 'ALL_ROWS', '', '', '', 'DO_NOT_USE_ARCHIVING'] Every once in a while I can get this to work but can't find rhyme or reason as to why it works every once in a while. I have tried the output file geodatabase location on my C: drive ('C:\\WorkSpace\\temp\\CreateReplicas\\outputs\\gdbs\\Activities.gdb'), on the external share mapped as UNC path (as above: '\\\\199.131.000.000\\TNFRef\\GISData\\Activities.gdb'), and mapped as a drive letter ('Y:\\GISData\\Activities.gdb'), all with the same results (Error 00582). [The IP address has been changed to 0s on purpose for posting here, it is the real IP address in the script.] Attached is the code block from my script, with inputs being: parentGDS = Database connection .sde file on C: drive that points to our Workgroup SDE instance for the database in the list of databases (in this case, "Activities") GDBPath = the output location for the file GDB to be stored. I have tried local C: drive and our NAS drive as UNC and mapped as a drive letter gdbName = the name of the database in the list. In this case "Activities" If the output geodatabase (in this case Activities.gdb) does not exist, it is created before getting to the create replica part, using: if not arcpy.Exists(outGDBPath + os.sep + gdbName): createTargetGDB(outGDBPath,gdbName) I tried running it in ArcMap, using the Create Replica tool in Toolbox and got the following: Executing: CreateReplica Activities.DBO.CoverType_Topology;Activities.DBO.VCU_TMComp_Topology;ActivityPoint;ActivityLine;ProjectArea;Activities.DBO.TMCompartment;CoverType;Activities.DBO.ValueComparisonUnit;ActivityPolygon ONE_WAY_REPLICA C:\WorkSpace\temp\CreateReplicas\outputs\gdbs\Activities.gdb ArcMapToolboxTest FULL PARENT_DATA_SENDER ALL_ROWS DO_NOT_REUSE GET_RELATED # DO_NOT_USE_ARCHIVING Start Time: Wed Oct 28 15:12:27 2015 Executing CreateReplica... ERROR 000582: Error occurred during execution. Failed to execute (CreateReplica). Is there any way to tell which input parameter is causing the error? Could this still be a bug in the GP tool? I'm about to go to ArcObjects and write a C#.NET executable to do the replica creation like I used to before I thought Bug NIM-073906 was fixed (http://support.esri.com/en/bugs/nimbus/TklNMDczOTA2).

‎10-27-2015

I am finding the same thing (ArcGIS 10.2.2, standard Python 2.7 install, Windows 7 64-bit computer but 32 bit Python interpreter). I have wasted days trying to figure out vague ERROR 000582 in both SynchronizeChanges and CreateReplica. If I use the following line, in the interactive PythonWin window or in the ArcMap Python window, I get the error that follows: arcpy.SynchronizeChanges_management(parentGDS, replicaName, outGDB, "FROM_GEODATABASE1_TO_2") Traceback (most recent call last): File "<interactive input>", line 1, in <module> File "C:\Program Files (x86)\ArcGIS\Desktop10.2\arcpy\arcpy\management.py", line 1286, in SynchronizeChanges raise e ExecuteError: ERROR 000582: Error occurred during execution. If I change the order and use: arcpy.SynchronizeChanges_management(outGDB, replicaName, parentGDS, "FROM_GEODATABASE2_TO_1") ....it works successfully. It seems like a bug since the one way replica is from parent to child, but as long as I figured out the correct syntax, I can work around this issue.

‎06-17-2014

Are you running Windows 7 64-bit? I found a bug regarding this: NIM073906: Cannot run Create Replica as a script on a Windows 7 64-bit machine. I am experiencing this issue on a Windows 7 64-bit machine. As this bug was found in version 10.0 SP2 and I am running version 10.2, any idea when this bug will be fixed? I have 45 geodatabases to create replicas for and doing it outside of a script (manually through ArcToolbox or ArcMap, which works) is not really an option. Thanks!

‎05-30-2014

I stumbled upon this after looking for a couple days into my favorite Error 999999 when running the Find Identical tool on a very large dataset in ArcGIS Desktop version 10.2 (in a Python script but also tried it through Toolbox). I noticed it was a 'fixed' bug in 10.1 but I'm guessing the datasets I work with are larger than what they tested as a 'large' dataset. Or else the bug is back in 10.2. Anyway, I was able to code the above solution directly into my Python script and it ran WAY faster than the other method (We're talking close to a 14 hour processing time). Thank you so much for posting this!! It helped me tremendously.

‎04-12-2013

Yes, please! I create temp geodatabases as scratch workspaces that I delete and recreate in my scripts and it is a huge PAIN when debugging and working through a script to have to close Pythonwin over and over every 5 minutes to clear the locks. I would like a command to clear locks on a specified geodatabase in Python.

Online Status	Offline
Date Last Visited	‎11-11-2020 02:23 AM

My Ideas

Latest Contributions by ChristalHigdon

Re: Is there a way to add a table from ArcGIS online to Operations Dashboard for ArcGIS?

Re: Processing time for Python Script using pythonwin vs. Script Tool

Re: Processing time for Python Script using pythonwin vs. Script Tool

Re: Processing time for Python Script using pythonwin vs. Script Tool

Processing time for Python Script using pythonwin vs. Script Tool

Re: Create replica problem-produces exception

Re: Create replica problem-produces exception

Re: Create replica problem-produces exception

Re: SynchronizeChanges Tool Error 582 when using FROM_GEODATABASE1_TO_2

Re: Create replica problem-produces exception

Re: Find Identical tool Replacement

Re: Remove schema locks in Python

Re: Is there a way to add a table from ArcGIS onli...

Re: Remove schema locks in Python

Processing time for Python Script using pythonwin ...