topic Re: Looking for python scripts in Python Questions

Looking for python scripts

JRAdams — Tue, 12 Jun 2018 19:09:12 GMT

Trying to find a couple scripts...

I want to use my windows task manager to run them at a given time, so I am wanting to have the parameters pre-filled with inputs and outputs. Would like to generate token, but other I've set up were fine without.

#1) Want to pull a feature service from AGOL, includes point layer and three related tables, all with attributes enabled. I would ideally like all of this to remain intact. If not possible then a script to download replicas would suffice. The one I found throws error- ModuleNotFoundError: No module named 'urllib2'

#2) A script to export data to an access .mdb

--If one can be made to maintain relationships & attachments and then imported into access .mdb as such, that would be brilliant, but not thinking this one is possible. So if I could just get something that will overwrite the existing table through an export, I'd be super grateful!

I've gotten so far as downloading multiple at once, but it didn't maintain attachments. I was also able to append the .mdb, but it created loads of duplicates, and a simple CopyFeatures was not working for me.

Tried working with the Download Attachments created by Jake Skinner, I believe, but do not know enough script to modify it to allow both features and tables to be grabbed, along with pre-filled parameters.

I am using ArcMap 10.6 and ArcPro 2.1.3, although .mdb does not seem to connect in Pro

Thank you for any and all assistance!!

Re: Looking for python scripts

JoeBorgione — Tue, 12 Jun 2018 19:20:38 GMT

Personal geodatabases (AKA access mdb) are not supported in ArcGIS PRO. See 001324: Personal Geodatabases are not supported in 64-bit versions of ArcGIS.—Help | ArcGIS Desktop If you absolutely need your data in a .mdb, you'll need to stick with ArcGIS/ArcMap/ArcCatalog.

Can you provide the code you currently are using?

Re: Looking for python scripts

JoshuaBixby — Tue, 12 Jun 2018 20:03:31 GMT

This is a big ask of community members. It appears you have tried some things on your own, which is good, but what is asked here doesn't give any of those details and asks for quite a bit.

Looking at #1, what script have you tried, exactly?

Re: Looking for python scripts

JRAdams — Wed, 13 Jun 2018 12:41:35 GMT

Yeah, I've been connecting to it in ArcMap & Catalog

Re: Looking for python scripts

JRAdams — Wed, 13 Jun 2018 12:58:29 GMT

Download with attachments used (user is prompted to enter variables) by Jake Skinner Download ArcGIS Online Feature Service or ArcGIS Server Feature/Map Service

This works for one service at a time, and does not overwrite an existing, as I would hope to. If not possible, just downloading the replica or something similar into a zip file will do.

For exporting the .mdb, the table is going from one database to another. So I tried this one (also from Jake Skinner) but it duplicates instead of updating (all fields are a perfect match). When I change "Append_management" to CopyFeatures, it doesn't do anything, although not running any errors, but not completing the task-

import arcpy, os
from arcpy import env
GDB1 = r"C:\temp\fileGDB1.gdb"
GDB2 = r"C:\temp\fileGDB2.gdb"
env.workspace = GDB1
#Append tables
for table in arcpy.ListTables("*"😞
env.workspace = GDB2
for tableGDB in arcpy.ListTables(table):
try:
if tableGDB.lower() == table.lower():
arcpy.AddMessage("\tAppending " + table)
try:
arcpy.Append_management(GDB1 + os.sep + table, GDB2 + os.sep + tableGDB, "NO_TEST")
except:
arcpy.AddMessage("Could not append " + table)
pass
except:
pass
env.workspace = GDB1

Re: Looking for python scripts

JRAdams — Wed, 13 Jun 2018 12:59:59 GMT

I've also tried others and multiple iterations of each before reaching out to see if someone can guide me in the right direction here

Re: Looking for python scripts

JRAdams — Sat, 11 Dec 2021 15:12:34 GMT

Found a workable one for replicas (although would still prefer one to overwrite existing if anyone has one):

from __future__ import print_function
from arcrest.security import AGOLTokenSecurityHandler
from arcrest.agol import FeatureService
from arcrest.common.filters import LayerDefinitionFilter

if __name__ == "__main__":
    username = "[username]"
    password = "[passwprd]"
    url = "[feature service url]"
    proxy_port = None
    proxy_url = None
    agolSH = AGOLTokenSecurityHandler(username=username,
                                      password=password)
    fs = FeatureService(
        url=url,
        securityHandler=agolSH,
        proxy_port=proxy_port,
        proxy_url=proxy_url,
        initialize=True)
    result = fs.createReplica(replicaName='Demo',
                              layers=[0,1,2],
                              dataFormat="filegdb",
                              out_path='D:\\temp')

    print( result)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Then I am using this one to rename the attachments as something more meaningful, otherwise they come as Photo1.jpeg, Photo2.jpeg...

import arcpy, os
from collections import defaultdict

inFC = r'D:\test.gdb\INLET' # Feature Class 
inTable = r'D:\test.gdb\INLET__ATTACH' # Attachment table
fileLocation = r'D:\test\TestOutput' # Output location

# Get dictionary of ObjectID and associated field value
myFeatures = dict()
with arcpy.da.SearchCursor(inFC, ['GLOBALID', 'ID']) as cursor:
for row in cursor:
myFeatures[row[0]] = row[1]

# Create dictionary to count usage of the field value (to increment files)
valueUsage = defaultdict(int)

# Loop through attachments, incrementing field value usage, and using that
# increment value in the filename
with arcpy.da.SearchCursor(inTable, ['DATA', 'ATT_NAME', 'ATTACHMENTID', 'REL_GLOBALID']) as cursor:
for row in cursor:
if row[3] in myFeatures:
attachment = row[0]
fieldValue = myFeatures[row[3]] # Value of specified field in feature class
valueUsage[fieldValue] += 1 # Increment value
filename = "{0}_{1}.jpeg".format(fieldValue, valueUsage[fieldValue]) # filename = FieldValue_1
output = os.path.join(fileLocation, filename) # Create output ilepath
open(output, 'wb').write(attachment.tobytes()) # Output attachment to file‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Is there a way to link the two? I think I would need to do an unzip prior to the second.

Re: Looking for python scripts

DanPatterson_Retired — Wed, 13 Jun 2018 20:59:04 GMT

Brita... /blogs/dan_patterson/2016/08/14/script-formatting to make it readable

Re: Looking for python scripts

JRAdams — Thu, 14 Jun 2018 13:38:48 GMT

Thank you!

Re: Looking for python scripts

JoeBorgione — Thu, 14 Jun 2018 13:44:37 GMT

Brita- watch your indents (or lack there of) in the second script at line 10 and then again at 18...

Is there a way to link the two?

You could put both scripts into one, calling each with their own def():