Latest Contributions by Tom_Laue

@JustinColville  Has anyone successfully been able to permanently delete an AGOL item via Python AFTER ESRI added the recycle bin?   from arcgis.gis import GIS gis = GIS("home") item_id='767ff8fe699047d7bc0e74c0f15a63a4' #this is the service_ID of the hosted feature layer to delete itemToDelete = gis.content.get(item_id) itemToDelete.delete(permanent=True)     Running this code in AGOL Notebooks as well as Python 3.9.16 on my computer with Pro 3.1.2 I get the following error message:     TypeError Traceback (most recent call last) /tmp/ipykernel_19/3146111176.py in <cell line: 7>() 5 6 itemToDelete = gis.content.get(item_id) ----> 7 itemToDelete.delete(permanent=True) TypeError: delete() got an unexpected keyword argument 'permanent'   ... View more

A couple things come to mind…   When testing, I would add to your script print(type(Initial_Date)) That way you can tell what date type it is and research how to do a time delta to that format (or if you need to convert it to a different datetime format) I have seen issues where a date query doesn’t work unless I give it a range of dates. Date > 6/6/2024      In some cases that does not work Date > 6/6/2024 and Date<1/1/2099      Works when the first one doesn’t ... View more

JSON backups   Similarly, I also backup the content JSON files incase schema on a hosted layer gets changed or a webmap/dashboard/app gets inadvertently changed or broken.   ESRI webmaps, dashboards, etc. have two parts to their JSON data. Description Data   The Data is where all the customizations you’ve made to the content are stored. Tom_Laue_2-1715013978834.png       The script is set to download all the following JSON Data for the following item types in your Portal: Web Map Web Mapping Application Feature Layer Application Dashboard Web Experience item_types   Tom_Laue_3-1715013978836.png       If a new item of that type is added to Portal, a new folder is created from the item name. Tom_Laue_4-1715013978843.png     If the content was modified in the last 24 hours, a new JSON file is saved. Tom_Laue_5-1715013978847.png   import arcgis from arcgis import gis from arcgis.gis import GIS import json import os import glob gis = arcgis.gis.GIS("https://yourorg.maps.arcgis.com", "username", "password") import datetime now = datetime.datetime.now() dateString = now.strftime("%Y-%m-%d") folder_location = r"C:\ArcGISOnline\BackupFiles\JSON" item_types = { 'Web Map', 'Web Mapping Application', 'Feature Layer','Application', 'Dashboard', 'Web Experience'} for itemType in item_types: folder_name = itemType subfolder_path = os.path.join(folder_location,folder_name) try: os.mkdir(subfolder_path) except: pass print("\n"+itemType) itemType_items = gis.content.search(query="*",item_type=itemType,max_items=10000) listOfItemIDs = [] for item in itemType_items: listOfItemIDs.append(item.id) for iid in listOfItemIDs: my_item = gis.content.get(iid) item_title = my_item.title removestring ="%:/,.\\[]<>*?$" item_title = ''.join([c for c in item_title if c not in removestring]).strip() file_name = item_title+"_"+itemType+"_"+str(dateString)+".json" file_path_item_folder = os.path.join(subfolder_path ,item_title) file_path = os.path.join(file_path_item_folder ,file_name) item = my_item.get_data(try_json=True) if len(item)>0: # only proceed if json dump is not empty try: #print(file_path_item_folder) os.mkdir(file_path_item_folder) except: a=1 full_path = os.path.join(file_path_item_folder,file_name) #get date of newest file in folder list_of_files = glob.glob(file_path_item_folder+"\*") if len(list_of_files)>0: latest_file = max(list_of_files, key=os.path.getctime) newestFileDate = os.path.getmtime(latest_file ) else: newestFileDate = 0 #note: does not run on empty folders with no json exports already if newestFileDate == 0 or my_item.modified/1000>newestFileDate : # if modified date newer than last json or no json in folder print("\t"+item_title) print(full_path) with open (full_path, "w") as file_handle: file_handle.write(json.dumps(item)) print("\n\nCompleted")   ... View more

Geodatabase Backups   I recommend adding a Tag to any content you want to backup.  Tom_Laue_0-1715013689755.png   Then via Python script, you can download any content with that Tag to gdb and schedule the script (via Task Scheduler) to run daily or weekly as you need. I use the tag: GDBNightlyBackup   import datetime startTime = datetime.datetime.now() TodaysDate = datetime.date.today().isoformat() print (startTime) ############## import arcgis from arcgis.gis import GIS import os #enter AGOL sign-in credentials gis = GIS("https://yourorg.maps.arcgis.com", "username", "password",verify_cert=False) now = datetime.datetime.now() folderName = now.strftime("%Y-%m-%d") #print (folderName) parent_dir = r"C:\ArcGISOnline\BackupFiles\FeatureLayers" path = os.path.join(parent_dir, folderName) #create folder if it doesn't exist if os.path.isdir(path): pass else: os.mkdir(path) print("Directory '% s' created" % folderName) def downloadItems(downloadFormat): try: download_items = [i for i in gis.content.search(query="tags: = 'GDBNightlyBackup'", item_type='Feature Layer', max_items=-1)] #print(download_items) # Loop through each item and if equal to Feature service then download it for item in download_items: if item.type == 'Feature Service': print(item) result = item.export(f'{item.title}', downloadFormat) #r'file path of where to store the download' result.download(path) # Delete the item after it downloads to save on space result.delete() except Exception as e: print(e) downloadItems(downloadFormat='File Geodatabase') ############# endTime = datetime.datetime.now() td = endTime - startTime hours, remainder = divmod(td.seconds, 3600) minutes, seconds = divmod(remainder, 60) TimeElapsed='{:02}:{:02}:{:02}'.format(int(hours), int(minutes), int(seconds)) print ("") print ("Done!") print ("") print ("Ended at " + str(endTime)) print ("Time elapsed " + str(td))     The result is I have backup folders every day for all the hosted content I've been downloading. Tom_Laue_1-1715013789245.png     ... View more

Awesome 🎉 Don't get too frustrated as it gets easier the more you use Arcpy. The more code you write, the more you can "steal" ideas from your other scripts, or ESRI samples or GIS Stack Exchange, etc. Even ChatGPT sometimes can produce usable Esri Python code! ... View more

Python IDLE is probably putting a lock on those mxds. If you close the Python results Window, you should be able to edit in ArcMap. ... View more

@AlfredBaldenweck is correct. If you're ever curious what a variable is you can type:   print(type(mxd))   Also, the df part need to be tabbed over:   from arcpy import env # Set the workspace for the folder containing MXDs arcpy.env.workspace = r"S:\Workgroups\Test" mxdList = arcpy.ListFiles("*.mxd") # Iterate through all MXDs in the workspace for mxd in mxdList: mxdpath = env.workspace + "\\" + mxd print (mxd + "Is being processed") mxdNext = arcpy.mapping.MapDocument(mxdpath) for df in arcpy.mapping.ListDataFrames(mxdNext,"Layers"): for lyr in arcpy.mapping.ListLayers(mxd, "Backup", df): if lyr == "Backup": lyr.replaceDataSource(r"S:\Workgroups", "SHAPEFILE_WORKSPACE", "Backup.shp", r"S:\Workgroups\Data.gdb\Final", "FILEGDB_WROKSPACE") if lyr.name == "Backup": lyr.name = "Final" print("lyr.name") mxdNext.save() arcpy.RefreshTOC()     Otherwise it's only going to run on the last MXD in the folder, not all the MXDs. ... View more

After making changes to your mxd via Python, you need to save those changes with:   mxd.save()   ... View more

I've used variations of this script: Updating and fixing data sources with arcpy.mapping  import arcpy mxd = arcpy.mapping.MapDocument(r"C:\Project\Project.mxd") for lyr in arcpy.mapping.ListLayers(mxd): if lyr.supports("DATASOURCE"): if lyr.dataSource == r"C:\Project\Data\Parcels.gdb\MapIndex": lyr.findAndReplaceWorkspacePath(r"Data", r"Data2") mxd.saveACopy(r"C:\Project\Project2.mxd") del mxd   ... View more

Can the Workspace be a feature class or feature dataset?   I've always set the workspace as a .gdb or .sde I'm curious if it works if you set the workspace as:    r"C:\Users\User\AppData\Roaming\Esri\ArcGISPro\Favorites\sdeConnection.sde   ... View more

 My understanding is if you point a tool at a layer in the Table of Contents, it will run on the selected records (if any are selected) and on the entire layer if none are selected. 99% of my Python scripts run outside ArcMap but that's the way it works in standalone scripts. ... View more

Never tried to do this but thinking in my head... Using a Loop... Do a near analysis and get the OID of the nearest feature. Then make a feature layer but def query to display all features EXCEPT the OID returned Run Near Analysis again against the queried feature layer to get the 2nd closest feature ... View more

I add something like this if I want to remind myself that I'm about to edit or overwrite critical data...   answer = input("Do you want to continue? (yes/no): ").lower() if answer == "yes" or answer == "y": print("Continuing...") # Add your code here for further execution else: print("Exiting...") sys.exit() ... View more