Latest Contributions by PeterWilson

Hi Curtis Thanks for the following. I'm currently reading up on sys.path to better understand how it works as well as virtualenv\virtualenvwrapper. I'll post my workflow once I've got it working as I'm also going to be using GitHub for version management of my code. ... View more

Hi Dan Thanks for the following. I'll work through it tonight and get back to you tomorrow. ... View more

Hi Dan I'll go through the following and post my code. Will most like come back to you with some questions regarding summarizing the new classes based on above. ... View more

Hi Blake Thanks for the following, looks great. I'll post my final code using Data Access Module and NumPy for comparison. ... View more

Hi Dan Thanks for the reply. In this case each record is unique. The original table is a summary of the number of buildings that was found within each service area interval (i.e. TIME5 = 0 - 5min, TIME10 = 5 - 10min etc.) This time around I'm sumarising the percentage of total buildings found within each new time interval (i.e. TIME0_15min = 0 - 15min etc.). For the unique columns could I use the OBJECTID? How do I go about collapsing the columns to generate the new time intervals based on the following? With regards to the Q's The number of records are reasonably small, but I'll be running the following regularly for different study areas. Yes, I'd like to generate graphs but would like them displayed in ArcMap as part of my Data Driven Pages at a later stage. Not at this stage I'm looking at using OpenPyXL to write the final table out to Excel based on a predifined template for various social facility types (i.e. Schools, Health Facilities, Community Services, Recreation Facilities etc.) ... View more

Thanks Dan, much appreciated ... View more

Hi Dan I've used the code example within your "Observation_Summary_1.pdf" and understand the most of your code, but if you wouldn't mind unpacking from  Line 45 to 50. I'm unsure if line 45 is a list comprehension of some sort and not understanding the how its working. # coding: utf-8 """ Dan Patterson: Numpy Pivot Table Summary 16/05/2016 """ # import site-packages and modules import numpy as np import arcpy # set input summary table input_table = r"E:\Projects\2016\G112224\Models\Schools\Schools_Combined_160505.gdb\De_Villiers_Graaff_Hs_SAA_Stats" output_gdb = r"E:\Python\Testing\dan_patterson_numpy\SAA_Summary_Report_Testing.gdb" # numpy pivot table function def pivot_summary(input_table, output_gdb):     # convert summary table to structured numpy array     numpy_fields = ("OBJECTID", "TOWN", "SETTLEMENTNAME",                     "NAME", "TIME", "FREQUENCY")     sum_array = arcpy.da.TableToNumPyArray(input_table, numpy_fields)  # @UndefinedVariable     # obtain unique records based on first three columns     unique_records = np.unique(sum_array[['TOWN', 'SETTLEMENTNAME', 'NAME']])     # number of unique rows     shp = len(unique_records)     # construct the output array     dt = [('TOWN', 'U20'), ('SETTLEMENTNAME', 'U20'), ('NAME', 'U20'),           ('TIME5', np.int32), ('TIME10', np.int32), ('TIME15', np.int32),           ('TIME20', np.int32), ('TIME25', np.int32), ('TIME30', np.int32),           ('TIME60', np.int32)]     # populate array with zeros     pivot_array = np.zeros(shp, dtype=dt)     # assign the first three columns     pivot_array['TOWN'] = unique_records['TOWN']     # the values from the unique test     pivot_array['SETTLEMENTNAME'] = unique_records['SETTLEMENTNAME']     # everything is sorted     pivot_array['NAME'] = unique_records['NAME']     # loop through unique records array     for i in range(shp):         # pull out the rows that match         row_match = sum_array[sum_array[['TOWN', 'SETTLEMENTNAME',                                         'NAME']] == unique_records]         for j in range(len(row_match)):             column = 'TIME' + str(row_match ['TIME'])             buildings = row_match ['FREQUENCY']             pivot_array[column] = buildings     pivot_table = "{0}\\{1}".format(output_gdb, "Pivot_Table_Summary")     arcpy.da.NumPyArrayToTable(pivot_array, pivot_table)  # @UndefinedVariable     return pivot_table pivot_table = pivot_summary(input_table, output_gdb) Thanks for your help Dan ... View more

Hi Devin I wrote the following python script to copy the datasets (feature classes & rasters) for each mxd within a folder into a new File Geodatabase. You could use the following as a starting point and instead of copy it out write the location of the layers (feature classes and rasters) into a summary table. ''' Created on Jan 20, 2016 Copy all feature classes and rasters from each mxd in a folder into a new File Geodatabase. @author: PeterW ''' import os import time import arcpy # set arguments folder = arcpy.GetParameterAsText(0) out_gdb = arcpy.GetParameterAsText(1) # folder = arcpy.GetParameterAsText(0) # out_gdb = arcpy.GetParameterAsText(1) # Processing time def hms_string(sec_elapsed):     h = int(sec_elapsed / (60 * 60))     m = int(sec_elapsed % (60 * 60) / 60)     s = sec_elapsed % 60     return "{}h:{:>02}m:{:>05.2f}s".format(h, m, s) start_time1 = time.time() # copy layers function def copy_features():     try:         if arcpy.Exists(os.path.join(out_gdb, layer.datasetName)):             arcpy.AddMessage("Feature class already exists, it will be skipped")         else:             arcpy.FeatureClassToGeodatabase_conversion(lyr_source, out_gdb)     except:         arcpy.AddMessage("Error copying: " + layer.name)         arcpy.AddError(arcpy.GetMessages()) def copy_rasters():     try:         if arcpy.Exists(os.path.join(out_gdb, layer.datasetName)):             arcpy.AddMessage("Raster already exists, it will be skipped")         else:             out_raster = os.path.join(out_gdb, layer.datasetName)             arcpy.CopyRaster_management(lyr_source, out_raster)     except:         arcpy.AddMessage("Error copying: " + layer.name)         arcpy.AddError(arcpy.GetMessages()) # Loop through each data frame, layer and copy to new file geodatabase for filename in os.listdir(folder):     fullpath = os.path.join(folder, filename)     if os.path.isfile(fullpath):         basename, extension = os.path.splitext(fullpath)         if extension.lower() == ".mxd":             arcpy.AddMessage("Processing: " + basename)             mxd = arcpy.mapping.MapDocument(fullpath)             dfs = arcpy.mapping.ListDataFrames(mxd)             for df in dfs:                 arcpy.AddMessage("DataFrame: " + df.name)                 layers = arcpy.mapping.ListLayers(mxd, "", df)                 for layer in layers:                     if layer.isFeatureLayer:                         lyr_source = layer.dataSource                         lyr_name = layer.name.encode("utf8", "replace")                         arcpy.AddMessage("Copying: {}".format(lyr_name))                         copy_features()                     if layer.isRasterLayer:                         lyr_source = layer.dataSource                         lyr_name = layer.name.encode("utf8", "replace")                         arcpy.AddMessage("Copying: {}".format(lyr_name))                         copy_rasters() # Determine the time take to copy features end_time1 = time.time() print ("It took {} to copy all layers to file geodatabase".format(hms_string(end_time1 - start_time1))) Let me know if you need help amending the following to meet you needs. ... View more

Hi Joshua The  "spaces" and "," are required between the strings i.e. "Rivers, Wetlands". The removal of the "spaces" and "," are those at the end of the concatenated string i.e. "Rivers, Wetlands,space" ... View more

Hi Dan The following dealt with both the "space" and "," thanks so much Regards ... View more

Thanks Dan Was just thinking about that. I was considering using a nested if statement to test the length of records for each row to remove the  "space" after the "," where there is only one item and to remove the "," at the end. ... View more

Hi Dan I've used slicing to select the correct fields that are defined within my UpdateCursor as the fields are made up of: "TYPE_RIV", "TYPE_WET", "TYPE_CBA" (input to good) "ENVIRO_TYPE" (output field to be populated) field_name = "ENVIRO_TYPE" arcpy.AddField_management(union_name, "ENVIRO_TYPE", "TEXT", field_length=100) enviro_fields = [f.name for f in arcpy.ListFields(union_name, "TYPE*", "TEXT")] enviro_fields.append(field_name) with arcpy.da.UpdateCursor(union_name, enviro_fields )as upcur:  # @UndefinedVariable     for row in upcur:         good = [val for val in list(row[:-1]) if val not in["", None]]         frmt = ("{}, "*len(good)).format(*good)         row[-1] = frmt         upcur.updateRow(row)         print row[-1] Thanks for all the help. ... View more

Hi Dan The problem is that I'm not sure how to get the field values without having to specify the field index and the last field row[2] = ""ENVIRO_TYPE", is the field I need to update. row[0] = "TYPE_RIV", row[1] = "TYPE_WET" this time but it won't always be the case. Any suggestions welcome Print Statement: # environmental features within each settlement def environmental_features(enviro_input):     enviro_intersect = []     for fcs in enviro_input:         orig_name = arcpy.Describe(fcs).name         input_features = ["Settlements_Amended", orig_name]         intersect_name = "{0}\\{1}_int".format("in_memory", orig_name)         arcpy.Intersect_analysis(input_features, intersect_name)         enviro_intersect.append(intersect_name)     merge_name = "{0}\\{1}_merge".format("in_memory", "Environmental")     arcpy.Merge_management(enviro_intersect, merge_name)     diss_name = "{0}\\{1}_diss".format("in_memory", "Environmental")     arcpy.Union_analysis(merge_name, diss_name, "ALL")     field_name = "ENVIRO_TYPE"     arcpy.AddField_management(diss_name, "ENVIRO_TYPE",                               "TEXT",                               field_length=100)     field_names = [f.name for f in arcpy.ListFields(diss_name, "TYPE*", "TEXT")]     cur_fields = list(field_names)     cur_fields.append(field_name)     print cur_fields     with arcpy.da.UpdateCursor(diss_name, cur_fields)as ucur:  # @UndefinedVariable         for row in ucur:             print row[0], row[1], row[2] Python Code: ... View more