Latest Contributions by PeterWilson

I' have extracted 2000 random building footprints within my study area and need to group the following points into optimal clusters to divide the study area for the 24 surveyors (x24 Tablets). We have 8 days to complete the survey and have roughly determined that it would take 45 minutes to survey a house, including walking from the previous house. The house locations are spread over the study area and have high and low clusters, which need to be taken into account. Any suggestions or methodologies that I could use to generate the clusters to group the points to split the study area up for the surveyors will be appreciated. I've tried used the Group Analysis tool within ArcGIS with little to no success as I have no attributes to use for any commonality between the points. ... View more

I have recently started learning more about Python Packages and Modules. I'm currently busy updating my existing modules so that that can be run as script or imported as a module into my other code. I'm not sure how to construct my input arguments within my module and pass them to the main() function within my module. I've have written my my main() function and called it under if __name__ == '__main__' passing the input arguments. The inputs are currently hard coded to show what I'm trying to achieve. Any help in how to correctly construct my input arguments that the user will pass, which will then be passed onto the main function will be appreciated. As mentioned I'm trying to be able to use the following as a script when used directly or imported as a module into my other code and run from there. If I import it as a module would I call the main() function when importing it? Is the following structure correct in how I have written the following? Any advice is appreciated. ''' Created on March 12, 2017 Create a new ArcHydro Schema File Geodatabase and Rasters Folder @author: PeterW ''' # import site-packages and modules import re from pathlib import Path import arcpy # set environment settings arcpy.env.overwriteOutput = True def archydro_rasters_folder(workspace):     """Create rasters folder directory     if it doens't already exist"""     model_name = Path(workspace).name     layers_name = re.sub(r"\D+", "Layers", model_name)     layers_folder = Path(workspace, layers_name)     if layers_folder.exists():         arcpy.AddMessage("Rasters folder: {0} exists".format(layers_name))     else:         layers_folder.mkdir(parents=True)         arcpy.AddMessage("Rasters folder {0} created".format(layers_name)) def archydro_fgdb_schema(schema, dem, workspace):     """Create file geodatabase using XML     schema and set coordinate system based     on input DEM if it doesn't already exist"""     model_name = Path(workspace).name     fgdb = "{0}.gdb".format(model_name)     if arcpy.Exists(str(Path(workspace, fgdb))):         arcpy.AddMessage("{0} file geodatabase exists".format(fgdb))     else:         new_fgdb = arcpy.CreateFileGDB_management(str(workspace), fgdb)         import_type = "SCHEMA_ONLY"         config_keyword = "DEFAULTS"         arcpy.AddMessage("New {0} file geodatabase created".format(fgdb))         arcpy.ImportXMLWorkspaceDocument_management(new_fgdb, schema,                                                     import_type,                                                     config_keyword)         arcpy.AddMessage("ArcHydro schema imported")         projection = arcpy.Describe(dem).spatialReference         projection_name = projection.PCSName         feature_dataset = Path(workspace, fgdb, "Layers")         arcpy.DefineProjection_management(str(feature_dataset),                                           projection)         arcpy.AddMessage("Changed projection to {0}".format(projection_name)) def main(workspace, dem, schema):     """main function to create rasters folder     and file geodatabase"""     archydro_rasters_folder(workspace)     archydro_fgdb_schema(schema, dem, workspace) if __name__ == '__main__':     main(workspace = r"E:\Projects\2016\01_Bertrand_Small_Projects\G113268\ArcHydro\Model04",          dem = r"E:\Projects\2016\01_Bertrand_Small_Projects\G113268\ArcHydro\DEM2\raw",          schema = r"E:\Python\Masters\Schema\ESRI_UC12\ModelBuilder\Schema\Model01.xml") ‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ ... View more

from fnmatch import fnmatch, filter from os.path import isdir, join from shutil import copytree def include_patterns(*patterns):     """Factory function that can be used with copytree() ignore parameter.     Arguments define a sequence of glob-style patterns     that are used to specify what files to NOT ignore.     Creates and returns a function that determines this for each directory     in the file hierarchy rooted at the source directory when used with     shutil.copytree().     """     def _ignore_patterns(path, names):         keep = set(name for pattern in patterns                             for name in filter(names, pattern))         ignore = set(name for name in names                         if name not in keep and not isdir(join(path, name)))         return ignore     return _ignore_patterns # sample usage copytree(src_directory, dst_directory,          ignore=include_patterns('*.dwg', '*.dxf'))‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ I have found the following Python Factory Function on Stack Overflow that uses Python shutil.copytree to copy the directory and files based on the inverse of the ignore argument. It adds all file types that are not part of the include_patterns("*.dwg", "*.dxf"). The problem is that it's copying directories where there are no CAD files and resulting in empty directories. The link to the Stack Overflow post is: post Solution: I've found a very simple solution of removing the empty directories with some amendments. ''' Created on 27 Feb 2017 Extract CAD files from within all directories @author: PeterW ''' # import site-packages and modules from fnmatch import filter from os.path import isdir, join from shutil import copytree, rmtree from os import listdir, rmdir, walk import errno # set arguments input_folder = r"H:\Tanzania" output_folder = r"E:\CAD" # create ignore patterns dynamically based on include patterns def include_patterns(*patterns):     def _ignore_patterns(path, names):         keep = set(name for pattern in patterns for name in filter(names, pattern))         ignore = set(name for name in names if name not in keep and not isdir(join(path, name)))         return ignore     return _ignore_patterns # copy directory structure and files based on pattern def copytree_files(input_folder, output_folder):     if isdir(output_folder):         rmtree(output_folder)     copytree(input_folder, output_folder, ignore=include_patterns("*.dwg", "*.dxf")) copytree_files(input_folder, output_folder) # remove empty directories def remove_empty_dirs(output_folder):     dirs = [x[0] for x in walk(output_folder, topdown=False)]     for dir in dirs:         try:             rmdir(dir)         except Exception as e:             if e.errno == errno.ENOTEMPTY:                 print("Directory: {0} not empty".format(dir)) remove_empty_dirs(output_folder) ‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ I found an additional solution that could work from a solution provided on Stack Overflow, but due to time constraints I wasn't able to get it to work: How do I copy an entire directory of files into an existing directory using Python? Mital Vora provided the following solution: def copytree(src, dst, symlinks=False, ignore=None):     if not os.path.exists(dst):         os.makedirs(dst)     for item in os.listdir(src):         s = os.path.join(src, item)         d = os.path.join(dst, item)         if os.path.isdir(s):             copytree(s, d, symlinks, ignore)         else:             if not os.path.exists(d) or os.stat(s).st_mtime - os.stat(d).st_mtime > 1:                 shutil.copy2(s, d)‍‍‍‍‍‍‍‍‍‍‍ The idea of the following was to create a list of directories that contain CAD drawings thereby eliminating the need of removing empty directories afterwards: Incomplete Solution: ''' Created on 27 Feb 2017 Extract CAD files from within all directories @author: PeterW ''' # import site-packages and modules from fnmatch import fnmatch, filter import os from os.path import isdir, join from shutil import copytree, copy2 # set arguments input_folder = r"H:\Tanzania\fromDropbox\Infrastructure" output_folder = r"E:\CAD" def directories_list(input_folder):     dirs_list = []     for root, dirs, files in os.walk(input_folder):         if any(file.endswith('.dwg') or file.endswith('.dxf') for file in files):             dirs_list.append(os.path.abspath(root))     return dirs_list dirs_list = directories_list(input_folder) # function def include_patterns(*patterns):     def _ignore_patterns(path, names):         keep = set(name for pattern in patterns for name in filter(names, pattern))         ignore = set(name for name in names if name not in keep and not isdir(join(path, name)))         return ignore     return _ignore_patterns # relook at the following, its not working as expected # due to copytree limitation of existing directory exists # after first loop def copytree_files(dirs_list, output_folder):     if not os.path.exists(output_folder):         os.makedirs(output_folder)     for dir in dirs_list:         for item in os.listdir(dir):             s = os.path.join(dir, item)             d = os.path.join(output_folder, item)             if os.path.isdir(s):                 copytree(s, d, ignore=include_patterns('*.dwg', "*.dxf"))             else:                 if not os.path.exists(d) or os.stat(s).st_mtime - os.stat(d).st_mtime > 1:                     copy2(s, d) copytree_files(dirs_list, input_folder)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ ... View more