from fnmatch import fnmatch , filter from os . path import isdir , join from shutil import copytree def include_patterns ( * patterns ) : """Factory function that can be used with copytree() ignore parameter. Arguments define a sequence of glob-style patterns that are used to specify what files to NOT ignore. Creates and returns a function that determines this for each directory in the file hierarchy rooted at the source directory when used with shutil.copytree(). """ def _ignore_patterns ( path , names ) : keep = set ( name for pattern in patterns for name in filter ( names , pattern ) ) ignore = set ( name for name in names if name not in keep and not isdir ( join ( path , name ) ) ) return ignore return _ignore_patterns # sample usage copytree ( src_directory , dst_directory , ignore = include_patterns ( '*.dwg' , '*.dxf' ) ) I have found the following Python Factory Function on Stack Overflow that uses Python shutil.copytree to copy the directory and files based on the inverse of the ignore argument. It adds all file types that are not part of the include_patterns("*.dwg", "*.dxf"). The problem is that it's copying directories where there are no CAD files and resulting in empty directories. The link to the Stack Overflow post is: post Solution: I've found a very simple solution of removing the empty directories with some amendments. ''' Created on 27 Feb 2017 Extract CAD files from within all directories @author: PeterW ''' # import site-packages and modules from fnmatch import filter from os . path import isdir , join from shutil import copytree , rmtree from os import listdir , rmdir , walk import errno # set arguments input_folder = r "H:\Tanzania" output_folder = r "E:\CAD" # create ignore patterns dynamically based on include patterns def include_patterns ( * patterns ) : def _ignore_patterns ( path , names ) : keep = set ( name for pattern in patterns for name in filter ( names , pattern ) ) ignore = set ( name for name in names if name not in keep and not isdir ( join ( path , name ) ) ) return ignore return _ignore_patterns # copy directory structure and files based on pattern def copytree_files ( input_folder , output_folder ) : if isdir ( output_folder ) : rmtree ( output_folder ) copytree ( input_folder , output_folder , ignore = include_patterns ( "*.dwg" , "*.dxf" ) ) copytree_files ( input_folder , output_folder ) # remove empty directories def remove_empty_dirs ( output_folder ) : dirs = [ x [ 0 ] for x in walk ( output_folder , topdown = False ) ] for dir in dirs : try : rmdir ( dir ) except Exception as e : if e . errno == errno . ENOTEMPTY : print ( "Directory: {0} not empty" . format ( dir ) ) remove_empty_dirs ( output_folder ) I found an additional solution that could work from a solution provided on Stack Overflow, but due to time constraints I wasn't able to get it to work: How do I copy an entire directory of files into an existing directory using Python? Mital Vora provided the following solution: def copytree ( src , dst , symlinks = False , ignore = None ) : if not os . path . exists ( dst ) : os . makedirs ( dst ) for item in os . listdir ( src ) : s = os . path . join ( src , item ) d = os . path . join ( dst , item ) if os . path . isdir ( s ) : copytree ( s , d , symlinks , ignore ) else : if not os . path . exists ( d ) or os . stat ( s ) . st_mtime - os . stat ( d ) . st_mtime > 1 : shutil . copy2 ( s , d ) The idea of the following was to create a list of directories that contain CAD drawings thereby eliminating the need of removing empty directories afterwards: Incomplete Solution: ''' Created on 27 Feb 2017 Extract CAD files from within all directories @author: PeterW ''' # import site-packages and modules from fnmatch import fnmatch , filter import os from os . path import isdir , join from shutil import copytree , copy2 # set arguments input_folder = r "H:\Tanzania\fromDropbox\Infrastructure" output_folder = r "E:\CAD" def directories_list ( input_folder ) : dirs_list = [ ] for root , dirs , files in os . walk ( input_folder ) : if any ( file . endswith ( '.dwg' ) or file . endswith ( '.dxf' ) for file in files ) : dirs_list . append ( os . path . abspath ( root ) ) return dirs_list dirs_list = directories_list ( input_folder ) # function def include_patterns ( * patterns ) : def _ignore_patterns ( path , names ) : keep = set ( name for pattern in patterns for name in filter ( names , pattern ) ) ignore = set ( name for name in names if name not in keep and not isdir ( join ( path , name ) ) ) return ignore return _ignore_patterns # relook at the following, its not working as expected # due to copytree limitation of existing directory exists # after first loop def copytree_files ( dirs_list , output_folder ) : if not os . path . exists ( output_folder ) : os . makedirs ( output_folder ) for dir in dirs_list : for item in os . listdir ( dir ) : s = os . path . join ( dir , item ) d = os . path . join ( output_folder , item ) if os . path . isdir ( s ) : copytree ( s , d , ignore = include_patterns ( '*.dwg' , "*.dxf" ) ) else : if not os . path . exists ( d ) or os . stat ( s ) . st_mtime - os . stat ( d ) . st_mtime > 1 : copy2 ( s , d ) copytree_files ( dirs_list , input_folder )

nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Python Shutil.copytree: Dont copy empty directories

PeterWilson

<SPAN class="keyword token">from</SPAN> fnmatch <SPAN class="keyword token">import</SPAN> fnmatch<SPAN class="punctuation token">,</SPAN> filter
<SPAN class="keyword token">from</SPAN> os<SPAN class="punctuation token">.</SPAN>path <SPAN class="keyword token">import</SPAN> isdir<SPAN class="punctuation token">,</SPAN> join
<SPAN class="keyword token">from</SPAN> shutil <SPAN class="keyword token">import</SPAN> copytree

<SPAN class="keyword token">def</SPAN> <SPAN class="token function">include_patterns</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="operator token">*</SPAN>patterns<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="string token">"""Factory function that can be used with copytree() ignore parameter.

&nbsp;&nbsp;&nbsp; Arguments define a sequence of glob-style patterns
&nbsp;&nbsp;&nbsp; that are used to specify what files to NOT ignore.
&nbsp;&nbsp;&nbsp; Creates and returns a function that determines this for each directory
&nbsp;&nbsp;&nbsp; in the file hierarchy rooted at the source directory when used with
&nbsp;&nbsp;&nbsp; shutil.copytree().
&nbsp;&nbsp;&nbsp; """</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">def</SPAN> <SPAN class="token function">_ignore_patterns</SPAN><SPAN class="punctuation token">(</SPAN>path<SPAN class="punctuation token">,</SPAN> names<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; keep <SPAN class="operator token">=</SPAN> set<SPAN class="punctuation token">(</SPAN>name <SPAN class="keyword token">for</SPAN> pattern <SPAN class="keyword token">in</SPAN> patterns
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> name <SPAN class="keyword token">in</SPAN> filter<SPAN class="punctuation token">(</SPAN>names<SPAN class="punctuation token">,</SPAN> pattern<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ignore <SPAN class="operator token">=</SPAN> set<SPAN class="punctuation token">(</SPAN>name <SPAN class="keyword token">for</SPAN> name <SPAN class="keyword token">in</SPAN> names
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> name <SPAN class="operator token">not</SPAN> <SPAN class="keyword token">in</SPAN> keep <SPAN class="operator token">and</SPAN> <SPAN class="operator token">not</SPAN> isdir<SPAN class="punctuation token">(</SPAN>join<SPAN class="punctuation token">(</SPAN>path<SPAN class="punctuation token">,</SPAN> name<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> ignore
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> _ignore_patterns

<SPAN class="comment token"># sample usage</SPAN>

copytree<SPAN class="punctuation token">(</SPAN>src_directory<SPAN class="punctuation token">,</SPAN> dst_directory<SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ignore<SPAN class="operator token">=</SPAN>include_patterns<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'*.dwg'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'*.dxf'</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

I have found the following Python Factory Function on Stack Overflow that uses Python shutil.copytree to copy the directory and files based on the inverse of the ignore argument. It adds all file types that are not part of the include_patterns("*.dwg", "*.dxf"). The problem is that it's copying directories where there are no CAD files and resulting in empty directories.

The link to the Stack Overflow post is: post

Solution:

I've found a very simple solution of removing the empty directories with some amendments.

<SPAN class="string token">'''
Created on 27 Feb 2017

Extract CAD files

from within all 

directories

@author: PeterW
'''</SPAN>
<SPAN class="comment token"># import site-packages and modules</SPAN>
<SPAN class="keyword token">from</SPAN> fnmatch <SPAN class="keyword token">import</SPAN> filter
<SPAN class="keyword token">from</SPAN> os<SPAN class="punctuation token">.</SPAN>path <SPAN class="keyword token">import</SPAN> isdir<SPAN class="punctuation token">,</SPAN> join
<SPAN class="keyword token">from</SPAN> shutil <SPAN class="keyword token">import</SPAN> copytree<SPAN class="punctuation token">,</SPAN> rmtree
<SPAN class="keyword token">from</SPAN> os <SPAN class="keyword token">import</SPAN> listdir<SPAN class="punctuation token">,</SPAN> rmdir<SPAN class="punctuation token">,</SPAN> walk
<SPAN class="keyword token">import</SPAN> errno

<SPAN class="comment token"># set arguments</SPAN>
input_folder <SPAN class="operator token">=</SPAN> r<SPAN class="string token">"H:\Tanzania"</SPAN>
output_folder <SPAN class="operator token">=</SPAN> r<SPAN class="string token">"E:\CAD"</SPAN>


<SPAN class="comment token"># create ignore patterns dynamically based on include patterns</SPAN>
<SPAN class="keyword token">def</SPAN> <SPAN class="token function">include_patterns</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="operator token">*</SPAN>patterns<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">def</SPAN> <SPAN class="token function">_ignore_patterns</SPAN><SPAN class="punctuation token">(</SPAN>path<SPAN class="punctuation token">,</SPAN> names<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; keep <SPAN class="operator token">=</SPAN> set<SPAN class="punctuation token">(</SPAN>name <SPAN class="keyword token">for</SPAN> pattern <SPAN class="keyword token">in</SPAN> patterns <SPAN class="keyword token">for</SPAN> name <SPAN class="keyword token">in</SPAN> filter<SPAN class="punctuation token">(</SPAN>names<SPAN class="punctuation token">,</SPAN> pattern<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ignore <SPAN class="operator token">=</SPAN> set<SPAN class="punctuation token">(</SPAN>name <SPAN class="keyword token">for</SPAN> name <SPAN class="keyword token">in</SPAN> names <SPAN class="keyword token">if</SPAN> name <SPAN class="operator token">not</SPAN> <SPAN class="keyword token">in</SPAN> keep <SPAN class="operator token">and</SPAN> <SPAN class="operator token">not</SPAN> isdir<SPAN class="punctuation token">(</SPAN>join<SPAN class="punctuation token">(</SPAN>path<SPAN class="punctuation token">,</SPAN> name<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> ignore
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> _ignore_patterns


<SPAN class="comment token"># copy directory structure and files based on pattern</SPAN>
<SPAN class="keyword token">def</SPAN> <SPAN class="token function">copytree_files</SPAN><SPAN class="punctuation token">(</SPAN>input_folder<SPAN class="punctuation token">,</SPAN> output_folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> isdir<SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; rmtree<SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; copytree<SPAN class="punctuation token">(</SPAN>input_folder<SPAN class="punctuation token">,</SPAN> output_folder<SPAN class="punctuation token">,</SPAN> ignore<SPAN class="operator token">=</SPAN>include_patterns<SPAN class="punctuation token">(</SPAN><SPAN class="string token">"*.dwg"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"*.dxf"</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>

copytree_files<SPAN class="punctuation token">(</SPAN>input_folder<SPAN class="punctuation token">,</SPAN> output_folder<SPAN class="punctuation token">)</SPAN>


<SPAN class="comment token"># remove empty directories</SPAN>
<SPAN class="keyword token">def</SPAN> <SPAN class="token function">remove_empty_dirs</SPAN><SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; dirs <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN>x<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN> <SPAN class="keyword token">for</SPAN> x <SPAN class="keyword token">in</SPAN> walk<SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">,</SPAN> topdown<SPAN class="operator token">=</SPAN><SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">]</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> dir <SPAN class="keyword token">in</SPAN> dirs<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">try</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; rmdir<SPAN class="punctuation token">(</SPAN>dir<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">except</SPAN> Exception <SPAN class="keyword token">as</SPAN> e<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> e<SPAN class="punctuation token">.</SPAN>errno <SPAN class="operator token">==</SPAN> errno<SPAN class="punctuation token">.</SPAN>ENOTEMPTY<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"Directory: {0} not empty"</SPAN><SPAN class="punctuation token">.</SPAN>format<SPAN class="punctuation token">(</SPAN>dir<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>

remove_empty_dirs<SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">)</SPAN>
<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

I found an additional solution that could work from a solution provided on Stack Overflow, but due to time constraints I wasn't able to get it to work: How do I copy an entire directory of files into an existing directory using Python?

Mital Vora provided the following solution:

<SPAN class="keyword token">def</SPAN> <SPAN class="token function">copytree</SPAN><SPAN class="punctuation token">(</SPAN>src<SPAN class="punctuation token">,</SPAN> dst<SPAN class="punctuation token">,</SPAN> symlinks<SPAN class="operator token">=</SPAN><SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">,</SPAN> ignore<SPAN class="operator token">=</SPAN>None<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> <SPAN class="operator token">not</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>exists<SPAN class="punctuation token">(</SPAN>dst<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; os<SPAN class="punctuation token">.</SPAN>makedirs<SPAN class="punctuation token">(</SPAN>dst<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> item <SPAN class="keyword token">in</SPAN> os<SPAN class="punctuation token">.</SPAN>listdir<SPAN class="punctuation token">(</SPAN>src<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; s <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>src<SPAN class="punctuation token">,</SPAN> item<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; d <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>dst<SPAN class="punctuation token">,</SPAN> item<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>isdir<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; copytree<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">,</SPAN> d<SPAN class="punctuation token">,</SPAN> symlinks<SPAN class="punctuation token">,</SPAN> ignore<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">else</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> <SPAN class="operator token">not</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>exists<SPAN class="punctuation token">(</SPAN>d<SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">or</SPAN> os<SPAN class="punctuation token">.</SPAN>stat<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">.</SPAN>st_mtime <SPAN class="operator token">-</SPAN> os<SPAN class="punctuation token">.</SPAN>stat<SPAN class="punctuation token">(</SPAN>d<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">.</SPAN>st_mtime <SPAN class="operator token">></SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; shutil<SPAN class="punctuation token">.</SPAN>copy2<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">,</SPAN> d<SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

The idea of the following was to create a list of directories that contain CAD drawings thereby eliminating the need of removing empty directories afterwards:

Incomplete Solution:

<SPAN class="string token">'''
Created on 27 Feb 2017

Extract CAD files

from within all 

directories

@author: PeterW
'''</SPAN>
<SPAN class="comment token"># import site-packages and modules</SPAN>
<SPAN class="keyword token">from</SPAN> fnmatch <SPAN class="keyword token">import</SPAN> fnmatch<SPAN class="punctuation token">,</SPAN> filter
<SPAN class="keyword token">import</SPAN> os
<SPAN class="keyword token">from</SPAN> os<SPAN class="punctuation token">.</SPAN>path <SPAN class="keyword token">import</SPAN> isdir<SPAN class="punctuation token">,</SPAN> join
<SPAN class="keyword token">from</SPAN> shutil <SPAN class="keyword token">import</SPAN> copytree<SPAN class="punctuation token">,</SPAN> copy2

<SPAN class="comment token"># set arguments</SPAN>
input_folder <SPAN class="operator token">=</SPAN> r<SPAN class="string token">"H:\Tanzania\fromDropbox\Infrastructure"</SPAN>
output_folder <SPAN class="operator token">=</SPAN> r<SPAN class="string token">"E:\CAD"</SPAN>

<SPAN class="keyword token">def</SPAN> <SPAN class="token function">directories_list</SPAN><SPAN class="punctuation token">(</SPAN>input_folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; dirs_list <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> root<SPAN class="punctuation token">,</SPAN> dirs<SPAN class="punctuation token">,</SPAN> files <SPAN class="keyword token">in</SPAN> os<SPAN class="punctuation token">.</SPAN>walk<SPAN class="punctuation token">(</SPAN>input_folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> any<SPAN class="punctuation token">(</SPAN>file<SPAN class="punctuation token">.</SPAN>endswith<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'.dwg'</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">or</SPAN> file<SPAN class="punctuation token">.</SPAN>endswith<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'.dxf'</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">for</SPAN> file <SPAN class="keyword token">in</SPAN> files<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; dirs_list<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>abspath<SPAN class="punctuation token">(</SPAN>root<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> dirs_list

dirs_list <SPAN class="operator token">=</SPAN> directories_list<SPAN class="punctuation token">(</SPAN>input_folder<SPAN class="punctuation token">)</SPAN>

<SPAN class="comment token"># function</SPAN>
<SPAN class="keyword token">def</SPAN> <SPAN class="token function">include_patterns</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="operator token">*</SPAN>patterns<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">def</SPAN> <SPAN class="token function">_ignore_patterns</SPAN><SPAN class="punctuation token">(</SPAN>path<SPAN class="punctuation token">,</SPAN> names<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; keep <SPAN class="operator token">=</SPAN> set<SPAN class="punctuation token">(</SPAN>name <SPAN class="keyword token">for</SPAN> pattern <SPAN class="keyword token">in</SPAN> patterns <SPAN class="keyword token">for</SPAN> name <SPAN class="keyword token">in</SPAN> filter<SPAN class="punctuation token">(</SPAN>names<SPAN class="punctuation token">,</SPAN> pattern<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ignore <SPAN class="operator token">=</SPAN> set<SPAN class="punctuation token">(</SPAN>name <SPAN class="keyword token">for</SPAN> name <SPAN class="keyword token">in</SPAN> names <SPAN class="keyword token">if</SPAN> name <SPAN class="operator token">not</SPAN> <SPAN class="keyword token">in</SPAN> keep <SPAN class="operator token">and</SPAN> <SPAN class="operator token">not</SPAN> isdir<SPAN class="punctuation token">(</SPAN>join<SPAN class="punctuation token">(</SPAN>path<SPAN class="punctuation token">,</SPAN> name<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> ignore
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> _ignore_patterns


<SPAN class="comment token"># relook at the following, its not working as expected</SPAN>
<SPAN class="comment token"># due to copytree limitation of existing directory exists</SPAN>
<SPAN class="comment token"># after first loop</SPAN>
<SPAN class="keyword token">def</SPAN> <SPAN class="token function">copytree_files</SPAN><SPAN class="punctuation token">(</SPAN>dirs_list<SPAN class="punctuation token">,</SPAN> output_folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> <SPAN class="operator token">not</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>exists<SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; os<SPAN class="punctuation token">.</SPAN>makedirs<SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> dir <SPAN class="keyword token">in</SPAN> dirs_list<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> item <SPAN class="keyword token">in</SPAN> os<SPAN class="punctuation token">.</SPAN>listdir<SPAN class="punctuation token">(</SPAN>dir<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; s <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>dir<SPAN class="punctuation token">,</SPAN> item<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; d <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>output_folder<SPAN class="punctuation token">,</SPAN> item<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>isdir<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; copytree<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">,</SPAN> d<SPAN class="punctuation token">,</SPAN> ignore<SPAN class="operator token">=</SPAN>include_patterns<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'*.dwg'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"*.dxf"</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">else</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> <SPAN class="operator token">not</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>exists<SPAN class="punctuation token">(</SPAN>d<SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">or</SPAN> os<SPAN class="punctuation token">.</SPAN>stat<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">.</SPAN>st_mtime <SPAN class="operator token">-</SPAN> os<SPAN class="punctuation token">.</SPAN>stat<SPAN class="punctuation token">(</SPAN>d<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">.</SPAN>st_mtime <SPAN class="operator token">></SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; copy2<SPAN class="punctuation token">(</SPAN>s<SPAN class="punctuation token">,</SPAN> d<SPAN class="punctuation token">)</SPAN>

copytree_files<SPAN class="punctuation token">(</SPAN>dirs_list<SPAN class="punctuation token">,</SPAN> input_folder<SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Find more posts tagged with

Accepted answers

bixb0012

One approach would be to recursively remove empty directories after you call copytree. Here is a Gist of some fairly simple, straightforward to do just that: Python Recursively Remove Empty Directories.

All comments

DanPatterson_Retired

Do not that there have been some changes to shutil in version 3.x

bixb0012

A second approach would be use subprocess to launch a native OS/shell command to copy what you want. For Windows, you could use Robocopy. Robocopy has lots of flags, including excluding the copying of empty directories.

bixb0012

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.