Hi, so here's what I'm trying to do. I have a parent folder, which I'm calling my workspace. Under that folder are several subfolders, each containing one file geodatabase. Each file geodatabase contains unique feature datasets that I'm trying to merge into one final file geodatabase. I'm stuck at building the list of the feature datasets. Here's the code in question: folder = "C:\\Temp\\Extracted" walk = arcpy . da . Walk ( folder , datatype = "FeatureDataset" ) for dirpath , workspaces , datatypes in walk : for datatype in datatypes : print ( datatype ) This code yields *everything* in the subdirectory structure down to the feature dataset level. It lists all folder names, all file geodatabases at the .gdb level, and all feature datasets. What I'm trying to do is get a list back of *only* feature datasets. Can someone tell me where I'm going wrong?

Joshua, sorry for the lateness of this reply but I figured I'd chime in and close the loop for anyone who may stumble on this question later. The way I fixed this was to basically check for file geodatabases first, feature datasets second, and feature classes last, extracting each to their own list. It is certainly inelegant but it gives me reliable results. So it looks a bit like... gdbList = [] fdList = [] for paths, subdirs, names in os.walk(workingPath): for subdir in subdirs: if subdir[-4:] == '.gdb': gdbName = os.path.join(paths, subdir) gdbList.append(gdbName) for fgdb in gdbList: walk = arcpy.da.Walk(fgdb, datatype="FeatureDataset") for fd in walk: if fd[0][-4:] not in '.gdb': fdList.append(fd[0]) Basically I'm building lists through brute-force string checking.

I try to avoid using the datatype parameter of arcpy.da.Walk if possible because the definitions of those data types are poorly documented. As you describe, "FeatureDataset" returns not only feature datasets but also subfolders within a folder. With ArcGIS 10.4.x, they finally removed the "Geo" option after I kept asking for a clear definition since the results were strange, to say the least, when using it. My fuller code snippet should work for you because I am testing whether Walk is already in a file geodatabase before looking at the folders returned, which will be datasets of one kind or another. If you have multiple kinds of datasets (FeatureDataset, RasterDataset, etc...) and only want a particular kind, the script can be modified to use arcpy.Describe to narrow down the results even further.

Sorry Joshua, I mis-typed there - I edited my response to make it more accurate. My issue is that even though I have da.Walk limited to a datatype="FeatureDataset", it doesn't list only feature datasets. It lists folders, geodatabases, AND feature datasets.

nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Using da.Walk to discover feature datasets throughout a series of subfolders

EricEagle

Hi, so here's what I'm trying to do. I have a parent folder, which I'm calling my workspace. Under that folder are several subfolders, each containing one file geodatabase. Each file geodatabase contains unique feature datasets that I'm trying to merge into one final file geodatabase.

I'm stuck at building the list of the feature datasets. Here's the code in question:

folder <SPAN class="operator token">=</SPAN> <SPAN class="string token">"C:\\Temp\\Extracted"</SPAN>

walk <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>da<SPAN class="punctuation token">.</SPAN>Walk<SPAN class="punctuation token">(</SPAN>folder<SPAN class="punctuation token">,</SPAN> datatype<SPAN class="operator token">=</SPAN><SPAN class="string token">"FeatureDataset"</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> dirpath<SPAN class="punctuation token">,</SPAN> workspaces<SPAN class="punctuation token">,</SPAN> datatypes <SPAN class="keyword token">in</SPAN> walk<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> datatype <SPAN class="keyword token">in</SPAN> datatypes<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN>datatype<SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

This code yields *everything* in the subdirectory structure down to the feature dataset level. It lists all folder names, all file geodatabases at the .gdb level, and all feature datasets.

What I'm trying to do is get a list back of *only* feature datasets. Can someone tell me where I'm going wrong?

Encuentra más publicaciones etiquetadas con

Accepted answers

All comments

JoshuaBixby

You have a Python3 print statement. Are you using ArcPy that comes with ArcGIS Pro?

When I run your code in ArcCatalog, as is but with a different starting directory, it prints nothing.

Christian_Wells

Here is the steps on adding code blocks to GeoNet:

https://community.esri.com/people/huffmanp/blog/2014/07/08/how-do-we-add-code-blocks-in-this-new-forum

To add to bixb0012‌ comments, can you post the output of your script, perhaps in a txt file?

EricEagle

Joshua,

Yeah, so I'm actually using this in Spyder outside of ArcMap, just calling arcpy as another library so the python3 print statements work fine.

I've updated the code a bit further to this:

folder <SPAN class="operator token">=</SPAN> <SPAN class="string token">"C:\\Temp\\Extracted"</SPAN>
gdbList <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>

<SPAN class="keyword token">for</SPAN> paths<SPAN class="punctuation token">,</SPAN> subdirs<SPAN class="punctuation token">,</SPAN> names <SPAN class="keyword token">in</SPAN> os<SPAN class="punctuation token">.</SPAN>walk<SPAN class="punctuation token">(</SPAN>folder<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> subdir <SPAN class="keyword token">in</SPAN> subdirs<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> name <SPAN class="keyword token">in</SPAN> subdirs<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> name<SPAN class="punctuation token">.</SPAN>endswith<SPAN class="punctuation token">(</SPAN><SPAN class="string token">".gdb"</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fullName <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>paths<SPAN class="punctuation token">,</SPAN> name<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; gdbList<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>fullName<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"Appended {} to gdbList"</SPAN><SPAN class="punctuation token">.</SPAN>format<SPAN class="punctuation token">(</SPAN>fullName<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="keyword token">else</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; fdList <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> fgdb <SPAN class="keyword token">in</SPAN> gdbList<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; walk <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>da<SPAN class="punctuation token">.</SPAN>Walk<SPAN class="punctuation token">(</SPAN>fgdb<SPAN class="punctuation token">,</SPAN> datatype<SPAN class="operator token">=</SPAN><SPAN class="string token">"FeatureDataset"</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> fd <SPAN class="keyword token">in</SPAN> walk<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fdList<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>fd<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">else</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN>fdList<SPAN class="punctuation token">)</SPAN>‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

The problem now is that the feature dataset list (fdList) contains the full path including the geodatabase in the following format returned in a list of tuples. The way they are formatted is as follows:

[(u'C:\\Temp\\Extracted\\dir1\\geodatabase01.gdb', [u'Water_Network'], []), (u'C:\\Temp\\Extracted\\dir1\\geodatabase01.gdb\\Water_Network', [], []), (u'C:\\Temp\\Extracted\\dir2\\geodatabase02.gdb', [u'Electric_Network'], []), (u'C:\\Temp\\Extracted\\dir2\\geodatabase02.gdb\\Electric_Network', [], []), (and so on.....)

Again what I'm trying to do is to isolate the feature dataset here and use arcpy copy management to copy it all into a consolidated file geodatabase. I feel like I'm close but missing some glue here, because I can't iterate the copy_management through the fdList object yet.

(edited for a more thorough example of the output)

DanPatterson_Retired

Christian as well /blogs/dan_patterson/2016/08/14/script-formatting beyond the basic stuff as well

JoshuaBixby

Assuming you only want to copy feature datasets, and not feature classes in the GDBs, what about the following (haven't fully tested😞

folder <SPAN class="operator token">=</SPAN> <SPAN class="comment token"># path to starting directory</SPAN>
dst_gdb <SPAN class="operator token">=</SPAN> <SPAN class="comment token"># path to destination gdb</SPAN>
walk <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>da<SPAN class="punctuation token">.</SPAN>Walk<SPAN class="punctuation token">(</SPAN>folder<SPAN class="punctuation token">)</SPAN>
<SPAN class="keyword token">for</SPAN> root<SPAN class="punctuation token">,</SPAN> dirs<SPAN class="punctuation token">,</SPAN> files <SPAN class="keyword token">in</SPAN> walk<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> root<SPAN class="punctuation token">.</SPAN>endswith<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'.gdb'</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> dir <SPAN class="keyword token">in</SPAN> dirs<SPAN class="punctuation token">:</SPAN>&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; arcpy<SPAN class="punctuation token">.</SPAN>Copy_management<SPAN class="punctuation token">(</SPAN>os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>root<SPAN class="punctuation token">,</SPAN> dir<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>dst_gdb<SPAN class="punctuation token">,</SPAN> dir<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

DanPatterson_Retired

FYI to all... the print statement works fine in 2.7 as well as in the 3.x series and has for the last 7 (?) years. Get used to it, you will need to use 3.x-ish for work in Pro and arcmap in upcoming versions.

JoshuaBixby

You think they will migrate ArcMap to Python 3.x? You are a more hopeful man than I.

EricEagle

The problem with this is that each file geodatabase is in its own subdirectory. So when I use da.Walk and list dirs, it lists OS subdirectories and geodatabases in the results alongside the feature datasets. Please see my updated code and the updated output I've listed. At this point I'm just trying to figure out how to do copy management given the tuples I'm being returned.

Únete a la Conversación

Los miembros registrados pueden publicar, seguir actualizaciones y más. ¿Nuevo aquí? Regístrate gratis.

Enlaces Rápidos

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.