nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Get attributes from many shapefiles?

MichaelLenore1

I have a very large .gdb (15000+ shapefiles). I know that's unusually and impractially large, but it's the result of an iterative model. I need an Excel sheet with all of those shapefiles' attributes. I tried merging them but it's too many. Is there some other way?

Find more posts tagged with

Accepted answers

FilipKrál

Hi Michael,

More than 15000 feature classes in a geodatabase is indeed unusual. We could debate about how to avoid that situation in the first place, but that's not the point here. So let's focus on your question.

Let's assume that all your feature classes have the same attributes and that they are stored like this:

c:/my.gdb/fc1
c:/my.gdb/fc2
...
c:/my.gdb/fc15000
...<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

I would use the following code to merge attributes of all your feature classes into a csv file and then I'd try to open the csv file in Excel.

<SPAN class="keyword token">import</SPAN> arcpy
output_file <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'c:\my.csv'</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>workspace <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'c:\my.gdb'</SPAN>

feature_classes <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListFeatureClasses<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>

first_fc <SPAN class="operator token">=</SPAN> feature_classes<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN>
fieldnames <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN>f<SPAN class="punctuation token">.</SPAN>name <SPAN class="keyword token">for</SPAN> f <SPAN class="keyword token">in</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListFields<SPAN class="punctuation token">(</SPAN>first_fc<SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">if</SPAN> f<SPAN class="punctuation token">.</SPAN>type<SPAN class="punctuation token">.</SPAN>lower<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">!=</SPAN> <SPAN class="string token">'geometry'</SPAN><SPAN class="punctuation token">]</SPAN>
delimiter <SPAN class="operator token">=</SPAN> <SPAN class="string token">','</SPAN>

<SPAN class="keyword token">with</SPAN> open<SPAN class="punctuation token">(</SPAN>output_file<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'w'</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">as</SPAN> fl<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp; <SPAN class="comment token"># write header</SPAN>
&nbsp;&nbsp;&nbsp; fl<SPAN class="punctuation token">.</SPAN>write<SPAN class="punctuation token">(</SPAN>delimiter<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>fieldnames<SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">+</SPAN> <SPAN class="string token">"\n"</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp; <SPAN class="comment token"># append attributes from each feature class</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> fc <SPAN class="keyword token">in</SPAN> feature_classes<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">with</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>da<SPAN class="punctuation token">.</SPAN>SearchCursor<SPAN class="punctuation token">(</SPAN>fc<SPAN class="punctuation token">,</SPAN> fieldnames<SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">as</SPAN> sc<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> row <SPAN class="keyword token">in</SPAN> sc<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fl<SPAN class="punctuation token">.</SPAN>write<SPAN class="punctuation token">(</SPAN>delimiter<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>map<SPAN class="punctuation token">(</SPAN>str<SPAN class="punctuation token">,</SPAN> row<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">+</SPAN> <SPAN class="string token">'\n'</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">del</SPAN> row
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">del</SPAN> sc
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

If your attributes include some complicated strings or datetime objects, you will be in for a bit of headache with resolving those but the concept is there. Perhaps using tab ('\t') instead of a comma as a delimiter would help with that.

I wonder how long is it all going to take. Especially the ListFeatureClasses function call can take a while with that many feature classes.

Filip.

All comments

Lake_Worth_BeachAdmin

Correct, the test GDB I tried the script on contained FC that would NOT have the same field names so that makes sense.

thank you

FilipKrál

Hi Michael and Joseph,

The initial piece of code demonstrated how one would go around solving the problem but there are things one needs to add to make it more bulletproof. If I added them in the first place, the code would be too long and hard to understand.

One important assumption in the initial code is that all feature classes in the geodatabase have the same columns. Why else would you want to join them all into one result? I suspect Joseph is seeing the error because the script encountered a feature class that does not fit this assumption.

When it comes to empty feature classes, i.e. feature classes with no rows, the code the `for row in rows` loop should not raise an exception as long fc has all the expected columns. The subsequent `del row` statement may raise an exception though. You can to comment out the `del row` statement.

One way to deal with these strange cases is to add some try-except statements and handle the failing feature classes in some other way. I'll leave that up to you.

Cheers,

Filip.

Lake_Worth_BeachAdmin

I would wait to see what the script author has to say but I just ran this script on a file GDB on my work machine and got this result:

>>>
Listing feature classes...
Found 473 feature classes
[u'OBJECTID', u'Shape', u'FINALNAME', u'CHARACTR', u'created_user', u'created_date', u'last_edited_user', u'last_edited_date', u'Shape_Length', u'Shape_Area']
Writing to C:\Users\jhead\Desktop\SDE_FC_Attributes.csv
WATER_BODIES
STORM_CDM_LakeWorthStructures

Traceback (most recent call last):
File "C:\Users\jhead\Desktop\Scripts\ArcPy\List_Feature_Class_Attributes_GDB.py", line 24, in <module>
for row in sc:
RuntimeError: A column was specified that does not exist.
>>>

MichaelLenore1

Is there a way to get the script to skip blank FCs? There shouldn't be any but I can't be sure.

Lake_Worth_BeachAdmin

Correct. The code tells the script each feature has rows and to look at the rows. However if there is no row to look at it raises an error.

MichaelLenore1

Oh, I see, sorry. Sure enough, there's no data in that FC. I guess that's why it stopped?

Lake_Worth_BeachAdmin

FC 1783 has attributes to list? It saying there is no row it can find. Anything special about this fc?

MichaelLenore1

Stopped at 1783. I'm not sure what you mean about data - there is data for all of the feature classes in the source geodatabase, and there is also data in the generated csv, which is correct, as noted above. The csv has a line for each of the 1783 fcs and nothing more.

Lake_Worth_BeachAdmin

Which fc did it stop at? Is there any data there or is it all NULL/ blank?

MichaelLenore1

OK, I ran this again, as follows:

<SPAN class="keyword token">import</SPAN> arcpy
output_file <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'C:\Users\mlenore\Desktop\GIS_Working_Folder\Residential_model\bgs.csv'</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>workspace <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'C:\Users\mlenore\Desktop\GIS_Working_Folder\Residential_model\bgs_finished_2.gdb'</SPAN>
<SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"Listing feature classes..."</SPAN><SPAN class="punctuation token">)</SPAN>
feature_classes <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListFeatureClasses<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"Found {0} feature classes"</SPAN><SPAN class="punctuation token">.</SPAN>format<SPAN class="punctuation token">(</SPAN>len<SPAN class="punctuation token">(</SPAN>feature_classes<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
first_fc <SPAN class="operator token">=</SPAN> feature_classes<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN>
fieldnames <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN>f<SPAN class="punctuation token">.</SPAN>name <SPAN class="keyword token">for</SPAN> f <SPAN class="keyword token">in</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListFields<SPAN class="punctuation token">(</SPAN>first_fc<SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">if</SPAN> f<SPAN class="punctuation token">.</SPAN>type<SPAN class="punctuation token">.</SPAN>lower<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">!=</SPAN> <SPAN class="string token">'geometry'</SPAN><SPAN class="punctuation token">]</SPAN>
delimiter <SPAN class="operator token">=</SPAN> <SPAN class="string token">','</SPAN>
<SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN>fieldnames<SPAN class="punctuation token">)</SPAN> <SPAN class="comment token">#line 10</SPAN>
<SPAN class="keyword token">with</SPAN> open<SPAN class="punctuation token">(</SPAN>output_file<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'w'</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">as</SPAN> fl<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">'Writing to {0}'</SPAN><SPAN class="punctuation token">.</SPAN>format<SPAN class="punctuation token">(</SPAN>output_file<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
 
&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="comment token"># write header</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp; fl<SPAN class="punctuation token">.</SPAN>write<SPAN class="punctuation token">(</SPAN>delimiter<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>fieldnames<SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">+</SPAN> <SPAN class="string token">"\n"</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="comment token"># append attributes from each feature class</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> fc <SPAN class="keyword token">in</SPAN> feature_classes<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN>fc<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">with</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>da<SPAN class="punctuation token">.</SPAN>SearchCursor<SPAN class="punctuation token">(</SPAN>fc<SPAN class="punctuation token">,</SPAN> field_names<SPAN class="operator token">=</SPAN>fieldnames<SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">as</SPAN> sc<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> row <SPAN class="keyword token">in</SPAN> sc<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fl<SPAN class="punctuation token">.</SPAN>write<SPAN class="punctuation token">(</SPAN>delimiter<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>map<SPAN class="punctuation token">(</SPAN>str<SPAN class="punctuation token">,</SPAN> row<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">+</SPAN> <SPAN class="string token">'\n'</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">del</SPAN> row
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">del</SPAN> sc‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

but it stopped before finishing all the feature classes and I got the following:

Runtime error
Traceback (most recent call last):
File "<string>", line 23, in <module>
NameError: name 'row' is not defined

FYI it processed 1700 or so out of the approximately 15,000 FCs before stopping. The csv file has those correctly.

Please let me know if you have any ideas. Thanks for this excellent script.

MichaelLenore1

I let this script run overnight, and this morning, here's what I found:

>>> import arcpy
... output_file = r'C:\Users\mlenore\Desktop\GIS_Working_Folder\Residential_model\bgs.csv'
... arcpy.env.workspace = r'C:\Users\mlenore\Desktop\GIS_Working_Folder\Residential_model\BGs_finished.gdb'
... print("Listing feature classes...")
... feature_classes = arcpy.ListFeatureClasses()
... print("Found {0} feature classes".format(len(feature_classes)))
... first_fc = feature_classes[0]
... fieldnames = [f.name for f in arcpy.ListFields(first_fc) if f.type.lower() != 'geometry']
... delimiter = ','
...
... print(field_names)
... with open(output_file, 'w') as fl:
... print('Writing to {0}'.format(output_file))
... # write header
... fl.write(delimiter.join(fieldnames) + "\n")
...
... # append attributes from each feature class
... for fc in feature_classes:
... print(fc)
... with arcpy.da.SearchCursor(fc, fieldnames) as sc:
... for row in sc:
... fl.write(delimiter.join(map(str, row)) + '\n')
... del row
... del sc
...
Listing feature classes...
Found 15727 feature classes
Runtime error
Traceback (most recent call last):
File "<string>", line 11, in <module>
NameError: name 'field_names' is not defined

FilipKrál

Hi Michael,

You're not supposed to replace 'geometry' or '\n' with anything. The line with 'geometry' lists names of all the columns where column type is not geometry. The '\n' adds a new line character at the end of every line you write to the output csv file.

Joseph Head‌ is right. Some print statements will help you figure out what's going on. I recommend adding the following print statements to line 4, 6, 10, and 12, respectively:

print("Listing feature classes...") # line 4
print("Found {0} feature classes".format(len(feature_classes))) # line 6
print(field_names) #line 10
print('Writing to {0}'.format(output_file)) # line 12

#Also insert the following just before line 18 and align it with the 'with' keyword:&nbsp;
print(fc)
‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

My guess is that the arcpy.ListFeatureClasses() takes a long time but without the print statements you won't know.

It is likely that the whole thing is going to take some time. One way to figure out if the process is still doing anything is to check the size of the output csv file every couple of minutes to see if it is still growing.

Filip.

Lake_Worth_BeachAdmin

what exactly is it hanging on? Include some print statements to see what bits of code are successfully being executed and where it hangs.

MichaelLenore1

This seems like exactly what I need.

Please forgive the novice question, but with what, if anything, am I to replace 'geometry' and "\n"? I have tried running this, but ArcMap just hangs.

FilipKrál

Hi Michael,

Let's assume that all your feature classes have the same attributes and that they are stored like this:

c:/my.gdb/fc1
c:/my.gdb/fc2
...
c:/my.gdb/fc15000
...<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

I would use the following code to merge attributes of all your feature classes into a csv file and then I'd try to open the csv file in Excel.

<SPAN class="keyword token">import</SPAN> arcpy
output_file <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'c:\my.csv'</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>workspace <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'c:\my.gdb'</SPAN>

feature_classes <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListFeatureClasses<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>

first_fc <SPAN class="operator token">=</SPAN> feature_classes<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN>
fieldnames <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN>f<SPAN class="punctuation token">.</SPAN>name <SPAN class="keyword token">for</SPAN> f <SPAN class="keyword token">in</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListFields<SPAN class="punctuation token">(</SPAN>first_fc<SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">if</SPAN> f<SPAN class="punctuation token">.</SPAN>type<SPAN class="punctuation token">.</SPAN>lower<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">!=</SPAN> <SPAN class="string token">'geometry'</SPAN><SPAN class="punctuation token">]</SPAN>
delimiter <SPAN class="operator token">=</SPAN> <SPAN class="string token">','</SPAN>

<SPAN class="keyword token">with</SPAN> open<SPAN class="punctuation token">(</SPAN>output_file<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'w'</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">as</SPAN> fl<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp; <SPAN class="comment token"># write header</SPAN>
&nbsp;&nbsp;&nbsp; fl<SPAN class="punctuation token">.</SPAN>write<SPAN class="punctuation token">(</SPAN>delimiter<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>fieldnames<SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">+</SPAN> <SPAN class="string token">"\n"</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; 
&nbsp;&nbsp;&nbsp; <SPAN class="comment token"># append attributes from each feature class</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> fc <SPAN class="keyword token">in</SPAN> feature_classes<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">with</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>da<SPAN class="punctuation token">.</SPAN>SearchCursor<SPAN class="punctuation token">(</SPAN>fc<SPAN class="punctuation token">,</SPAN> fieldnames<SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">as</SPAN> sc<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> row <SPAN class="keyword token">in</SPAN> sc<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fl<SPAN class="punctuation token">.</SPAN>write<SPAN class="punctuation token">(</SPAN>delimiter<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>map<SPAN class="punctuation token">(</SPAN>str<SPAN class="punctuation token">,</SPAN> row<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">+</SPAN> <SPAN class="string token">'\n'</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">del</SPAN> row
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">del</SPAN> sc
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

I wonder how long is it all going to take. Especially the ListFeatureClasses function call can take a while with that many feature classes.

Filip.

MichaelLenore1

Thanks for replying - but I don't need that table. I need a new table based on my model's results, which are in a geodatabase. The geodatabase contains one shapefile per BG with new data appended to each.

JoeBorgione

Or as I mentioned in your last post, download the shape file from https://www.census.gov/geo/maps-data/data/cbf/cbf_blkgrp.html : the dbf can be saved as an excel spreadsheet

JimCousins

Try using append in a loop over your files, so that it is only working with 2 files at a time, instead of 15000 all at once.

Best Regards,

Jim

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.