Get file size for Shapefile not SHP file

Question

I was wondering if there was a way to get file sizes from a shapefile or other multi part spatial file as a single command.

For instance a shapefile is comprised of the several files including SHP, DBF, SHX, etc... and would involve getting info for each of the parts if done using regular Python.  While I can use the os.path.getfilesize('fileName') command it does not take into account the other information that is not specifically the SHP file.

While it would not be too difficult to write a one off for say a shapefile it would require writing one for each multi part file type in 'ListDatasets'.

TedKowal · Answer

I had a similiar issue but different workflow.....

I get Shapefiles within Zip containers so I use a slightly different technique....

How to know the folder size in a zipfile (Python) - Stack Overflow

Ted

DanielScott · Answer

Henry Colgate and Marc, Jumping on the ride here, for the last few weeks Ive been messing around with this script to get this correct function and Im getting some layer files being mapped whilst others not. What want to do: a) Map out the layers files that are in use in a mxd (shps should be dealt with with the glob, but doesnt include tiffs) b) Get the size of the collection of shps (i.e. test.shp consists of test.dbf, test.proj etc and I want to get the size of this bunch) - problem c) Total size calculator of how much data is in the mxd - cant figure best way of doing this as b is blocking me I found a really nice library called humanize to help the size conversion. import arcpy, os, humanize, glob def write_log(text,file): f = open(file,'a') #a appends to an existing file if it exists f.write("{} ".format(text)) #write the text to the logfile and move to the next line return output = r'X:\ds\sizemxd.txt' #directory of the log file mxd = arcpy.mapping.MapDocument("CURRENT") df = arcpy.mapping.ListDataFrames(mxd) write_log("This report summarizes the names of all map documents and data frames within " + mxd.filePath + " ",output) write_log("Date: " + str(datetime.datetime.today().strftime("%d %B, %Y")) + " ",output) for d in df: write_log("Data Frame: " + d.name, output) layers = arcpy.mapping.ListLayers(mxd, "", d) for lyr in layers: try: if lyr.supports("dataSource"): lname = lyr.name print "lname: " + lname datasource = lyr.dataSource wspath = lyr.workspacePath if datasource.endswith('.shp'): stringwspath = str(wspath).replace("\", '/') path = stringwspath + "/" print "Path: " + path for shp in glob.glob(os.path.join(path,'{0}.*').format(lname)): shp = str(shp).replace("\", '/') print "stripped " + stripshp try: size = os.stat(shp).st_size print "size of shp " + stripshp + " is " + humanize.naturalsize(size) except: print "unable to access size of " + shp else: pass else: pass #print "File size: " + humanize.size except: print "Unable to analyse size for " + lname.encode('utf-8')‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍ The output is: Path: C:/Users/ds/Desktop/stripped C:/Users/ds/Desktop/E458_search.cpgsize of shp C:/Users/ds/Desktop/E458_search.cpg is 9 Bytesstripped C:/Users/ds/Desktop/E458_search.dbfsize of shp C:/Users/ds/Desktop/E458_search.dbf is 391 Bytesstripped C:/Users/ds/Desktop/E458_search.sbnsize of shp C:/Users/ds/Desktop/E458_search.sbn is 252 Bytesstripped C:/Users/ds/Desktop/E458_search.sbxsize of shp C:/Users/ds/Desktop/E458_search.sbx is 124 Bytesstripped C:/Users/ds/Desktop/E458_search.shpsize of shp C:/Users/ds/Desktop/E458_search.shp is 2.3 kBstripped C:/Users/ds/Desktop/E458_search.shp.NB-055.12412.16264.sr.locksize of shp C:/Users/ds/Desktop/E458_search.shp.NB-055.12412.16264.sr.lock is 0 Bytesstripped C:/Users/ds/Desktop/E458_search.shxsize of shp C:/Users/ds/Desktop/E458_search.shx is 204 Byteslname: E458_HSR_LITHO_29092017_acQlname: E458ThinSections_17082017Path: C:/shps/stripped C:/shps/E458ThinSections_17082017.CPGsize of shp C:/shps/E458ThinSections_17082017.CPG is 5 Bytesstripped C:/shps/E458ThinSections_17082017.dbfsize of shp C:/shps/E458ThinSections_17082017.dbf is 36.7 kBstripped C:/shps/E458ThinSections_17082017.prjsize of shp C:/shps/E458ThinSections_17082017.prj is 409 Bytesstripped C:/shps/E458ThinSections_17082017.sbnsize of shp C:/shps/E458ThinSections_17082017.sbn is 260 Bytesstripped C:/shps/E458ThinSections_17082017.sbxsize of shp C:/shps/E458ThinSections_17082017.sbx is 124 Bytesstripped C:/shps/E458ThinSections_17082017.shpsize of shp C:/shps/E458ThinSections_17082017.shp is 492 Bytesstripped C:/shps/E458ThinSections_17082017.shp.NB-055.12412.16264.sr.locksize of shp C:/shps/E458ThinSections_17082017.shp.NB-055.12412.16264.sr.lock is 0 Bytesstripped C:/shps/E458ThinSections_17082017.shp.xmlsize of shp C:/shps/E458ThinSections_17082017.shp.xml is 789 Bytesstripped C:/shps/E458ThinSections_17082017.shxsize of shp C:/shps/E458ThinSections_17082017.shx is 212 Byteslname: PBT_FieldObservationPoints_24072017Path: G:/08/E458/Data/Geology/Observation Points/lname: PBT_FieldDescriptions_24072017Path: G:/08/E458/Data/Geology/IntegratedGeol/PBT Maps/ so for the last two files PBT_FieldObservationPoints_24072017 and PBT_FieldDescriptions_24072017, I can see in the folder that there do exist shp files but for some reason it doesnt register them to get their size checked. Would anyone be able to help with this? Thanks in advance

MarcNakleh · Answer

Hi Henry,

Agreed on all points. To be honest, I'm not 100% sure whether the os or arcpy modules could do much of what you're wondering about. 
My money is on the need to use more in-depth analysis modules (or the associated programs themselves) to find out this kind of metadata. I don't even know if these would be part of Python's standard library, though I can't say for sure. Your best bet would be to look around online for GIS modules developed in Python for Image Analysis or File management.

Cheers,
Marc