topic Re: Programmatically return Feature Class file size and date modified in Python Questions

Programmatically return Feature Class file size and date modified

JohnDye — Tue, 21 May 2013 13:19:39 GMT

There doesn't appear to be a function in arcpy to return the file size of a feature class or it's date modified timestamp.

Anyone have any idea how to do this? I know there is a property somewhere because you can setup ArcCatalog to display the information. However, I want to see it returned in a Python Script so that I can write a two-way synchronization function.

Re: Programmatically return Feature Class file size and date modified

JamesCrandall — Tue, 21 May 2013 14:24:53 GMT

There doesn't appear to be a function in arcpy to return the file size of a feature class or it's date modified timestamp.

Anyone have any idea how to do this? I know there is a property somewhere because you can setup ArcCatalog to display the information. However, I want to see it returned in a Python Script so that I can write a two-way synchronization function.

os.path has both of the methods you want (I have not worked with these myself).

os.path.getmtime
os.path.getsize

http://docs.python.org/2/library/os.path.html

Re: Programmatically return Feature Class file size and date modified

ChrisSnyder — Sat, 11 Dec 2021 15:39:17 GMT

Unless its a shapefile, I don't believe there is currently a way to do this with arcpy in v10.1.

A trick though to getting this to work is to make a seperate FGBD for each FC.

This code might give you some ideas on how to get the size:

import glob
def compactAndReportFGDB(fgdbPath): 
    oldFgdbSize = 0
    for file in glob.glob(fgdbPath + "\\*"):
        oldFgdbSize = oldFgdbSize + os.path.getsize(file)
    arcpy.Compact_management(fgdbPath)
    newFgdbSize = 0
    for file in glob.glob(fgdbPath + "\\*"):
        newFgdbSize = newFgdbSize + os.path.getsize(file)
    compactPct = str(int((oldFgdbSize - newFgdbSize) / float(oldFgdbSize) * 100))
    return compactPct

Re: Programmatically return Feature Class file size and date modified

JamesCrandall — Tue, 21 May 2013 18:27:03 GMT

Unless its a shapefile, I don't believe there is currently a way to do this with arcpy in v10.1.

Good point. I guess you'd have to implement some kind of your own logging process on the gdb to maintain info on modification dates. Not sure exactly how you'd work out the size of GDB elements too other than creating individual .shp files or gdb's of each item. ewww.

Re: Programmatically return Feature Class file size and date modified

JamesCrandall — Tue, 21 May 2013 18:34:32 GMT

By the looks of this http://gis.stackexchange.com/questions/23914/how-to-get-the-size-of-a-file-geodatabase-feature-class-on-disk you could probably get at this info with ArcObects someway.

edit: yup.. http://gis.stackexchange.com/questions/24242/how-to-programmatically-determine-the-size-of-a-feature-class-in-a-file-geodatab ArcObjects will get it done.

Re: Programmatically return Feature Class file size and date modified

JohnDye — Tue, 21 May 2013 20:26:14 GMT

Thanks James,
I initially thought the same thing but was skeptical since Windows doesn't natively understand the GDB format. Needless to say, this raises an error.

Re: Programmatically return Feature Class file size and date modified

JohnDye — Tue, 21 May 2013 20:28:12 GMT

By the looks of this http://gis.stackexchange.com/questions/23914/how-to-get-the-size-of-a-file-geodatabase-feature-class-on-disk you could probably get at this info with ArcObects someway.

edit: yup.. http://gis.stackexchange.com/questions/24242/how-to-programmatically-determine-the-size-of-a-feature-class-in-a-file-geodatab ArcObjects will get it done.

Thanks James,
I actually saw this before posting here, but I'm not sure how to leverage ArcObjects from Python, if I can at all.

Re: Programmatically return Feature Class file size and date modified

ChrisSnyder — Tue, 21 May 2013 20:36:41 GMT

I've never used ArcObjects via Python but you can: http://gis.stackexchange.com/questions/80/how-do-i-access-arcobjects-from-python

Re: Programmatically return Feature Class file size and date modified

JohnDye — Tue, 21 May 2013 20:45:42 GMT

Since it's not currently possible through anything I've seen in Python, I've added it to the ideas site.https://c.na9.visual.force.com/apex/ideaView?id=087E00000004eOq

Re: Programmatically return Feature Class file size and date modified

JohnDye — Tue, 21 May 2013 21:27:31 GMT

I've never used ArcObjects via Python but you can: http://gis.stackexchange.com/questions/80/how-do-i-access-arcobjects-from-python

sweet. I'll give it a go. thanks!

Re: Programmatically return Feature Class file size and date modified

JohnDye — Sat, 11 Dec 2021 15:39:19 GMT

So digging around a little more, I found a nifty little featurecompare function in the management toolbox. It seems to give me a decent solution to flagging child fcs that are different from the parentfc. According to the the ArcGIS Resources Help File:

"The comparison tools result object will be 'true' when no differences are found and 'false' when differences are detected."

So I should be able to return a True or False from the result object. It seems however that my result object is not returning anything. Does it matter that the result object is a unicode string?

I dont understand why my result object is coming up empty.

CODE:

childfc = r"C:\Temp\MyGDB\Stores"
parentfc = r"\\sharedrive\ParentGDB\Stores"

result = arcpy.FeatureCompare_management(parentfc, childfc, "DID", "ATTRIBUTES_ONLY", "", "", "", "", "", "", "NO_CONTINUE_COMPARE")

print "Comparison Result is: " + result
result.GetOutput

Shell Results:

Comparison Result is:
<bound method Result.getOutput of <Result ''>>

Re: Programmatically return Feature Class file size and date modified

JohnDye — Sat, 11 Dec 2021 15:39:22 GMT

I dont understand why my result object is coming up empty.

Doh!
Index Values help...

CODE:

childfc = r"C:\Temp\MyGDB\Stores"
parentfc = r"\\sharedrive\ParentGDB\Stores"

result = arcpy.FeatureCompare_management(parentfc, childfc, "DID", "ATTRIBUTES_ONLY", "", "", "", "", "", "", "NO_CONTINUE_COMPARE")

print "Comparison Result is: " + result.getOutput(1)
result.GetOutput(1)

Shell Results:

Comparison Result is: false
u'false'

Re: Programmatically return Feature Class file size and date modified

DanielBauer — Thu, 22 Aug 2013 05:28:55 GMT

Hello,

I tried juanf.martinez.carmona's code using comtypes.client and it worked fine on a system running ArcGIS 10.0. Sadly running the script on an ArcGIS 10.1 system leads to the following error:

Traceback (most recent call last):
File "D:\pyTest\FeatureClass_date.py", line 12, in <module>
pwf = comtypes.client.CreateObject(esriDataSourcesGDB.FileGDBWorkspaceFactory, interface=esriGeodatabase.IWorkspaceFactory)
AttributeError: 'module' object has no attribute 'FileGDBWorkspaceFactory'

Does anybody have an idea, what might be the problem here?

Re: Programmatically return Feature Class file size and date modified

MicahBabinski — Sat, 11 Dec 2021 15:39:25 GMT

Getting the modified date of a .gdb table/feature class took some real acrobatics, but I was finally able to get it done. I started out with zero ArcObjects experience but a good dose of Python and arcpy.

Step one was to carefully follow the instructions here:

How do I access ArcObjects from Python? - Geographic Information Systems Stack Exchange

and here:

python - ArcObjects + comtypes at 10.1 - Geographic Information Systems Stack Exchange

Once I got the "create point" code working (from the example in the first link), I opened up the Snippets.py code and inserted the following function under the *** Standalone *** section, where gdb is the full path to the gdb and tableName is the table name:

def GetModifiedDate(gdb, tableName):    
    # Setup    
    GetStandaloneModules()    
    InitStandalone()    
    import comtypes.gen.esriSystem as esriSystem    
    import comtypes.gen.esriGeoDatabase as esriGeoDatabase    
    import comtypes.gen.esriDataSourcesGDB as esriDataSourcesGDB    

    # Open the FGDB    
    pWS = Standalone_OpenFileGDB(gdb)  
  
    # Create empty Properties Set    
    pPropSet = NewObj(esriSystem.PropertySet, esriSystem.IPropertySet)    
    pPropSet.SetProperty("database", gdb)    

    # Cast the FGDB as IFeatureWorkspace    
    pFW = CType(pWS, esriGeoDatabase.IFeatureWorkspace)    

    # Open the table    
    pTab = pFW.OpenTable(tableName)    

    # Cast the table as a IDatasetFileStat    
    pDFS = CType(pTab, esriGeoDatabase.IDatasetFileStat)    

    # Get the date modified    
    return pDFS.StatTime(2)

Finally, I created a script that implemented the function (set up for a custom script tool but could be used as a stand-alone as well):

import Snippets
import datetime
import arcpy
import sys

# User Params
file_gdb = arcpy.GetParameterAsText(0) # Path to FGDB
table_name = arcpy.GetParameterAsText(1) # Table or feature class name

arcpy.env.workspace = file_gdb

if file_gdb.split(".")[-1] != "gdb":
    arcpy.AddMessage("The input workspace is not a file geodatabase!")
    sys.exit()

def doIt(file_gdb, table_name):

    # Call GetModifiedDate function to get the number of seconds
    num_seconds = Snippets.GetModifiedDate(file_gdb, arcpy.Describe(table_name).baseName)

    # Translate the number of seconds into a formatted date
    date_modified = datetime.datetime.fromtimestamp(num_seconds).strftime('%Y-%m-%d %H:%M:%S')

    # Report the result
    arcpy.AddMessage(date_modified)
    return date_modified

doIt(file_gdb, arcpy.Describe(table_name).baseName)

I sincerely hope this helps! Thanks to all the people who got me to an actual solution.

Re: Programmatically return Feature Class file size and date modified

JamesCrandall — Mon, 02 Mar 2015 17:59:31 GMT

Have you distributed this across your organization? I can see right away it will fail in a Citrix environment. Too bad because this type of programmatic access is pretty good to have!

Re: Programmatically return Feature Class file size and date modified

MicahBabinski — Mon, 02 Mar 2015 18:33:49 GMT

Hi James,

No I haven't. I developed this solution as part of some R&D on a redesign of an SDE data loading process we have. We need to detect changes in datasets in a range of formats so we can determine which of them have been updated and need to be loaded to our SDE geodatabases. Our current app was set up by my supervisor in C# ArcObjects. It works well but has a few shortcomings and has proven tricky to maintain over the years.

Out of curiosity, what indicates that it will fail in a Citrix environment?

Re: Programmatically return Feature Class file size and date modified

JamesCrandall — Mon, 02 Mar 2015 18:42:06 GMT

Out of curiosity, what indicates that it will fail in a Citrix environment?

It will fail on your import comtypes statement(s)

Re: Programmatically return Feature Class file size and date modified

VandanaRaghunathan — Mon, 02 Mar 2015 18:59:19 GMT

Hello John,

Have you considered using editor tracking instead? This will create columns in the attribute table indicating the edits made to the feature class, this you can access using python.

About tracking an editor's changes to data—Help | ArcGIS for Desktop

Like mentioned in the previous posts, unless it is a shapefile, the date modified for file geodatabase feature class cannot be displayed in ArcCatalog. Even the edits made to the feature class, does not affect the time stamp on the geodatabase itself until all the locks are released (this is also considered an "edit" on the gdb) i.e. till the application is closed which may not be the time you stopped editing.

43164 - In ArcCatalog, why is the time stamp incorrect on the date modified field of a file geodatabase feature class?

Therefore, editor tracking is definitely better option if you want to track changes made to the feature class. Feature Compare essentially compares the properties of two feature classes in terms of geometry, attrribute, schema and spatial reference.

Hope this helps!

Thanks,

Best,

Vandana

Re: Programmatically return Feature Class file size and date modified

MattWilkie2 — Wed, 13 May 2015 22:54:08 GMT

Hi Micah, thanks for this clear start to finish example of using python arcobjects. I hope you don't mind me taking the liberty of folding it into my (very slowly) growing py-arcobjects module(?)

arcplus/ao.py at master · maphew/arcplus · GitHub

Re: Programmatically return Feature Class file size and date modified

MicahBabinski — Thu, 14 May 2015 15:46:29 GMT

Hi Matt,

I don't mind at all. Thanks for the shout-out. Happy scripting!

Micah