nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Execution time- Arcpy

Yaron_YosefCohen

Hello everyone,

I am working on arcmap 10.3.1 and python 2.7.8. I need to determine how much time arcpy needed to finish a specific task (add layer) . I'm using this code:

import arcpy,os,sys,string,datetime,timeit
import arcpy.mapping
from arcpy import env

env.workspace = r"C:\Project"
Layer1 = arcpy.mapping.Layer(r"C:\Project\layers\atikot.lyr")
counter = 0
for mxd in arcpy.ListFiles("*.mxd"):
    print (mxd)
    mapdoc = arcpy.mapping.MapDocument(r"C:\Project\\" + mxd)
    df = arcpy.mapping.ListDataFrames(mapdoc, "Layers")[0]  
    arcpy.mapping.AddLayer(df ,Layer1, "TOP")
    print ('AddLayer')
    mapdoc.save()
    counter = counter + 1
del mxd 
print (counter)
print str(datetime.datetime.now().date())
print time.clock()

When i run it i get:

>>> 
Project 2.mxd
AddLayer
Project.mxd
AddLayer
soil.mxd
AddLayer
soil_20008.mxd
AddLayer
ta34b_4.mxd
AddLayer
wells.mxd
AddLayer
6
2015-03-18
3.20723655198e-07
>>>

I have been unable to get execution times for the processes. when i measured this process with stopper -i got 9.6 second in real time

but in the code the score is 3.207. I dont know if 3.2 is seconds -and if it is that mean this time isn't right.

Any help would be great

Find more posts tagged with

Accepted answers

DanPatterson_Retired

practice with your stop watch before you use the time function

copy and paste these in an interactive editor session

>>> import datetime
>>> now = datetime.datetime.now()  # wait a bit, then paste the next line
>>> later = datetime.datetime.now()
>>> # ... your code stuff here or nothing ...
>>> elapsed = later - now
>>> print elapsed
0:00:04.416000
>>>

All comments

FredMitchell

Hi @DanPatterson_Retired,

Not sure if you're still monitoring this thread but just wanted to comment that the syntax for Python 3.x has changed since Print is now a function so the brackets have to change slightly:

print('Script Complete...run time was... {} seconds'.format(elapsed))

Figured I'd share this updated line here in case anyone else is trying to use it. Thanks for providing the original code block!

Yaron_YosefCohen

thanks Owen, i will try it

OwenEarley

I have found function decorators a useful way to do this kind of thing. A good starting guide on function decorators is available at simeonfranklin.com - Understanding Python Decorators in 12 Easy Steps!

Basically, you wrap your processing function inside a timer function. This can be done ad-hoc by pre-pending the function definition with a decorator name and the @ symbol:

import time
import inspect

def recordPerformance(func):
    def wrapper(*arg):
        t1 = time.clock()
        res = func(*arg)
        t2 = time.clock()
        print '%s, %0.2f' % (func.func_name, (t2-t1))
        return res
    return wrapper

def mainProcess():
    subProcess1()
    subProcess2()
    subProcess3()

@recordPerformance
def subProcess1():
    time.sleep(2)

@recordPerformance
def subProcess2():
    time.sleep(1)

@recordPerformance
def subProcess3():
    time.sleep(3)


mainProcess()

When you run this the result is:

subProcess1, 1.99
subProcess2, 1.01
subProcess3, 3.00

EDIT - fixed function names in output results.

This approach provides a lot of flexibility and is great for logging and performance timing.

JamesCrandall

This slight change should give you the time interval in seconds:

#adjust from miliseconds to seconds
print "The process took %.02f secs. " % (t.interval)

JamesCrandall

class Timer:    
    def __enter__(self):
        self.start = time.clock()
        return self
    def __exit__(self, *args):
        self.end = time.clock()
        self.interval = self.end - self.start
        
import arcpy,os,sys,string,datetime,timeit  
import arcpy.mapping  
from arcpy import env  

def mainProcess():
    env.workspace = r"C:\Project"  
    Layer1 = arcpy.mapping.Layer(r"C:\Project\layers\atikot.lyr")  
    counter = 0  
    for mxd in arcpy.ListFiles("*.mxd"):  
        print (mxd)  
        mapdoc = arcpy.mapping.MapDocument(r"C:\Project\\" + mxd)  
        df = arcpy.mapping.ListDataFrames(mapdoc, "Layers")[0]    
        arcpy.mapping.AddLayer(df ,Layer1, "TOP")  
        print ('AddLayer')  
        mapdoc.save()  
        counter = counter + 1  
    del mxd 
  
t = Timer()
with t:
    mainProcess()

print "The process took %.2f Milisecs. " % (t.interval)

Yaron_YosefCohen

where i implement your code in my code?

JamesCrandall

Implement a Timer class to reuse throughout the code base.

class Timer:    
    def __enter__(self):
        self.start = time.clock()
        return self
    def __exit__(self, *args):
        self.end = time.clock()
        self.interval = self.end - self.start

Simple to implement, especially when you wrap up your functions/code blocks into individual def's

def dftest():
    #some process wrapped up in this def()

#time the process
t = Timer()
with t:
    dftest()

print "The process took %.2f Milisecs. " % (t.interval)

DanPatterson_Retired

maybe computer clock speeds...don't know

Yaron_YosefCohen

Dan, the run time is acually less then in my watch timer- why is it?

DanPatterson_Retired

And for extra clarity... just substitute the nap_time line with your code block

#  time_timeit_sleep_demo.py
#  Dan.Patterson@carleton.ca
#
import time
import datetime
now = datetime.datetime.now()
#
nap_time = time.sleep(5)  # sleep time in seconds... change to test
#
later = datetime.datetime.now()
elapsed = later - now
print('Nap time was... {} seconds').format(elapsed)

DanPatterson_Retired

practice with your stop watch before you use the time function

copy and paste these in an interactive editor session

>>> import datetime
>>> now = datetime.datetime.now()  # wait a bit, then paste the next line
>>> later = datetime.datetime.now()
>>> # ... your code stuff here or nothing ...
>>> elapsed = later - now
>>> print elapsed
0:00:04.416000
>>>

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.