nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN

For example, the model below is intended to query an indexed and a nonindexed layer. I wanted to compare the time between these two cases. This is why I need a tool to measure the time to perform the “select by attribute” in these two cases.

Najděte více příspěvků označených jako

Accepted answers

All comments

DanPatterson

Timing is best done in python. It needs to be scripted with calls to collect time information and the actual tool being used.

For instance the code samples for a tool show the required syntax to perform a select by attribute

Select Layer By Attribute (Data Management)—ArcGIS Pro | Documentation

to collect time you throw what you need between the time collecting code

performance - How do I measure elapsed time in Python? - Stack Overflow

provides a simple example of the concept

import time

start = time.time()
# -- amazing things section
print("Replace this with the select by attributes code")
# -- now find out how long it took
end = time.time()
print(end - start)

JamalNUMAN

I exported the model into a python but couldn’t figure out how to stick the piece of code you have already provided in order to get the time printed.

Could you please help me on this?

# -*- coding: utf-8 -*-
"""
Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39
"""
import arcpy

def Model():  # IndexingElapsedTime

    # To allow overwriting outputs change overwriteOutput option to True.
    arcpy.env.overwriteOutput = False

    # Model Environment settings
    with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"):
        Parcels = "Parcels"

        # Process: Copy Features (Copy Features) (management)
        Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Add Attribute Index (Add Attribute Index) (management)
        Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0]

        # Process: Select Layer By Attribute (Select Layer By Attribute) (management)
        Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")

        # Process: Copy Features (2) (Copy Features) (management)
        Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management)
        Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")

if __name__ == '__main__':
    Model()

JakeSkinner

Hi @JamalNUMAN,

Try the following:

# -*- coding: utf-8 -*-
"""
Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39
"""
import arcpy, time

def Model():  # IndexingElapsedTime

    # To allow overwriting outputs change overwriteOutput option to True.
    arcpy.env.overwriteOutput = False

    # Model Environment settings
    with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"):
        Parcels = "Parcels"

        # Process: Copy Features (Copy Features) (management)
        Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Add Attribute Index (Add Attribute Index) (management)
        Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0]

        # Process: Select Layer By Attribute (Select Layer By Attribute) (management)
		startTime = time.time()
        Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
		endTime = time.time()
		elapsedTime = endTime - startTime
		arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete")

        # Process: Copy Features (2) (Copy Features) (management)
        Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management)
		startTime = time.time()
        Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
		endTime = time.time()
		elapsedTime = endTime - startTime
		arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete")

if __name__ == '__main__':
    Model()

JamalNUMAN

It fails to run. I got an error

JakeSkinner

Make sure the indentation matches for the highlighted lines. They should align with the same indentation as the Parcels_CopyFeatures1_Layer,.... line.

JamalNUMAN

I got an error as per the screenshot below

# -*- coding: utf-8 -*-
"""
Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39
"""
import arcpy, time

def Model():  # IndexingElapsedTime

    # To allow overwriting outputs change overwriteOutput option to True.
    arcpy.env.overwriteOutput = True

    # Model Environment settings
    with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"):
        Parcels = "Parcels"

        # Process: Copy Features (Copy Features) (management)
        Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Add Attribute Index (Add Attribute Index) (management)
        Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0]

        # Process: Select Layer By Attribute (Select Layer By Attribute) (management)
        startTime = time.time()
        Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
        endTime = time.time()
        elapsedTime = endTime - startTime
        arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete")

        # Process: Copy Features (2) (Copy Features) (management)
        Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management)
        startTime = time.time()
        Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
        endTime = time.time()
        elapsedTime = endTime - startTime
        arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete")

if __name__ == '__main__':
    Model()

JakeSkinner

Type-o on my part. Just remove the extra E in arcpy.AddMessageE (line 28 and 29). Should be:

arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete")

JamalNUMAN

It works fine but the elapsed time is not printed for the “select by attribute” tool

# -*- coding: utf-8 -*-
"""
Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39
"""
import arcpy, time

def Model():  # IndexingElapsedTime

    # To allow overwriting outputs change overwriteOutput option to True.
    arcpy.env.overwriteOutput = True

    # Model Environment settings
    with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"):
        Parcels = "Parcels"

        # Process: Copy Features (Copy Features) (management)
        Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Add Attribute Index (Add Attribute Index) (management)
        Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0]

        # Process: Select Layer By Attribute (Select Layer By Attribute) (management)
        startTime = time.time()
        Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
        endTime = time.time()
        elapsedTime = endTime - startTime
        arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete")

        # Process: Copy Features (2) (Copy Features) (management)
        Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management)
        startTime = time.time()
        Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
        endTime = time.time()
        elapsedTime = endTime - startTime
        arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete")

if __name__ == '__main__':
    Model()

JakeSkinner

How are you running the script? You may need to change arcpy.AddMessage to print.

JamalNUMAN

I’m running the script from inside the Pro as per screenshot in my pervious post.

What is the correct script for the print that needs to replace:

arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete")

DanPatterson

print(f"Selection took {elapsedTime} seconds to complete")

JamalNUMAN

Great. It works fine with no issues.

The comparison demonstrates a slight difference when performing the “select by attribute” tool on an indexed data and a nonindexed for a data of around 340,000 records as per the screenshot below.

# -*- coding: utf-8 -*-
"""
Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39
"""
import arcpy, time

def Model():  # IndexingElapsedTime

    # To allow overwriting outputs change overwriteOutput option to True.
    arcpy.env.overwriteOutput = True

    # Model Environment settings
    with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels.gdb"):
        Parcels = "Parcels"

        # Process: Copy Features (Copy Features) (management)
        Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Add Attribute Index (Add Attribute Index) (management)
        Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0]

        # Process: Select Layer By Attribute (Select Layer By Attribute) (management)
        startTime = time.time()
        Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
        endTime = time.time()
        elapsedTime = endTime - startTime
        print(f"Selection of indexed data took {elapsedTime} seconds to complete")

        # Process: Copy Features (2) (Copy Features) (management)
        Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1"
        arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None)

        # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management)
        startTime = time.time()
        Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="")
        endTime = time.time()
        elapsedTime = endTime - startTime
        print(f"Selection on nonindexed data took {elapsedTime} seconds to complete")

if __name__ == '__main__':
    Model()

DanPatterson

Proving that the Attribute indexes in the geodatabase—ArcGIS Pro | Documentation was once again spot on 😉

with the warning that an index "can" speed things up, but it doesn't say "will always" speed things up

Připojte se ke konverzaci

Přihlášení členové mohou přispívat, sledovat aktualizace a další. Jste tu noví? Zaregistrujte si bezplatný účet.

Rychlé odkazy

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.