topic ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder? in ArcGIS Pro Questions

ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN — Fri, 02 Sep 2022 04:59:07 GMT

ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

For example, the model below is intended to query an indexed and a nonindexed layer. I wanted to compare the time between these two cases. This is why I need a tool to measure the time to perform the “select by attribute” in these two cases.

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

DanPatterson — Fri, 02 Sep 2022 07:46:13 GMT

Timing is best done in python. It needs to be scripted with calls to collect time information and the actual tool being used.

For instance the code samples for a tool show the required syntax to perform a select by attribute

Select Layer By Attribute (Data Management)—ArcGIS Pro | Documentation

to collect time you throw what you need between the time collecting code

performance - How do I measure elapsed time in Python? - Stack Overflow

provides a simple example of the concept

import time start = time.time() # -- amazing things section print("Replace this with the select by attributes code") # -- now find out how long it took end = time.time() print(end - start)

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN — Fri, 02 Sep 2022 10:43:03 GMT

I exported the model into a python but couldn’t figure out how to stick the piece of code you have already provided in order to get the time printed.

Could you please help me on this?

# -*- coding: utf-8 -*- """ Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39 """ import arcpy def Model(): # IndexingElapsedTime # To allow overwriting outputs change overwriteOutput option to True. arcpy.env.overwriteOutput = False # Model Environment settings with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"): Parcels = "Parcels" # Process: Copy Features (Copy Features) (management) Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Add Attribute Index (Add Attribute Index) (management) Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0] # Process: Select Layer By Attribute (Select Layer By Attribute) (management) Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") # Process: Copy Features (2) (Copy Features) (management) Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management) Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") if __name__ == '__main__': Model()

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JakeSkinner — Fri, 02 Sep 2022 11:18:13 GMT

Hi @JamalNUMAN,

Try the following:

# -*- coding: utf-8 -*- """ Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39 """ import arcpy, time def Model(): # IndexingElapsedTime # To allow overwriting outputs change overwriteOutput option to True. arcpy.env.overwriteOutput = False # Model Environment settings with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"): Parcels = "Parcels" # Process: Copy Features (Copy Features) (management) Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Add Attribute Index (Add Attribute Index) (management) Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0] # Process: Select Layer By Attribute (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete") # Process: Copy Features (2) (Copy Features) (management) Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete") if __name__ == '__main__': Model()

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN — Fri, 02 Sep 2022 12:01:35 GMT

It fails to run. I got an error

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JakeSkinner — Fri, 02 Sep 2022 12:42:18 GMT

Make sure the indentation matches for the highlighted lines. They should align with the same indentation as the Parcels_CopyFeatures1_Layer,.... line.

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN — Fri, 02 Sep 2022 16:11:06 GMT

I got an error as per the screenshot below

# -*- coding: utf-8 -*- """ Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39 """ import arcpy, time def Model(): # IndexingElapsedTime # To allow overwriting outputs change overwriteOutput option to True. arcpy.env.overwriteOutput = True # Model Environment settings with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"): Parcels = "Parcels" # Process: Copy Features (Copy Features) (management) Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Add Attribute Index (Add Attribute Index) (management) Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0] # Process: Select Layer By Attribute (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete") # Process: Copy Features (2) (Copy Features) (management) Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime arcpy.AddMessageE(f"Selection took {elapsedTime} seconds to complete") if __name__ == '__main__': Model()

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JakeSkinner — Fri, 02 Sep 2022 16:18:50 GMT

Type-o on my part. Just remove the extra E in arcpy.AddMessageE (line 28 and 29). Should be:

arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete")

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN — Fri, 02 Sep 2022 19:13:21 GMT

It works fine but the elapsed time is not printed for the “select by attribute” tool

# -*- coding: utf-8 -*- """ Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39 """ import arcpy, time def Model(): # IndexingElapsedTime # To allow overwriting outputs change overwriteOutput option to True. arcpy.env.overwriteOutput = True # Model Environment settings with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels_NonIndexed.gdb"): Parcels = "Parcels" # Process: Copy Features (Copy Features) (management) Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Add Attribute Index (Add Attribute Index) (management) Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0] # Process: Select Layer By Attribute (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete") # Process: Copy Features (2) (Copy Features) (management) Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete") if __name__ == '__main__': Model()

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JakeSkinner — Fri, 02 Sep 2022 19:31:26 GMT

How are you running the script? You may need to change arcpy.AddMessage to print.

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN — Fri, 02 Sep 2022 19:52:49 GMT

I’m running the script from inside the Pro as per screenshot in my pervious post.

What is the correct script for the print that needs to replace:

arcpy.AddMessage(f"Selection took {elapsedTime} seconds to complete")

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

DanPatterson — Sat, 03 Sep 2022 00:22:25 GMT

print(f"Selection took {elapsedTime} seconds to complete")

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

JamalNUMAN — Sat, 03 Sep 2022 04:40:34 GMT

Great. It works fine with no issues.

The comparison demonstrates a slight difference when performing the “select by attribute” tool on an indexed data and a nonindexed for a data of around 340,000 records as per the screenshot below.

# -*- coding: utf-8 -*- """ Generated by ArcGIS ModelBuilder on : 2022-09-02 12:37:39 """ import arcpy, time def Model(): # IndexingElapsedTime # To allow overwriting outputs change overwriteOutput option to True. arcpy.env.overwriteOutput = True # Model Environment settings with arcpy.EnvManager(scratchWorkspace=r"C:\Z8\Q.gdb", workspace=r"C:\Z8\Parcels.gdb"): Parcels = "Parcels" # Process: Copy Features (Copy Features) (management) Output_Feature_Class = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Add Attribute Index (Add Attribute Index) (management) Parcels_CopyFeatures = arcpy.management.AddIndex(in_table=Output_Feature_Class, fields=["ParcelNumber"], index_name="ParcelNumber", unique="NON_UNIQUE", ascending="NON_ASCENDING")[0] # Process: Select Layer By Attribute (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures_Layer, Count = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Parcels_CopyFeatures, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime print(f"Selection of indexed data took {elapsedTime} seconds to complete") # Process: Copy Features (2) (Copy Features) (management) Output_Feature_Class_2_ = "C:\\Z8\\Q.gdb\\Parcels_CopyFeatures1" arcpy.management.CopyFeatures(in_features=Parcels, out_feature_class=Output_Feature_Class_2_, config_keyword="", spatial_grid_1=None, spatial_grid_2=None, spatial_grid_3=None) # Process: Select Layer By Attribute (2) (Select Layer By Attribute) (management) startTime = time.time() Parcels_CopyFeatures1_Layer, Count_2_ = arcpy.management.SelectLayerByAttribute(in_layer_or_view=Output_Feature_Class_2_, selection_type="NEW_SELECTION", where_clause="ParcelNumber = '72'", invert_where_clause="") endTime = time.time() elapsedTime = endTime - startTime print(f"Selection on nonindexed data took {elapsedTime} seconds to complete") if __name__ == '__main__': Model()

Re: ArcGIS Pro 3.0.1: How to measure the time for performing a particular tool in the model builder?

DanPatterson — Sat, 03 Sep 2022 08:52:43 GMT

Proving that the Attribute indexes in the geodatabase—ArcGIS Pro | Documentation was once again spot on 😉

with the warning that an index "can" speed things up, but it doesn't say "will always" speed things up