topic Re: Why is list index out of range here but not here? in Python Questions

Why is list index out of range here but not here?

LindsayRaabe_FPCWA — Sat, 11 Dec 2021 20:20:16 GMT

The code below seems to function correctly most of the time except when running through a situation where line 43 is False (no extent updates based on this layer) and Line 51 is True (1+ feature in this layer), meaning Line 54 is also True (extent set at Line 22 should still match extent at Line 52).

What I'm not understanding is 2 things:

1. Why is it running through the elif at Line 61 when the condition should be False (as per Line 54 being True)

2. Why when it does run through the elif at Line 61 I get the below Trackback error about the list Index being out of range when it works elsewhere in the same manner?

Hope that all makes sense!

import arcpy
from arcpy import env, mapping
from bisect import bisect

#input parameters;
Plantation = arcpy.GetParameter(0)
ForestID = arcpy.GetParameter(1)
CommonName = arcpy.GetParameter(2)
PYear = arcpy.GetParameter(3)
OpCode = arcpy.GetParameter(4)

#variables;
title1 = Plantation + " PLANTATION"
title2 = Plantation + "\r\nPLANTATION"
title3 = Plantation + " (" + CommonName + ")"
title4 = Plantation + " P" + PYear + " AREA STATEMENT"
mxd = mapping.MapDocument("CURRENT")
elements = mapping.ListLayoutElements(mxd)
layers = mapping.ListLayers(mxd)
HTL_layer_list = ["Entered In GeoMaster", "Entered In GeoMaster Archive"]
dflist = arcpy.mapping.ListDataFrames(mxd, "")
orig_ext = dflist[0].extent
new_exp = "PLANTATION = '" + Plantation + "'"
new_sur_exp = "PLANTATION <> '" + Plantation + "'"
as_new_exp = "EnteredInGeoMaster IS NOT NULL AND Plantation = '" + Plantation + "'"
opcode_exp1 = "Entered_In_GeoMaster IS NOT NULL AND Ops_Code = '" + OpCode + "'"
opcode_exp2 = "Ops_Code = '" + OpCode + "'"
scalelist = [5000, 7500, 10000, 12500, 20000, 25000, 30000, 40000, 50000, 60000, 70000, 75000, 80000, 90000, 100000]

if mxd.title <> ("Cutting Returns Entered in GeoMaster"):

    ###other code here###

elif mxd.title == ("Cutting Returns Entered in GeoMaster"):

    mxd.activeView = "Page_Layout"
    
    for lyr in layers:
        if lyr.name == "Entered In GeoMaster":
            lyr.definitionQuery = opcode_exp1
            arcpy.AddMessage(lyr.name + " definition query updated")
            EIGfeature_count = arcpy.GetCount_management(lyr)[0]
            if EIGfeature_count > 0:
                ext = lyr.getExtent() #gets the new extent of the Entered In GeoMaster layer
                dflist[0].extent = ext #applies the Entered In GeoMaster layer extent to the dataframe
                    
        elif lyr.name == "Entered In GeoMaster Archive":
            lyr.definitionQuery = opcode_exp2
            arcpy.AddMessage(lyr.name + " definition query updated")
            EIGAfeature_count = arcpy.GetCount_management(lyr)[0]
            if EIGAfeature_count > 0:
                current_ext = dflist[0].extent

                if current_ext == orig_ext:
                    ext = lyr.getExtent() #gets the new extent of the Entered In GeoMaster layer
                    dflist[0].extent = ext #applies the Entered In GeoMaster layer extent to the dataframe
                    oldscale = dflist[0].scale # Get scale of dataframe
                    newscale = scalelist[bisect(scalelist, oldscale)] # bisect old scale to get new scale
                    dflist[0].scale = newscale # Apply new scale to dataframe

                elif current_ext <> orig_ext:
                    # get current map extent
                    xmin, xmax = dflist[0].extent.XMin, dflist[0].extent.XMax
                    ymin, ymax = dflist[0].extent.YMin, dflist[0].extent.YMax
                    # loop through def query layer extents and create one extent to fit them all
                    lyr_ext = lyr.getExtent()
                    if lyr_ext.XMin < xmin:
                        xmin = lyr_ext.XMin
                    if lyr_ext.YMin < ymin:
                        ymin = lyr_ext.YMin
                    if lyr_ext.XMax > xmax:
                        xmax = lyr_ext.XMax
                    if lyr_ext.YMax > ymax:
                        ymax = lyr_ext.YMax
                    # set df extent to new extent
                    dflist[0].extent = arcpy.Extent(xmin, ymin, xmax, ymax)
                    oldscale = dflist[0].scale # Get scale of dataframe
                    newscale = scalelist[bisect(scalelist, oldscale)] # bisect old scale to get new scale
                    dflist[0].scale = newscale # Apply new scale to dataframe

        elif lyr.name == "PlantationsHarvestPlan_OperationsPlanner_WA":
            lyr.definitionQuery = new_exp
            arcpy.AddMessage(lyr.name + " definition query updated")‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Traceback (most recent call last):
 File "W:\Mapping\ToolboxPythonCodes\SCRIPTS\Update Definition Queries.py", line 78, in <module>
 newscale = scalelist[bisect(scalelist, oldscale)] # bisect old scale to get new scale
IndexError: list index out of range

For reference, the aim here is to updated the definition queries on 2 layers in an open MXD, check for features in each layer and zoom the extent to view all the features in both layers before stepping the scale up (using bisect) to the next round scale in the list.

Re: Why is list index out of range here but not here?

DanPatterson_Retired — Mon, 17 Sep 2018 07:48:26 GMT

What is it supposed to do if line 51 has a count of zero in line 51?

if EIGAfeature_count <> 0

Re: Why is list index out of range here but not here?

LindsayRaabe_FPCWA — Mon, 17 Sep 2018 23:55:26 GMT

It was intended to just skip that section of code if it didn't meet the count criteria (no features so no need to apply the layer extent to the data frame extent). I assumed that if it didn't meet that criteria it would just move on to the next valid bit of code instead or needing an ELIF. Have I figured that incorrectly?

Re: Why is list index out of range here but not here?

VinceAngelo — Tue, 18 Sep 2018 12:20:51 GMT

GetCount returns a result array, not a count. You need to retrieve the first element of that result array.

EIGAfeature_count = arcpy.GetCount_management(lyr)[0]

if EIGAfeature_count[0] > 0:

- V

Re: Why is list index out of range here but not here?

LindsayRaabe_FPCWA — Wed, 19 Sep 2018 00:35:35 GMT

Thanks Vince for the tip. I've updated the original code snippet so hopefully I have that correct now. This still isn't helping the "list index out of range" error though at line 78.

Re: Why is list index out of range here but not here?

DanPatterson_Retired — Wed, 19 Sep 2018 00:39:45 GMT

throw a print statement before this line

newscale = scalelist[bisect(scalelist, oldscale)]

and print scalelist and oldscale… one of the two is causing the error

and the line numbers don't match up anymore. Do yours differ from those that are posted in the thread?

Re: Why is list index out of range here but not here?

LindsayRaabe_FPCWA — Sat, 11 Dec 2021 20:20:18 GMT

I've eliminated a big chunk of code that doesn't apply to this MXD so the lines are different from the original but I've been trying to factor that into my post/responses. Still looks correct to me though here?

I added in the print statements and this is the result when running a query where EIG = 0 and EIGA > 0 (sorry if I'm formatting this wrong - trying to break it up into the info/error sections).

Executing: UpdateDefinitionQueries "Lake Muir 2" LM2 # # MLM7AFC
Start Time: Wed Sep 19 08:48:54 2018
Running script UpdateDefinitionQueries...
Entered In GeoMaster definition query updated
Entered In GeoMaster Archive definition query updated
scalelist: [5000, 7500, 10000, 12500, 20000, 25000, 30000, 40000, 50000, 60000, 70000, 75000, 80000, 90000, 100000]
old scale: 404659.559547
Failed script UpdateDefinitionQueries...

Traceback (most recent call last):
 File "W:\Mapping\ToolboxPythonCodes\SCRIPTS\Update Definition Queries.py", line 78, in <module>
 newscale = scalelist[bisect(scalelist, oldscale)] # bisect old scale to get new scale
IndexError: list index out of range
Failed to execute (UpdateDefinitionQueries).

Failed at Wed Sep 19 08:49:05 2018 (Elapsed Time: 10.25 seconds)

Re: Why is list index out of range here but not here?

DanPatterson_Retired — Sat, 11 Dec 2021 20:20:21 GMT

from bisect import bisect

scalelist = [5000, 7500, 10000, 12500, 20000, 25000, 30000, 40000, 50000, 60000, 70000, 75000, 80000, 90000, 100000]

oldscale = 404659.559547

newscale = scalelist[bisect(scalelist, oldscale)]
---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
<ipython-input-25-e09e51ee6bfc> in <module>()
----> 1 newscale = scalelist[bisect(scalelist, oldscale)]

IndexError: list index out of range

# ---- now add 500,000 to the end
scalelist = [5000, 7500, 10000, 12500, 20000, 25000, 30000, 40000, 50000, 60000, 70000, 75000, 80000, 90000, 100000, 500000]

oldscale = 404659.559547

newscale = scalelist[bisect(scalelist, oldscale)]

newscale
Out[29]: 500000‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

lets rule out that problem first

Re: Why is list index out of range here but not here?

LindsayRaabe_FPCWA — Wed, 19 Sep 2018 01:40:25 GMT

That makes sense and works (insert face plant here). The part that I must have been getting hung up on though is the desire for this to be returning a typical scale concentrated on a small area (i.e. 1:20,000), meaning that the logic I've used to get the map to focus on the grouped features isn't working as expected.

Fore example. Before running the script, the map is focused on a selection of polygons in one location (EIG > 0 and EIGA = 0). I run this script to change the definition query to look at a different selection of polygons in a different location (where EIG = 0 and EIGA > 0). The code should examine the if query at Line 43 as False and skip to the next ELIF (Line 47) resulting in an unchanged dataframe extent (at this point).

Next it should examine the if EIGA > 0 (Line 51) as TRUE then set the current extent variable. Line 54 sees the current extent compared to the original extent (should result in TRUE) and proceed to Line 55. It would apply the layer extent to the dataframe and step up to the next in the list. That should be the end of it but for some reason it is progressing through to the elif at Line 61 and finding that TRUE. I would expect this to be FALSE because the current_ext and orig_ext variables are unchanged (to my knowledge) despite the dataframe extent being updated so should result in no further action being taken.

What actually seems to be happening is the code is running the ELIF (Line 61) as TRUE and comparing the min/max values from the old extent and the new extent resulting in a huge scale. This should only be getting run if there are new features in both layers which will be similarly geolocated. This does work as expected when both layers > 0.

Re: Why is list index out of range here but not here?

DanPatterson_Retired — Sat, 11 Dec 2021 20:20:24 GMT

Lindsay all I can suggest at this point is.

you have 2 parameters and 2 conditions each? = 0 and > 0

(a == 0) and (b == 0)

(a == 0) and (b > 0)

(a > 0) and (b == 0)

(a > 0) and (b > 0)

Code separately for each section, and check the logic. Put conditionals within brackets as I have shown, and if possible check for both conditions rather than one at a time if applicable.

And future proof yourself... python 3 is upon you soon

a = 0; b = 1
a <> b
  File "<ipython-input-44-7450b63d9fd5>", line 1
    a <> b       ^SyntaxError: invalid syntax

a != b
True‍‍‍‍‍‍‍

Re: Why is list index out of range here but not here?

LindsayRaabe_FPCWA — Wed, 19 Sep 2018 02:03:37 GMT

Thanks for your help. Glad we at least got the index issues sorted! I'll have to look into python 3. Anything in particular here that won't talk in the new version? I'm guessing the syntax has changed?

Re: Why is list index out of range here but not here?

LindsayRaabe_FPCWA — Wed, 19 Sep 2018 02:08:39 GMT

I found a solution. I had a niggling feeling that it was the comparisons between original and current extent that was not behaving the way I expected. I originally thought this would be the best indication of the map having moved/changed based on the features in the layers. After seeing the scale print statements and how fine they were (i.e. oldscale = 404659.559547) I figured it would be highly unlikely these would ever occur twice. Thus, I changed the code from comparing original and current extent to scales and now it works as expected.

Can't thank you enough for your help with this!

Re: Why is list index out of range here but not here?

DanPatterson_Retired — Wed, 19 Sep 2018 02:15:29 GMT

As for python 3, I have forgotten most of the differences since I have been using 3 for so long (even with arcmap code).

The porting isn't that difficult and many of the differences don't affect the average user.

print.... no longer print "stuff" but print("stuff")

It is all in the python docs which are at 3.8 beta, 3.6 is used by python

I try to maintain any significant change in my blog post

/blogs/dan_patterson/2016/05/09/the-links

as for ArcGIS Pro and transitioning to it... this is a good place to start and there is something for modelbuilder checks as well

Tools that are not available in ArcGIS Pro—Appendices | ArcGIS Desktop

good luck