topic Re: Use Arcpy to Unselect the currently selected Features in all layers in Python Questions

Use Arcpy to Unselect the currently selected Features in all layers

OLANIYANOLAKUNLE — Tue, 15 Oct 2013 11:42:48 GMT

I have a script that unselects all the selected features in my Map view but it loops through each layer in the dataframe and this takes a lot of time. I want to write a script that would be as fast as the Unselect the currently selected Features in all layers within ArcMap itself? This is my code below;

mxd = arcpy.mapping.MapDocument("Current")
df = arcpy.mapping.ListDataFrames(mxd)[0]
for lyr in arcpy.mapping.ListLayers(mxd):
...     arcpy.SelectLayerByAttribute_management(lyr, "CLEAR_SELECTION")
...     
Runtime error  Traceback (most recent call last):   File "<string>", line 2, in <module>   File "C:\Program Files (x86)\ArcGIS\Desktop10.1\arcpy\arcpy\management.py", line 6461, in SelectLayerByAttribute     raise e ExecuteError: Failed to execute. Parameters are not valid. ERROR 000840: The value is not a Table View. ERROR 000840: The value is not a Raster Layer. ERROR 000840: The value is not a Mosaic Layer. Failed to execute (SelectLayerByAttribute).

Any Suggestions? Thanks

Re: Use Arcpy to Unselect the currently selected Features in all layers

T__WayneWhitley — Fri, 10 Dec 2021 22:28:21 GMT

I don't believe the capability exists within arcpy to 'wholesale' clear all selected features in the active dataframe...the way you are currently using the method to clear each layer is pretty much it. Unless you want to delve into ArcObjects...or, say, use the comtypes 'wrapper' to basically invoke the ArcObjects methods not readily available via arcpy.

Perhaps not the prime place to post about ArcObjects - I'll be brief though...
You raised an interesting topic (for which I see there have been no posted responses yet)...however, it is kind of intriguing that although continuing support for VBA is no longer provided (no new features), this code still works at 10.0 - I just tested the following on my 10.0 (and probably it still works at 10.1, and 10.2?...I have not yet migrated my VBA authorizations above 10.0 and will likely adapt something like this as VB.NET in the future). Here is the working VBA code to clear all selected features for all layers in the active data frame --- just for 'honorable mention', and it's so clean and simple:

Sub ClearSelection()

Dim pApp As IApplication
Set pApp = Application

Dim pMxDoc As IMxDocument
Set pMxDoc = ThisDocument

Dim pMap As IMap
Set pMap = pMxDoc.ActiveView

Dim pAV As IActiveView
Set pAV = pMap

pMap.ClearSelection
pAV.Refresh

Debug.Print "done!"
End Sub

Enjoy,
Wayne

Re: Use Arcpy to Unselect the currently selected Features in all layers

XanderBakker — Fri, 10 Dec 2021 22:28:24 GMT

I have a script that unselects all the selected features in my Map view but it loops through each layer in the dataframe and this takes a lot of time. I want to write a script that would be as fast as the Unselect the currently selected Features in all layers within ArcMap itself? This is my code below;
mxd = arcpy.mapping.MapDocument("Current")
df = arcpy.mapping.ListDataFrames(mxd)[0]
for lyr in arcpy.mapping.ListLayers(mxd):
...     arcpy.SelectLayerByAttribute_management(lyr, "CLEAR_SELECTION")
...     
Runtime error  Traceback (most recent call last):   File "<string>", line 2, in <module>   File "C:\Program Files (x86)\ArcGIS\Desktop10.1\arcpy\arcpy\management.py", line 6461, in SelectLayerByAttribute     raise e ExecuteError: Failed to execute. Parameters are not valid. ERROR 000840: The value is not a Table View. ERROR 000840: The value is not a Raster Layer. ERROR 000840: The value is not a Mosaic Layer. Failed to execute (SelectLayerByAttribute).
Any Suggestions? Thanks

Strange, if I run the (slightly changed) code it does run for me (in 10.2)

import arcpy
mxd = arcpy.mapping.MapDocument("CURRENT")
dfs = arcpy.mapping.ListDataFrames(mxd)
for df in dfs:
    for lyr in arcpy.mapping.ListLayers(mxd,"*",df):
        if lyr.isFeatureLayer:
            arcpy.SelectLayerByAttribute_management(lyr, "CLEAR_SELECTION")

    for tbl in arcpy.mapping.ListTableViews(mxd,"*",df):
        arcpy.SelectLayerByAttribute_management(tbl,"CLEAR_SELECTION")

What type of layers do you have in your TOC?

Kind regards,

Xander

Re: Use Arcpy to Unselect the currently selected Features in all layers

OLANIYANOLAKUNLE — Fri, 10 Dec 2021 22:28:27 GMT

Strange, if I run the (slightly changed) code it does run for me (in 10.2)

import arcpy
mxd = arcpy.mapping.MapDocument("CURRENT")
dfs = arcpy.mapping.ListDataFrames(mxd)
for df in dfs:
    for lyr in arcpy.mapping.ListLayers(mxd,"*",df):
        if lyr.isFeatureLayer:
            arcpy.SelectLayerByAttribute_management(lyr, "CLEAR_SELECTION")

    for tbl in arcpy.mapping.ListTableViews(mxd,"*",df):
        arcpy.SelectLayerByAttribute_management(tbl,"CLEAR_SELECTION")

What type of layers do you have in your TOC?

Kind regards,

Xander

Yeah, your code works but it takes the same time with what I have to go through each of the layers one after the other? I want something as fast as the " to Unselect the currently selected Features in all layers" in ArcMap

Re: Use Arcpy to Unselect the currently selected Features in all layers

TimWitt — Fri, 18 Oct 2013 19:03:28 GMT

Sadly this is not possible, you need to cycle through each layer 😞

Re: Use Arcpy to Unselect the currently selected Features in all layers

T__WayneWhitley — Fri, 18 Oct 2013 19:06:57 GMT

Yes that is good code Xander posted; however I think what confused him was your question wasn't related to the error in the code you posted.

No you do not have the same access with arcpy as you do with the system ArcMap button to 'Clear Selected Features'.

Maybe you can rig something to access ArcObjects with comtypes...but I think that's beyond the scope of this thread?

Enjoy,
Wayne

Re: Use Arcpy to Unselect the currently selected Features in all layers

XanderBakker — Mon, 21 Oct 2013 05:43:41 GMT

Wayne is right, ArcObjects will be the way to go. It is possible to use COM objects (ArcObjects) in Python.
If you want to know a bit more, the following links may be helpful:

http://forums.arcgis.com/threads/2567-Accessing-ArcObjects-through-Python
http://www.pierssen.com/arcgis/upload/misc/python_arcobjects.pdf
http://stackoverflow.com/questions/12190807/com-objects-arcobjects-in-python

Good luck,

Xander

Re: Use Arcpy to Unselect the currently selected Features in all layers

T__WayneWhitley — Fri, 10 Dec 2021 22:28:30 GMT

I'd like to post again both a VBA snippet and the Python comtypes equivalent... I don't know why I did not shorten the code in post #2 above to clear all selected features in the view (the current view, otherwise known as the 'focus map') to that listed below, effectively the same:

Sub ClearSelection()

Dim pMxDoc As IMxDocument
Set pMxDoc = ThisDocument

pMxDoc.FocusMap.ClearSelection
pMxDoc.ActiveView.Refresh

End Sub

Basically, the above is a VBA subroutine (called by the name ClearSelection) that sets a document object to the currently loaded mxd, clears the selection in the entire 'focus map', and refreshes the view (to show all feature selections have been cleared).
I don't think you can test this code any longer at 10.1, but you can at 10.0 if you've authorized (for free, and depending on availability) the VBA 'extension' with ESRI.

That's about as simple as you can write ArcObject code, using VBA... Only reason I wanted to show that is for comparison purposes, particularly for anyone interested in migrating VBA code to Python, using comtypes. I am yet relatively unfamiliar with comtypes but figured if there's a place to at least start the 'test drive', this oh-so-simple sample would be as good as any. So, without further ado, here it is - I am sure you can see the similarities:

import Snippets
import comtypes
from Snippets import CType

a = Snippets.GetApp()
from comtypes.gen.esriArcMapUI import *

mxDoc = CType(a.Document, IMxDocument)
mxDoc.FocusMap.ClearSelection()
mxDoc.ActiveView.Refresh()

Once everything is loaded, it is fast... also, once the document obj mxDoc is instantiated, only the last 2 commands need be executed on successive feature selection clearing. Of course, to be able to launch this, you need to install comtypes, downloaded from SourceForge. You also need a Snippets module - thanks very much for the 10.0-adapted module by Corey Blakeborough
of SSP Innovations and Mark Cederholm who wrote the original. The adapted version (which I used in the above 'clear selection' snippet) is at the link below:

http://www.sspinnovations.com/sites/default/files/assets/assets/SCRIPTS/Snippets.py

All I've got for now...this is just a very thin opening to the heap of things you can do with ArcObjects.

Enjoy,
Wayne

Re: Use Arcpy to Unselect the currently selected Features in all layers

MattSayler — Wed, 23 Oct 2013 20:09:38 GMT

Comtypes is probably the only solution where it will be as fast as the button.

If that's not an option for whatever reason, you could keep track of the layers with selected features in a list and loop through that instead of hitting every layer. Still not great, but better.

Re: Use Arcpy to Unselect the currently selected Features in all layers

ChrisSnyder — Fri, 10 Dec 2021 22:28:32 GMT

Via a Python solution, how about checking for any selected features before you try to unselect? Which may be faster or may be slower than not checking... Describe is pretty fast, so it might be worth the extra overhead.

if len(arcpy.Describe(lyr).fidSet) > 0:
    arcpy.SelectLayerByAttribute_management(lyr, "CLEAR_SELECTION")

BTW: Good to meet you last week Matt S.!

Re: Use Arcpy to Unselect the currently selected Features in all layers

ChrisSnyder — Fri, 10 Dec 2021 22:28:35 GMT

Not sure if ArcObjects/ComTypes is totally neccesssary here. Also, going back to the original post... The 3rd line should be:

for lyr in arcpy.mapping.ListLayers(df):

not

for lyr in arcpy.mapping.ListLayers(mxd):

In arcpy-land, the trick is to turn the layers' visibility off 1st, clear the selection(s), then turn the visible layer back on. Otherwise it want's to redraw every loop... which is really slow.

A little cluncky and verbose (might take out the .fidSet part - not sure if it would help that much). For me, this code takes 2 seconds to do the actual unselecting for ~6 layers with 20k features selcted... And then a redraw, which also takes time. The ArcMap unselect tool takes like 0.25 seconds... And DOESN'T have to redraw!

mxd = arcpy.mapping.MapDocument("CURRENT")
df = arcpy.mapping.ListDataFrames(mxd)[0]
lyrList = arcpy.mapping.ListLayers(df)
lyrDict = {}
for lyr in lyrList:
    lyrDict[lyr] = [lyr.visible, False]
    if len(arcpy.Describe(lyr).fidSet) > 0:
         lyrDist[lyr][1] = True
for lyr in lyrDict: #turn any visible layers off
    if lyrDict[lyr][0] == True:
        lyr.visible = False
arcpy.RefreshActiveView()
for lyr in lyrDict: #clear selections
    if lyrDict[lyr][1] == True:
        arcpy.SelectLayerByAttribute_management(lyr, "CLEAR_SELECTION")
for lyr in lyrDict: #turn any previously visible layers back on
    if lyrDict[lyr][0] == True: 
        lyr.visible = True
arcpy.RefreshActiveView()

EDIT: Fewer lines - with comprehensions!

mxd = arcpy.mapping.MapDocument("CURRENT")
df = arcpy.mapping.ListDataFrames(mxd)[0]
lyrDict = {}
for lyr in arcpy.mapping.ListLayers(df):
    lyrDict[lyr] = [lyr.visible, False]
    if len(arcpy.Describe(lyr).fidSet) > 0:
         lyrDist[lyr][1] = True
for lyr in [lyr for lyr in lyrDict if lyrDict[lyr][0] == True]:  #turn any visible layers off
    lyr.visible = False
arcpy.RefreshActiveView()
for lyr in [lyr for lyr in lyrDict if lyrDict[lyr][1] == True]: #clear selections
    arcpy.SelectLayerByAttribute_management(lyr, "CLEAR_SELECTION")
for lyr in [lyr for lyr in lyrDict if lyrDict[lyr][0] == True]: #turns layers back on 
    lyr.visible = True
arcpy.RefreshActiveView()

Re: Use Arcpy to Unselect the currently selected Features in all layers

ChrisSnyder — Fri, 10 Dec 2021 22:28:38 GMT

It'd be nice if the layer object from arcpy.mapping had some sort of 'selected set' property via arcpy.mapping. Seems all the other layer properties (like .definitionQuery, .name, etc) make it across from the good ole' Describe object ... Why no .fidSet!?!?!

for lyr in arcpy.mapping.ListLayers(df):
    if len(lyr.fidSet) > 0: #BTW: Wish the .fidSet property returned a native Python list!
        blah blah

Maybe even:

for lyr in arcpy.mapping.ListLayers(df):
    if lyr.hasSelection == True:
        blah blah

Hoping for some extra features for arcpy in the future!

Re: Use Arcpy to Unselect the currently selected Features in all layers

T__WayneWhitley — Fri, 10 Dec 2021 22:28:41 GMT

Ah, thank you Chris, you got me thinking about performance of the display refresh - this can be a subtlety greatly impacting performance. So what I needed access to was PartialRefresh (IActiveView)... I was banging my head against this for awhile, and had to go back to the basics to understand w/ VBA. So this VBA code more precisely mimics the 'Clear Selected Features' button (without redrawing everything):

Dim pMxDocument As IMxDocument
Dim pMap As IMap
Dim pActiveView As IActiveView

Set pMxDocument = ThisDocument
Set pMap = pMxDocument.FocusMap
Set pActiveView = pMap

pActiveView.PartialRefresh esriViewGeoSelection, Nothing, Nothing
pMap.ClearSelection

So, with that, I pared down my comtypes code to do essentially the same thing (please bear in mind, I'm still learning to apply this thing called comtypes):

import Snippets
import comtypes.gen.esriArcMapUI as esriArcMapUI
import comtypes.gen.esriCarto as esriCarto

pApp = Snippets.GetApp()
pDoc = pApp.Document
pMxDoc = Snippets.CType(pDoc, esriArcMapUI.IMxDocument)
pMap = pMxDoc.FocusMap
pAV = Snippets.CType(pMap, esriCarto.IActiveView)

pAV.PartialRefresh(esriCarto.esriViewGeoSelection, None, None)
pMap.ClearSelection()

The 1st time running in ArcMap, it takes a moment to load but nothing really limiting, and successive executions...uh, greased lightning (pardon the pun).

One more thing I may have omitted... since the script has been pared down, I admit I am not sure yet about what the comtypes is doing in the GetModule function, but it's getting called from the facilitating Snippets.py (also called GetModule) with:

from comtypes.client import GetModule

It has to do with getting the COM library refs...I think the 2 code lines below 'bypass' Snippets to get specifically to the interfaces needed (IActiveView and IMxDocument):

import comtypes.gen.esriArcMapUI as esriArcMapUI
import comtypes.gen.esriCarto as esriCarto

Not sure I fully understand that just yet - anyway, if I cut out too much in the 'initialization', you can make the Snippet.GetModule call to build what you need....

Enjoy,
Wayne

Re: Use Arcpy to Unselect the currently selected Features in all layers

T__WayneWhitley — Fri, 10 Dec 2021 22:28:43 GMT

...quick update about the comtypes installation - the above previous testing was with 10.0, which the companion module Snippets.py was designed to run with; I also have a 10.1 server installation where I installed comtypes (same version) today and got that running successfully, although haven't fully tested it yet.

However, I'll have to update Snippets if I intend to use it...I have both ArcServer and Desktop running on Windows Server 2012 and apparently the registry keys are different - the GetLibPath function that uses the python _winreg module does not find the HKEY_CLASSES_ROOT with the provided TypeLib key {866AE5D3-530C-11D2-A2BD-0000F8774FB5}....

>>> import _winreg
>>> keyESRI = _winreg.OpenKey(_winreg.HKEY_CLASSES_ROOT, \
...                               r"TypeLib\{866AE5D3-530C-11D2-A2BD-0000F8774FB5}\a.0\HELPDIR")

Traceback (most recent call last):
  File "<stdin>", line 2, in <module>
WindowsError: [Error 2] The system cannot find the file specified
>>>

That function just makes it more universal to find the root COM directory -- so for now I 'hardwired' it in this fashion (bypassing Snippets until I can get it fixed):

>>> from comtypes.client import GetModule
>>> GetModule(r'C:\Program Files (x86)\ArcGIS\Desktop10.1\com\esriArcMapUI.olb')
# Generating comtypes.gen._40499F24_596F_45D2_ACE1_A251E2990017_0_10_1
# Generating comtypes.gen._00020430_0000_0000_C000_000000000046_0_2_0
# Generating comtypes.gen.stdole
# Generating comtypes.gen._866AE5D3_530C_11D2_A2BD_0000F8774FB5_0_10_1
# Generating comtypes.gen._59FCCD31_434C_4017_BDEF_DB4B7EDC9CE0_0_10_1
# Generating comtypes.gen._C4B094C2_FF32_4FA1_ABCB_7820F8D6FB68_0_10_1
# Generating comtypes.gen._5E1F7BC3_67C5_4AEE_8EC6_C4B73AAC42ED_0_10_1
# Generating comtypes.gen.esriSystem
# Generating comtypes.gen.esriGeometry
# Generating comtypes.gen._4ECCA6E2_B16B_4ACA_BD17_E74CAE4C150A_0_10_1
# Generating comtypes.gen.esriSystemUI
# Generating comtypes.gen.esriDisplay
# Generating comtypes.gen.esriFramework
# Generating comtypes.gen._4A9C9ED7_F7DB_4614_B480_A5D265C961FC_0_10_1
# Generating comtypes.gen._0475BDB1_E5B2_4CA2_9127_B4B1683E70C2_0_10_1
# Generating comtypes.gen._18F2FC71_6B30_45B9_B101_037A8B868B66_0_10_1
...
...
...
(etc.)

If I'm using the correct terminology, the GetModule function makes a one-time call to create the 'wrapper' output to the Python install location for site pkgs, in this case comtypes makes a gen output folder (e.g., C:\Python27\ArcGIS10.1\Lib\site-packages\comtypes\gen). That's what I was referring to in my last post about 'if you need it call the GetModule function' and the output gen will be built - on successive calls the olb has already been 'wrapped', and you just need to do something like this:

import comtypes.gen.esriArcMapUI as esriArcMapUI

...and, since having problems with the Snippet helper module, until that's fixed the comtypes CreateObject method can be called directly, for example to get the current ArcMap app (only 1 ArcGIS app was running at the time):

>>> pAppROT = comtypes.client.CreateObject(esriFramework.AppROT, interface=esriFramework.IAppROT)
>>> pAppROT.count
1

>>> pApp = pAppROT.Item(0)

Hope this clarifies a little how Snippets facilitates comtypes. Maybe I haven't looked hard enough yet, but if someone knows the registry key fix for the GetLibPath function at 10.1 (Windows Server 2012), please let me know... I appreciate it.

Thanks,
Wayne

EDIT:
ah, looks like Luke has posted a modified GetLibPath function here he calls a 'kludge' but looks promising to me - I will test this tomorrow:
http://gis.stackexchange.com/questions/50714/are-there-any-python-scripts-for-creating-mxd-files/50718#50718

Re: Use Arcpy to Unselect the currently selected Features in all layers

GeorgeRiner — Thu, 05 Oct 2017 19:05:56 GMT

I find this confusion over what seem to be various flavors of 'Layer' objects. Once you get arcpy to hand you a layer object from ListLayers and you loop through them, try using the name property of the lyr instead of the layer object itself. E.g.:

this seems to work for me:

arcpy.SelectLayerByAttribute_management(lyr.name, "CLEAR_SELECTION")

And, as many others note, this is really slow. And if going to ArcObjects is not in your game, there is a python code through arcpy that clears selections really fast:

lyr.setSelectionSet("NEW",[])

Note: this is calling a method of the layer object, it is not an arcpy function.