idea Python Add-Ins for ArcGIS Pro in ArcGIS Pro Ideas

Python Add-Ins for ArcGIS Pro

BryanChastain — Thu, 02 May 2024 15:22:26 GMT

We're just now getting the full functionality of Python in ArcMap via Python Add-Ins, but now everything is moving to ArcGIS Pro and I noticed that there are not any plans to include Python Add-Ins for Pro as well. I do like the new mapping module for Pro, but please also give us the ability to create Add-Ins with Python as well.

Re: Python Add-Ins for ArcGIS Pro

DanielGreene — Fri, 31 Mar 2017 03:02:31 GMT

I agree. Python Add-Ins are great and not having to use Visual Studio and C# to create them is a very good deal!

Re: Python Add-Ins for ArcGIS Pro

Ericvan_Praag — Tue, 27 Jun 2017 21:34:14 GMT

One Esri client is extremely interested in this functionality. They will like to be able to have continued support for Phyton Add-ins for ArcGIS Pro.

Re: Python Add-Ins for ArcGIS Pro

KoryKramer — Tue, 24 Oct 2017 14:56:55 GMT

Daniel, are you able to please provide details about what you're doing with your Python add-ins. What functionality are you providing through the add-in?

Re: Python Add-Ins for ArcGIS Pro

KoryKramer — Tue, 24 Oct 2017 14:57:25 GMT

Eric, are you able to please provide details about what the customer is doing with their Python add-ins. What functionality are they providing through the add-in(s)?

Re: Python Add-Ins for ArcGIS Pro

ChrisSnyder — Tue, 24 Oct 2017 16:55:28 GMT

Python is an important and necessary "easy" GIS automation language... much akin to AML and Avenue and how those languages kindled a strong, vibrant, and skilled "GIS Analyst" caste. Continued support of Python (and Python AddIns) in ArcGIS Pro is a confirmation by ESRI for the continued support for this vital "GIS Analyst" role. These are the people that wear many hats in an organization and do all the geoprocessing, cartography, analysis, and automation, but don't necessarily want to be a full blown .NET Programmer. Many of us got into GIS for the coolness aspect, but also many of us are not enamored with the idea of doing full time programming work. Prior to the active support of Python (ArcGIS v9.0), ESRI had, in my opinion, inadvertently divided the traditional "GIS Analyst" role two main groups:

1. Programmers (people that you had to go to in order to automate anything)

2. Cartographers and data editors (non-programmers)

I am pleading with ESRI to actively support the classic GIS Analysts in the world by continuing strong and active support Python - and specifically continue their support for Python AddIns in ArcGIS Pro.

Re: Python Add-Ins for ArcGIS Pro

ChrisSnyder — Tue, 24 Oct 2017 17:37:00 GMT

FYI: Here is an ugly copy/paste of some documentation for a Python AddIn that we (WA State Dept. of Natural Resources, Forest Resources Division) developed internally for our Timber Sales Program staff (see below, pictures got lost, but you get the point). The Python AddIn basically assists in the automation of standard high quality map products that are used by our customer base (private companies that bid on the timber resources we put up for auction). Prior to the Python Addin: Because we lacked the .NET/ArcObjects skills internally in the business group (and our IT Division refused to assist us at the time), we had to contract this work to a rather expensive and difficult to work with private consulting firm to build an ArcObjects .NET toolbar that did basically the same thing. The old ArcObjects tool was extremely buggy and very difficult to maintain. Now, the new Python-Addin tool is easily maintained and upgraded by very competent internal GIS Analyst staff who are in direct communication with our timber sales business staff. Talk about streamlining and silo busting - the development of our "SUMA" Python AddIn tool was a smashing success and we couldn't have done it without ArcGIS support for Python AddIns.

Honestly, I (and many other users) find it maddening that ESRI regularly drops support for certain functionality on a seemingly regular basis without much care as to how it impacts their user base. I recognize that porting Python AddIn support to Pro is a bit of work, but really, it is entirely doable!

Cmon' ESRI, your customers need you!

State Uplands Mapping Application

(SUMA) Toolbar 2.1.0 Quickstart Guide

Forest Resources

Forest Informatics

12/20/2016

Contents

Scope. 2

General steps to create timber sale map documents with the new tool 2

Create New Project. 3

Edit Data. 5

Using the Dynamic Legend. 6

Navigate Map products. 8

Define pages for output. 8

Reorder/Delete Pages. 12

Create Final Output. 14

Scope

The State Uplands Mapping Application (SUMA) Toolbar is an ArcGIS Desktop addin developed by the DNR Forest Resources Division, Forest Informatics Section. It provides tools, functions, and standardized map products to assist DNR staff in duties associated with creating Timber Sale map packets. This version of the addin was developed using the Python programming language, and the Python Addin functionality of ArcGIS 10.4.1. In this version of SUMA, our goal is to leverage out-of-the-box functionality of ArcMap, automate processes when possible, and to rely on users’ skills working with the base software to more efficiently create SUMA map products.

General steps to create timber sale map documents with the new tool

Login to Citrix
Add SUMA toolbar (If not checked on by default)
Create a new project
Edit data (and dynamic legend)
Navigate map products
Define map pages for output
View page definitions
Reorder or Delete pages
Create final output

1 Log in to the Citrix Environment

Login to Citrix: http://citrixstorefront/Citrix/DNRXAOLY101-IWeb/

Start Basic ArcMap 10.4.1

2 Create New Project

The new version of SUMA will create all map products in a directory that you specify. It copies data from sources on the network, and creates a local file geodatabase to hold user data. The local geodatabase also stores a grid feature that is used to hold map page definitions (page extents). At the time of project creation all map products are copied into the user-specified location.

Select ‘SUMA Project > New Project’

Select the Region where your timber sale is located. (This value is used to filter Timber Sales)

Select the timber sale name from the drop down menu (This value is used to populate the agreement number)

The agreement number (if it exists) is displayed in the next field. It is for display purposes only.

In the ‘Output Folder’ field, enter the path to the network location where your region’s timber sale map projects are saved. A folder will be created in this directory with the naming convention ‘suma_<sale_name>’, where the sale name is stripped of special characters, converted to lowercase, and spaces are replaced with underscores. All map products and a file geodatabase will be created in the location.

From the ‘Open map’ drop down menu, select the mxd that you would like to open when the tool completes.

Optional: Browse to a shapefile or feature class that defines your timber sale. This will be used in place of spatial data in P&T.

Optional: Provide a custom distance used when clipping corporate roads for use in your Haul Route feature class. This will be useful if your sale is greater than 1 mile away from the major road that will be used to access the sale area. You will need to provide a distance value and unit of measure. If this is left blank, a default of 1 mile will be used.

Note: When the tool completes it will attempt to open the map document that you specified in your current ArcMap Session.

If you select ‘Cancel’, the tool will not open the new SUMA map product that you specified in the tool dialog.

3 Edit Data

SUMA 2.1 relies on the built-in functionality of ArcMap whenever possible. This is the case for editing where you will use Feature Templates that have been defined with existing symbology and default attribute values to add new features.

Start an editing session within your map document. When you do this, the ‘Create Features’ window should be active. Within the ‘Create Features’ window, feature templates are available to add new features to the feature classes that are present in the table of contents.

Save your edits and stop the edit session.

4 Using the Dynamic Legend

The new SUMA map products use a dynamic legend. Therefore, only features that are visible in the data frame are present in the legend. As you pan to new extents, the legend should update to reflect the symbology of the features that are in the new extent.

This may be undesirable if you do not want all of the symbolized values to be shown in the legend. You will notice that there are two Unit Tags layers and two Stream Labels layers in the Table of Contents of some of your map products. For example, there is a ‘Unit Tags Legend’ and ‘Unit Tags’ layer in the Timber Sale Map. The ‘Unit Tags Legend’ layer is the layer that determines which values are symbolized in the legend. You can remove symbols in this layer, which will remove them from the legend, without effecting the symbology in your dataframe.

Example 1: You edit your ‘Unit Tags’ layer by adding a record for ‘Right of Way Tags’ (single line) and ‘Right of Way Tags’ (double line). You only want one of these values to be visible, so you manually edit the ‘Unit Tags Legend’ layer to show the symbols visible in the map.

Example 2: You want all of the values from your ‘Unit Tags’ layer to show up in the legend, and you don’t want to update the ‘Unit Tags Legend’ layer for each new dataframe extent. You remove the ‘Unit Tags Legend’ from the legend, and add the ‘Unit Tags’ layer. If you select Items > Unit Tags > Only show classes that are visible in the current map extent, the software will update the legend dynamically. There are no ‘Unit Tags’ features visible in the dataframe, so no values are visible in the legend.

Note: if a record with a value previously absent in the legend is added via an edit session, that new symbol will not be visible in the legend until the edits are saved and the edit session is closed.

5 Navigate Map products

Navigation between map products is accomplished with the built-in ‘Open’ button. The default folder is the folder where the current map document is saved. You no longer open SUMA map products using a project file, you can open the .mxd just as you would any other.

6 Define pages for output

This version of SUMA will use extent rectangles with attributes that identify the associated map product to generate pdf documents and define bookmarks. In general, when a user defines a map page, he or she is capturing the extent of the data frame, and a polygon is created using those coordinates and inserted into the Grid_Index feature class in the Source_Data.gdb.

There are two tools that can be used to generate these extent rectangles. The first is the ‘Page Selector’ tool. This button will capture the current extent of the dataframe, and create an extent polygon. The page number is incremented automatically. This tool is only available in the Page Layout View.

The second way to define map pages is to use the ‘Import Pages’ tool. This tool will copy the extent rectangles that have been defined for one map product, and apply them to another map product. It does not change any map product, or copy any data except the appropriate Grid_Index features.

a) Page Selector

Zoom to the extent that you want to record for final map production. Note: There are scale requirements for some map products. The tool will present a message box and will not work if the scale is outside the acceptable range.

Select Tools>Page Selector

When prompted, Select ‘Yes’ to record the current extent into the Grid_Index feature class. During the process of exporting map pages to pdf format, the current map product will be zoomed to this extent, and a page will be created. If you select ‘No’ or ‘Cancel’, the current extent is not recorded.

If you are working in a map product that shares a scale range requirement with another, you will be asked to reuse the extent for the other map products. If you select ‘Yes’, the current extent will be recorded in the Grid_Index feature for later use in the ‘Create Final Output’ tool for the other map product. For example, if you are working in your Timber Sales Map and you select ‘Yes’ to reuse the current extent, that extent will be recorded for the FPA Map in addition to the Timber Sales Map. If you select ‘No’ or ‘Cancel’, the current extent will be recorded for the current map product.

b) Import Pages

Select Tools>Import Pages

Enter the source map product that has the extents you wish to copy from (the requirement is that you must define pages for this product prior to using this tool)

Enter the map product that will use the previously defined map extents (This will copy the extents, and associate the new index features with the map product that you select)

7 View Pages

The user will be able to view the extent rectangles that have been recorded for the current map product with the use of the ‘View Pages’ tool. The intent is to allow users to preview the extents that have been recorded to ensure that the entirety of the sale will be included in the production of final map documents. This is different than having the ability to preview the final output, but should approximate that functionality. The extents, and the associated page number, will be displayed in the dataframe. A dialog box will also be present.

By design, you will not be able to interact with the map document while viewing the pages that have been captured. Once you click ‘OK’, your map will be restored to the extent that it was zoomed to prior to using the ‘View Pages’ tool.

Open the map product you wish to view page extents for

Select Tools>View Pages

8 Zoom To

Another method to view the map page extents that have been recorded for the current map product is to use the ‘Zoom To’ drop down. The pages will be listed by page number (e.g. “page 1, page 2, etc.”), and the map will be zoomed to the extent associated with the page number after the user selects that page from the menu. You will only be able to view pages for the current map product, it will not allow you to navigate to other map products. This tool relies on the extent polygons that are stored in the Grid_Index feature class within the Source_Data.gdb.

Select the ‘Zoom To’ drop down menu

Click on the page that you wish to zoom to

9 Reorder/Delete Pages

This tool allows you to reorder and delete pages. Pages are grouped by map product, and the pages are numbered in the order they were added using the ‘Page Selector’ tool. You have the option to reorder/delete pages from all map products, or to reorder/delete pages from the current map product.

The page numbers are used to populate the ‘Bookmarks’ drop down menu to allow users to navigate to the page views he or she has recorded. Additionally, the ‘Create Final Output’ tool uses the page numbers to determine the order in which map pages are converted to pdf documents. The user can reorder map pages by moving the map page name up or down relative to other pages of the same product. The map pages for each product are determined by the position of each map page in relation to other pages of the same product. The tool automatically renumbers the map pages during execution.

The user can also delete page definitions with this tool by removing the page name from the list. Once a page is deleted, there is no way to undo this operation, although you can easily recreate a new page by using the Page Selector tool

Select Tools>Page Manager

Use the drop down menu to filter the map pages you wish to reorder. The options are ‘All Maps’ (you can reorder all pages for all map products) and ‘This Map’ (reorder pages for the current product only). In the following example, the Timber Sales Map Page 2 will become Timber Sales Map Page 1 and Timber Sales Map Page 1 will become Timber Sales Map Page 2. FPA Map Page 1 will remain FPA Map Page 1. Note: the order, or page numbering, is applied by map product.

If you wish to delete a map page (extent polygon) so it is not used as a bookmark or in the final map page creation, highlight the map page name, and select the button. In this example FPA Map pg. 1 was selected, and removed from the list.

Select ‘OK’, and the pages that were removed from the list will be deleted, and the pages will be renumbered to reflect the order that they appear in the list (Page numbers increase from top to bottom)

10 Create Final Output

This tool uses the grid index feature to export map documents to pdf format. A date-stamped folder is created in the folder the current map document was opened from, using the naming convention: ‘output_YYYYMMDD_HHMMSS’, and optionally, another folder named ‘pages’ will be created within the date-stamped folder. This is done every time the user uses this tool. Previous output is not overwritten.

By default, one pdf is created by map product. For example, if there are three pages defined for the Timber Sales Map and two pages defined for the Driving Map, then two pdf documents will be created: one Timber Sales pdf and one Driving Map pdf. Optionally, the user can check the box that asks, “Single Page Output (optional)”, and one pdf will be created for each page, regardless of the map product. These will be stored in the ‘pages’ subfolder. In the previous example, if the user had checked the optional box, then three Timber Sales Map pdf’s and two Driving Map pdf’s would be created in addition to the other pdf documents.

Upon completion, the output folder is opened and the user can open the pdf’s that were created.

Select Tools>Create Final Output

In the ‘Pages’ list, manually check the box next to the pages that you would like to be included in the final pdf documents. (Optionally, you can select the ‘Select All’ button to include all pages)

Check the box next to the ‘Single Page Output (optional)’ dialog if you wish to have single pdfs for each page. This can be useful if you will be using the pdfs with a mobile GIS application.

Select ‘OK’, and your pdf documents will be created. A windows explorer window will be opened to the output folder that holds the final pdf documents.

Re: Python Add-Ins for ArcGIS Pro

KoryKramer — Tue, 24 Oct 2017 22:04:15 GMT

Wow! Thank you for the detail, csny490‌. Very helpful.

Re: Python Add-Ins for ArcGIS Pro

JustinConnerWR — Fri, 19 Jan 2018 16:28:04 GMT

Python add-ins can be easier for users to find/use than Python script tools. Is it possible to add a custom toolbox to the ribbon interface as a workaround?

Re: Python Add-Ins for ArcGIS Pro

DanielGreene — Fri, 19 Jan 2018 18:37:14 GMT

Hello,

I have been building some Add-ins based on ArcGIS toolboxes for both the USFS and BLM. In addition I have migrated two large C# arc object programs and their corresponding Add-ins to python code and add-ins for much easier future maintenance. Now I can do the complete job with only ArcGIS, python, toolbox forms, and arcpy. It is nice to not have to pass the toolbox off to a .NET developer just to do the add-in. I hate the back and forth and problems that can cause (and cost to an agency). I really dislike the idea of purchasing Visual Studio just so I can distribute the python tools in the form of an add-in. On one of the C# conversions I was able to tweak the python version to get better performance than the compiled C# version which was a surprise to me.

A few of the more complex python programs used cx_Oracle to perform large queries of the agencies oracle database. The oracle passwords had to be protected. I found that password protecting a large program made it very slow to open off of the toolbar. However, the oracle query portion could be split off into a smaller tool in the toolbox that is called from the main program and password protected solving that problem. It seems that with some thought one can get around most development problems for ArcGIS using python. And, there are huge python resources on the internet. As an example, I struggled for a while figuring out how to put the oracle queried tuple into the arcpy "in_memory" but after looking around the internet I found the solution to that.

Python has finally replaced AML with as much and more functionality. Qualified GIS users in government agencies can now develop professional Add-Ins with only the software available to them that comes with ArcGIS. Not having the capability of a python Add-in could be a good reason for agencies to not move forward with ArcGIS Pro. Python should now be the language of choice for building most ArcGIS applications. Using .NET and VS should be reserved for applications needing complex custom forms. I have found that for most applications that the forms available with a standard toolbox are very adequate if used correctly. And, the program becomes much simpler if it does not have to include internal forms.

At least a toolbox works well with ArcGIS pro and it is easy to port a python 2.7 program that uses mostly arcpy toolbox commands over to 3.x. Of course, ArcGIS Pro does not recognize the location of MXDs but there are mostly minor problems such as wanting spaces and not tabs. The only major problem I see is if it does not support a python add-in. That would be greatly disappointing.

Come on ESRI - Please develop the necessary tools for a user to create a Python Add-in with ArcGIS Pro. If you don't, moving on to ArcGIS pro will seem like going backwards in functionality. I think that GIS users are just starting to catch on to the power of a Python Add-in. Don't give up on them.

Dan

Re: Python Add-Ins for ArcGIS Pro

DanielGreene — Fri, 19 Jan 2018 18:46:35 GMT

Hi Kory,

I have not signed on to this site in quite a long time. However, I added a post below that should help answer your question. I have been building python tools for the BLM and FS. I think that python ADD-ins are just starting to catch on and once they do folks will demand that functionality with ArcGIS pro.

Dan

Re: Python Add-Ins for ArcGIS Pro

KoryKramer — Fri, 19 Jan 2018 19:55:55 GMT

Thank you for the well thought out response, dgreene0141‌ I will make sure that your story is conveyed to the appropriate team.

Cheers

Re: Python Add-Ins for ArcGIS Pro

DanielGreene — Sat, 20 Jan 2018 00:54:44 GMT

Thanks Kory,

I appreciate that you are sharing my concerns with others.

Dan

Re: Python Add-Ins for ArcGIS Pro

DanielGreene — Wed, 14 Feb 2018 17:45:25 GMT

Hi,

If we don't get python add-in capability we at least need a replacement for this command that works for desktop:

pythonaddins.GPToolDialog(toolPath,'EditSpecies')

so that we can bring up the actual toolbox form just as we had navigated through the toolbox and selected the tool. If we have this capability in PRO then there could be just a small C# ADD-IN button that would call the python program and the python program could call the tools. You can import a toolbox and call a python script but that assumes that you pass parameters and does not invoke the form.

Dan

Re: Python Add-Ins for ArcGIS Pro

DarrylKlassen1 — Wed, 07 Mar 2018 17:46:40 GMT

I too am looking for something similar in ArcGIS Pro. We haven't moved our project work there, but it is coming. I have built various tools using PythonAddins (pythonaddins.GPToolDialog(toolPath,'EditSpecies')) as well as using the AddinAssistant.exe. This I have used to create tools the build bookmarks, zoom to intersections, add specific data directly, etc and without this functionality, our processes and workflows will be slowed and have to change. Please ESRI, consider implementing something that replaces this - so we don't have to re-write all our tools in other languages/development tools.

Re: Python Add-Ins for ArcGIS Pro

JoshuaBixby — Wed, 21 Mar 2018 15:16:33 GMT

I agree with others, supporting Python Add-ins is a critical need for ArcGIS Pro.

In response to Kory Kramer‌ likely next question, Esri has already answered the "why" in its own documentation: What is a Python add-in?

ArcGIS 10.1 introduces Python to the list of languages for authoring Desktop add-ins, providing you with an easy solution to extend desktop functionality.

My question back to Esri is, "why do you want to make extending desktop functionality more difficult in Pro by taking Python add-ins away?" I think the onus is on Esri to demonstrate the lack of continued need and removal of the feature rather than making the customers who have been using the functionality for 7+ years justify keeping/adding it.

Re: Python Add-Ins for ArcGIS Pro

South_JordanCity_of — Wed, 21 Mar 2018 21:22:45 GMT

Same here. We're using 7-8 python addins almost daily that we programmed ourselves to make our workflow more efficient.

I really want to like Pro, but man, ESRI is not making the switch very convenient, it's like going backwards a few versions, which is very disappointing. The last thing I want to do is to spend hours and hours to learn yet another language to somewhat accomplish what I'm already doing with Python addins.

Pro right now is a major pain, and I will surely not use it until Arcmap 10.x is on its last leg, and I'm forced to switch to Pro. And then the agony will begin..

I hope, ESRI will listen to the users of their products.

Marc

Re: Python Add-Ins for ArcGIS Pro

DanielGreene — Mon, 23 Apr 2018 15:11:52 GMT

Good Morning,

This is how I see the problem.

Evaluation of Government Agency Migration from Desktop to ArcGIS PRO

Positive: 64 bit processing, benefits of 64 bit processors and memory use, improved tools, python 3.x, easy migration of custom toolboxes, etc., interaction with arc

Negative: Agency GIS Coordinators will no longer be able to build "in-house" Add-Ins and will have to spend money on contracts to create Add-Ins using Visual Studio. This will be a considerable cost to the agencies compounded over several years and is a step backwards in functionality.

The comment in an earlier post is right on: "providing you with an easy solution to extend desktop functionality. " referring to the python Add-In capability. ESRI - Please don't remove a positive step in the right direction.

Dan

Re: Python Add-Ins for ArcGIS Pro

DanielGreene — Wed, 09 May 2018 12:58:17 GMT

One slick thing about ArcGIS pro is that if you right click on a tool in the toolbox you can add it to the analysis ribbon (gallery). This works pretty well in that when you hover over it the description that you have in the meta data for the tool will show up just. Now, if only the image that you have in the description for the tool would show up this would not be a bad alternative to an Add-In. However, the downside is that a user would still have to set it up for every new project (It is saved with the project) but once set up it is very visible and works like an add-in toolbar. The ESRI tools on the analysis ribbon all have nice images but I have even tried using those 32x32 png files in the ESRI directory and the image when adding a tool to the ribbon does not change from the default. The hover over description is a very nice feature though so perhaps the image capability is on the way. Regardless - we still need the Add-In but if we don't get it I will probably push for the ribbon route rather then messing with Visual Studio and will try to convince users to forget add-in and move in this other direction (maybe a project template?).

Pull down hover over description works but not the image as is the description - Summary (Abstract)

The image I'm talking about is in the tool metadata

Re: Python Add-Ins for ArcGIS Pro

DrewFlater — Wed, 09 May 2018 20:26:24 GMT

Hi Daniel and all,

Several people have mentioned that part of why they like Python Add-ins is to simply open a script tool form/dialog directly from a custom toolbar/menu/ribbon/etc. I'd like to show you that we have a new feature in the Pro 2.2 Beta that allows you to customize the ribbon and quick access toolbar with any geoprocessing tool (both Esri system tools and your custom script and model tools that have been added to the project). This provides another solution in addition to the customization of the Analysis gallery mentioned above.

These ribbon and Quick Access Toolbar customizations are saved into a user file in your Local App Data folder (%localappdata%\ESRI\ArcGIS.Desktop.Config.daml), so they apply to any project you open as the same user (and can be shared within an organization if the customization makes sense for all staff to use). The daml file can be configured to change the icon, size, and many other properties of the ribbon buttons.