Latest Contributions by ChrisSnyder

Francis -  In it's current state it will only work with planar coordinate systems (State Plane, UTM, etc.). Another way to do what you need is to use the "Raster To Point" tool and just add/calc a Lat and Long field to the table. Since geometry is produced (in addition to tabular records) this method would take longer, but should yield you your necessary outcome. Chris ... View more

Conspiracy theory: ESRI is withholding Python AddIns in Pro to maximize Professional Services/Business Partner profits associated with the ArcGIS Desktop to ArcGIS Pro conver$ion. Prove me wrong.   ... View more

From the looks of it, it seems you are just clipping 4 layers with a user defined polygon geometry and then inspecting the outputs... I think it would be much more efficient to use the Intersect tool to perform the goeprocessing here as opposed to 4, ideally simultaneous (but elusive) clips. Then you would scan the output using a searchcursor for the presence of the constituent records of the 4 inputs. Using the Intersect tool's join_attributes='ONLY_FID' parameter will probably make this more efficient if you just care about a yes/no presence. The right tool for the right job. ... View more

GenerateNearTable tool would be faster than a SelectByLocation in a for loop. ... then probably just SummaryStatistics based on the BUILDING_ID as the case field (mean value of the other featureclass) No programming required! ... View more

Thanks Dan, but I mean more in the context of a log file for a geoprocessing script. Tool name, parameters, etc... Basically I used to get this in Desktop: Mon Mar 04 18:00:44 2019 - Starting run of script file: \\dnr\divisions\FR_DATA\forest_info_2\gis\projects\synthetic_streams_westside\scripts\step_11_implement_stream_model_worker_v1061.py Mon Mar 04 18:00:44 2019 - Recording logfile to: D:\csny490\lidar_derivatives\step_11_implement_stream_model_worker_v1061_tile_4179_20190304180044.log Mon Mar 04 18:00:44 2019 - TEMP directory set to D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179 Mon Mar 04 18:00:44 2019 - Checked out Spatial Analyst License Mon Mar 04 18:00:44 2019 - Checked out 3D Analyst License Mon Mar 04 18:00:51 2019 - Executing: CreateFileGDB D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179 tile_4179 CURRENT Start Time: Mon Mar 4 18:00:51 2019 Succeeded at Mon Mar 4 18:00:51 2019 (Elapsed Time: 0.51 seconds) Mon Mar 04 18:00:52 2019 - Executing: Select D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\fishnet.shp D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179\tile_4179.gdb\tile_4179 "TILE_ID = 4179" Start Time: Mon Mar 4 18:00:51 2019 Succeeded at Mon Mar 4 18:00:52 2019 (Elapsed Time: 0.76 seconds) Mon Mar 04 18:01:01 2019 - Con took 7.84943149986 seconds... Mon Mar 04 18:01:03 2019 - Executing: CopyFeatures D:\csny490\lidar_derivatives\sl_trans.gdb\sl_trans D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179\tile_4179.gdb\sl_trans # 0 0 0 Start Time: Mon Mar 4 18:01:02 2019 Succeeded at Mon Mar 4 18:01:03 2019 (Elapsed Time: 1.31 seconds) Mon Mar 04 18:01:03 2019 - Executing: CalculateField fl ROAD_USGS_CLASS_CD 9 PYTHON # Start Time: Mon Mar 4 18:01:03 2019 Succeeded at Mon Mar 4 18:01:03 2019 (Elapsed Time: 0.02 seconds) Mon Mar 04 18:01:11 2019 - Executing: SelectLayerByLocation fl INTERSECT in_memory\f07C41C46_821F_403E_B860_78A1103462AD # NEW_SELECTION NOT_INVERT Start Time: Mon Mar 4 18:01:11 2019 Succeeded at Mon Mar 4 18:01:11 2019 (Elapsed Time: 0.12 seconds) Mon Mar 04 18:01:11 2019 - Executing: AddField D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179\tile_4179.gdb\sl_trans BUFF_DIST SHORT # # # # NULLABLE NON_REQUIRED # Start Time: Mon Mar 4 18:01:11 2019 Adding BUFF_DIST to D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179\tile_4179.gdb\sl_trans... Succeeded at Mon Mar 4 18:01:11 2019 (Elapsed Time: 0.09 seconds) Mon Mar 04 18:01:12 2019 - Executing: AddField D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179\tile_4179.gdb\sl_trans RASTER_VAL SHORT # # # # NULLABLE NON_REQUIRED # Start Time: Mon Mar 4 18:01:12 2019 Adding RASTER_VAL to D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179\tile_4179.gdb\sl_trans... Succeeded at Mon Mar 4 18:01:12 2019 (Elapsed Time: 0.12 seconds) but now I just get.... Wed Mar 13 11:41:29 2019 - Starting run of script file: \\dnr\divisions\FR_DATA\forest_info_2\gis\projects\synthetic_streams_westside\scripts\step_11_implement_stream_model_worker_vpro231.py Wed Mar 13 11:41:29 2019 - Recording logfile to: D:\csny490\lidar_derivatives\step_11_implement_stream_model_worker_vpro231_tile_4179_20190313114129.log Wed Mar 13 11:41:29 2019 - TEMP directory set to D:\csny490\lidar_derivatives\processing_data\rs_hydro_processing\tile_4179 Wed Mar 13 11:41:29 2019 - Checked out Spatial Analyst License Wed Mar 13 11:41:29 2019 - Checked out 3D Analyst License Wed Mar 13 11:41:30 2019 - Start Time: Wednesday, March 13, 2019 11:41:30 AM Succeeded at Wednesday, March 13, 2019 11:41:30 AM (Elapsed Time: 0.52 seconds) Wed Mar 13 11:41:31 2019 - Start Time: Wednesday, March 13, 2019 11:41:30 AM Succeeded at Wednesday, March 13, 2019 11:41:31 AM (Elapsed Time: 0.73 seconds) Wed Mar 13 11:41:32 2019 - Start Time: Wednesday, March 13, 2019 11:41:31 AM Succeeded at Wednesday, March 13, 2019 11:41:32 AM (Elapsed Time: 0.63 seconds) Wed Mar 13 11:41:41 2019 - Con took 8.238934079187088 seconds... Wed Mar 13 11:41:43 2019 - Start Time: Wednesday, March 13, 2019 11:41:41 AM Succeeded at Wednesday, March 13, 2019 11:41:43 AM (Elapsed Time: 1.19 seconds) Wed Mar 13 11:41:43 2019 - Start Time: Wednesday, March 13, 2019 11:41:43 AM Succeeded at Wednesday, March 13, 2019 11:41:43 AM (Elapsed Time: 0.17 seconds) Wed Mar 13 11:41:53 2019 - Start Time: Wednesday, March 13, 2019 11:41:51 AM Succeeded at Wednesday, March 13, 2019 11:41:51 AM (Elapsed Time: 0.12 seconds) Wed Mar 13 11:41:54 2019 - Start Time: Wednesday, March 13, 2019 11:41:53 AM Adding BUFF_DIST to sl_trans... Succeeded at Wednesday, March 13, 2019 11:41:54 AM (Elapsed Time: 0.43 seconds) Wed Mar 13 11:41:55 2019 - Start Time: Wednesday, March 13, 2019 11:41:54 AM Adding RASTER_VAL to sl_trans... Succeeded at Wednesday, March 13, 2019 11:41:55 AM (Elapsed Time: 0.44 seconds) Sad! ... View more

Well that's good news... Yeah, I'm finding that some of the arcpy.mapping functions aren't the fastest horses on the track. Onwards and upwards! ... View more

Why is there a need to write data to the in_memory tables? Seems like the stats you are calculating only rely on read data. Perhaps a dictionary could serve the purpose of you intermediate in_memory tables? Significant bottlenecks I see are: 1. Creating the intermediate tables, adding fields to them, and inserting values 2. Writing data to numpy arrays from the cursors. Seems like the np.square()  calculations are entirely doable outside of numpy. Certainly more convenient in np though. 3. Using arcpy.mapping to get a hook into the layer. Maybe you could just have a toolbox w/ an input feature layer variable that had a default value set to your desired layer name? ... View more

Note sure what the issue is - maybe just monkey with the values. For example in the interactive window try inserting some values like: updateRows.updateRow(("monkey", 1 , datetime.date(2017,2,5))) and see if they take. I know with the da cursors that dates are converted on the fly to Python datetime objects. If you interrogate the values in the dictionary are they all of the anticipated data type and order? ... View more

I assume the fields are added to the mainTbl and dictionary gets populated with the correct values, right? I don't see anything in the update cursor, but... Are the "PIN_ID" and "PIN_Num" field types the same ("123" vs 123 vs 123.0) ... View more

BTW: Long live .shp Woot woot!!! ... View more

Here's a general example of dictionary/cursor method. Could certainly be made more elegant depending on what you are trying to do....  import arcpy mainTbl = r"C:\temp\blah.shp" joinTbl = r"C:\temp\lookup.dbf" fieldsToJoinList = ["FIELD1","FIELD2","FIELD3"] joinField = "COMMON_ID" arcpy.AddField_management(mainTbl, "FIELD1", "BLAH") arcpy.AddField_management(mainTbl, "FIELD2", "BLAH") arcpy.AddField_management(mainTbl, "FIELD3", "BLAH") joinTblDict = {r[0]:r[1:] for r in arcpy.da.SearchCursor(joinTbl, [joinField]+fieldsToJoinList)} updateRows = arcpy.da.UpdateCursor(mainTbl, [joinField]+fieldsToJoinList) for updateRow in updateRows:     if updateRow[0] in joinTblDict:         updateRow[1] = joinTblDict[updateRow[0]][1]         updateRow[2] = joinTblDict[updateRow[0]][2]         updateRow[3] = joinTblDict[updateRow[0]][3]                                                   updateRows.updateRow(updateRow) del updateRow, updateRows ... View more

FYI: Here is an ugly copy/paste of some documentation for a Python AddIn that we (WA State Dept. of Natural Resources, Forest Resources Division) developed internally for our Timber Sales Program staff (see below, pictures got lost, but you get the point). The Python AddIn basically assists in the automation of standard high quality map products that are used by our customer base (private companies that bid on the timber resources we put up for auction). Prior to the Python Addin: Because we lacked the .NET/ArcObjects skills internally in the business group (and our IT Division refused to assist us at the time), we had to contract this work to a rather expensive and difficult to work with private consulting firm to build an ArcObjects .NET toolbar that did basically the same thing. The old ArcObjects tool was extremely buggy and very difficult to maintain. Now, the new Python-Addin tool is easily maintained and upgraded by very competent internal GIS Analyst staff who are in direct communication with our timber sales business staff. Talk about streamlining and silo busting - the development of our "SUMA" Python AddIn tool was a smashing success and we couldn't have done it without ArcGIS support for Python AddIns. Honestly, I (and many other users) find it maddening that ESRI regularly drops support for certain functionality on a seemingly regular basis without much care as to how it impacts their user base. I recognize that porting Python AddIn support to Pro is a bit of work, but really, it is entirely doable! Cmon' ESRI, your customers need you!   State Uplands Mapping Application (SUMA) Toolbar 2.1.0 Quickstart Guide       Forest Resources Forest Informatics 12/20/2016         Contents Scope. 2 General steps to create timber sale map documents with the new tool 2 Log in to the Citrix Environment. 2 Create New Project. 3 Edit Data. 5 Using the Dynamic Legend. 6 Navigate Map products. 8 Define pages for output. 8 Page Selector. 8 Import Pages. 10 View Pages. 11 Zoom To. 11 Reorder/Delete Pages. 12 Create Final Output. 14     Scope   The State Uplands Mapping Application (SUMA) Toolbar is an ArcGIS Desktop addin developed by the DNR Forest Resources Division, Forest Informatics Section. It provides tools, functions, and standardized map products to assist DNR staff in duties associated with creating Timber Sale map packets.  This version of the addin was developed using the Python programming language, and the Python Addin functionality of ArcGIS 10.4.1.  In this version of SUMA, our goal is to leverage out-of-the-box functionality of ArcMap, automate processes when possible, and to rely on users’ skills working with the base software to more efficiently create SUMA map products. General steps to create timber sale map documents with the new tool Login to Citrix Add SUMA toolbar (If not checked on by default) Create a new project Edit data (and dynamic legend) Navigate map products Define map pages for output View page definitions Reorder or Delete pages Create final output   1       Log in to the Citrix Environment   Login to Citrix: http://citrixstorefront/Citrix/DNRXAOLY101-IWeb/   Start Basic ArcMap 10.4.1              2       Create New Project   The new version of SUMA will create all map products in a directory that you specify. It copies data from sources on the network, and creates a local file geodatabase to hold user data.  The local geodatabase also stores a grid feature that is used to hold map page definitions (page extents).  At the time of project creation all map products are copied into the user-specified location.    Select ‘SUMA Project > New Project’   Select the Region where your timber sale is located. (This value is used to filter Timber Sales)   Select the timber sale name from the drop down menu (This value is used to populate the agreement number)   The agreement number (if it exists) is displayed in the next field. It is for display purposes only.   In the ‘Output Folder’ field, enter the path to the network location where your region’s timber sale map projects are saved. A folder will be created in this directory with the naming convention ‘suma_<sale_name>’, where the sale name is stripped of special characters, converted to lowercase, and spaces are replaced with underscores. All map products and a file geodatabase will be created in the location.   From the ‘Open map’ drop down menu, select the mxd that you would like to open when the tool completes.   Optional: Browse to a shapefile or feature class that defines your timber sale. This will be used in place of spatial data in P&T.   Optional: Provide a custom distance used when clipping corporate roads for use in your Haul Route feature class. This will be useful if your sale is greater than 1 mile away from the major road that will be used to access the sale area. You will need to provide a distance value and unit of measure. If this is left blank, a default of 1 mile will be used.     Note: When the tool completes it will attempt to open the map document that you specified in your current ArcMap Session. If you select ‘Cancel’, the tool will not open the new SUMA map product that you specified in the tool dialog.   3       Edit Data SUMA 2.1 relies on the built-in functionality of ArcMap whenever possible. This is the case for editing where you will use Feature Templates that have been defined with existing symbology and default attribute values to add new features.    Start an editing session within your map document. When you do this, the ‘Create Features’ window should be active. Within the ‘Create Features’ window, feature templates are available to add new features to the feature classes that are present in the table of contents.   Save your edits and stop the edit session.   4       Using the Dynamic Legend   The new SUMA map products use a dynamic legend. Therefore, only features that are visible in the data frame are present in the legend.  As you pan to new extents, the legend should update to reflect the symbology of the features that are in the new extent. This may be undesirable if you do not want all of the symbolized values to be shown in the legend.  You will notice that there are two Unit Tags layers and two Stream Labels layers in the Table of Contents of some of your map products.  For example, there is a ‘Unit Tags Legend’ and ‘Unit Tags’ layer in the Timber Sale Map.  The ‘Unit Tags Legend’ layer is the layer that determines which values are symbolized in the legend.  You can remove symbols in this layer, which will remove them from the legend, without effecting the symbology in your dataframe.  Example 1: You edit your ‘Unit Tags’ layer by adding a record for ‘Right of Way Tags’ (single line) and ‘Right of Way Tags’ (double line).  You only want one of these values to be visible, so you manually edit the ‘Unit Tags Legend’ layer to show the symbols visible in the map.   Example 2: You want all of the values from your ‘Unit Tags’ layer to show up in the legend, and you don’t want to update the ‘Unit Tags Legend’ layer for each new dataframe extent. You remove the ‘Unit Tags Legend’ from the legend, and add the ‘Unit Tags’ layer.  If you select Items > Unit Tags > Only show classes that are visible in the current map extent, the software will update the legend dynamically.  There are no ‘Unit Tags’ features visible in the dataframe, so no values are visible in the legend.   Note: if a record with a value previously absent in the legend is added via an edit session, that new symbol will not be visible in the legend until the edits are saved and the edit session is closed.   5       Navigate Map products   Navigation between map products is accomplished with the built-in ‘Open’ button. The default folder is the folder where the current map document is saved.  You no longer open SUMA map products using a project file, you can open the .mxd just as you would any other.     6       Define pages for output   This version of SUMA will use extent rectangles with attributes that identify the associated map product to generate pdf documents and define bookmarks. In general, when a user defines a map page, he or she is capturing the extent of the data frame, and a polygon is created using those coordinates and inserted into the Grid_Index feature class in the Source_Data.gdb.    There are two tools that can be used to generate these extent rectangles. The first is the ‘Page Selector’ tool.  This button will capture the current extent of the dataframe, and create an extent polygon.  The page number is incremented automatically.  This tool is only available in the Page Layout View.   The second way to define map pages is to use the ‘Import Pages’ tool. This tool will copy the extent rectangles that have been defined for one map product, and apply them to another map product.  It does not change any map product, or copy any data except the appropriate Grid_Index features. a)    Page Selector Zoom to the extent that you want to record for final map production. Note: There are scale requirements for some map products. The tool will present a message box and will not work if the scale is outside the acceptable range.       Select Tools>Page Selector    When prompted, Select ‘Yes’ to record the current extent into the Grid_Index feature class. During the process of exporting map pages to pdf format, the current map product will be zoomed to this extent, and a page will be created. If you select ‘No’ or ‘Cancel’, the current extent is not recorded.   If you are working in a map product that shares a scale range requirement with another, you will be asked to reuse the extent for the other map products. If you select ‘Yes’, the current extent will be recorded in the Grid_Index feature for later use in the ‘Create Final Output’ tool for the other map product. For example, if you are working in your Timber Sales Map and you select ‘Yes’ to reuse the current extent, that extent will be recorded for the FPA Map in addition to the Timber Sales Map. If you select ‘No’ or ‘Cancel’, the current extent will be recorded for the current map product.             b)    Import Pages Select Tools>Import Pages   Enter the source map product that has the extents you wish to copy from (the requirement is that you must define pages for this product prior to using this tool)   Enter the map product that will use the previously defined map extents (This will copy the extents, and associate the new index features with the map product that you select)    7       View Pages   The user will be able to view the extent rectangles that have been recorded for the current map product with the use of the ‘View Pages’ tool. The intent is to allow users to preview the extents that have been recorded to ensure that the entirety of the sale will be included in the production of final map documents.  This is different than having the ability to preview the final output, but should approximate that functionality.  The extents, and the associated page number, will be displayed in the dataframe.  A dialog box will also be present.  By design, you will not be able to interact with the map document while viewing the pages that have been captured. Once you click ‘OK’,  your map will be restored to the extent that it was zoomed to prior to using the ‘View Pages’ tool. Open the map product you wish to view page extents for   Select Tools>View Pages       8       Zoom To   Another method to view the map page extents that have been recorded for the current map product is to use the ‘Zoom To’ drop down. The pages will be listed by page number (e.g. “page 1, page 2, etc.”), and the map will be zoomed to the extent associated with the page number after the user selects that page from the menu.  You will only be able to view pages for the current map product, it will not allow you to navigate to other map products.  This tool relies on the extent polygons that are stored in the Grid_Index feature class within the Source_Data.gdb. Select the ‘Zoom To’ drop down menu    Click on the page that you wish to zoom to   9       Reorder/Delete Pages   This tool allows you to reorder and delete pages. Pages are grouped by map product, and the pages are numbered in the order they were added using the ‘Page Selector’ tool. You have the option to reorder/delete pages from all map products, or to reorder/delete pages from the current map product.  The page numbers are used to populate the ‘Bookmarks’ drop down menu to allow users to navigate to the page views he or she has recorded. Additionally, the ‘Create Final Output’ tool uses the page numbers to determine the order in which map pages are converted to pdf documents.  The user can reorder map pages by moving the map page name up or down relative to other pages of the same product.  The map pages for each product are determined by the position of each map page in relation to other pages of the same product.  The tool automatically renumbers the map pages during execution.  The user can also delete page definitions with this tool by removing the page name from the list. Once a page is deleted, there is no way to undo this operation, although you can easily recreate a new page by using the Page Selector tool   Select Tools>Page Manager   Use the drop down menu to filter the map pages you wish to reorder. The options are ‘All Maps’ (you can reorder all pages for all map products) and ‘This Map’ (reorder pages for the current product only). In the following example, the Timber Sales Map Page 2 will become Timber Sales Map Page 1 and Timber Sales Map Page 1 will become Timber Sales Map Page 2. FPA Map Page 1 will remain FPA Map Page 1. Note: the order, or page numbering, is applied by map product.   If you wish to delete a map page (extent polygon) so it is not used as a bookmark or in the final map page creation, highlight the map page name, and select the button. In this example FPA Map pg. 1 was selected, and removed from the list.   Select ‘OK’, and the pages that were removed from the list will be deleted, and the pages will be renumbered to reflect the order that they appear in the list (Page numbers increase from top to bottom)       10 Create Final Output   This tool uses the grid index feature to export map documents to pdf format. A date-stamped folder is created in the folder the current map document was opened from, using the naming convention: ‘output_YYYYMMDD_HHMMSS’, and optionally, another folder named ‘pages’ will be created within the date-stamped folder.  This is done every time the user uses this tool.  Previous output is not overwritten.  By default, one pdf is created by map product. For example, if there are three pages defined for the Timber Sales Map and two pages defined for the Driving Map, then two pdf documents will be created: one Timber Sales pdf and one Driving Map pdf.  Optionally, the user can check the box that asks, “Single Page Output (optional)”, and one pdf will be created for each page, regardless of the map product.  These will be stored in the ‘pages’ subfolder.  In the previous example, if the user had checked the optional box, then three Timber Sales Map pdf’s and two Driving Map pdf’s would be created in addition to the other pdf documents.  Upon completion, the output folder is opened and the user can open the pdf’s that were created. Select Tools>Create Final Output    In the ‘Pages’ list, manually check the box next to the pages that you would like to be included in the final pdf documents. (Optionally, you can select the ‘Select All’ button to include all pages)   Check the box next to the ‘Single Page Output (optional)’ dialog if you wish to have single pdfs for each page. This can be useful if you will be using the pdfs with a mobile GIS application.   Select ‘OK’, and your pdf documents will be created. A windows explorer window will be opened to the output folder that holds the final pdf documents.      ... View more