Latest Contributions by shildebrand

@JohnNergeBrooklynPark  @ShanaBritt I was able to successfully script this with python by geocoding a list of customers using the Assessor_ParcelNumber field (APN) and then export out the unmatched features and feed it through a second composite locator consisting of county parcel data and the ESRI World Geocoder and using the address field to geocode. It's a little messy but it works.  Essentially, we want the address data to be geocoded by APN first, then address (the reverse of what John was showing in his table).  See step 9-13 in the script below: import arcpy import os import sys import traceback from datetime import datetime # --- Set workspace and paths --- arcpy.env.workspace = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing" # Change to your workspace excel_file = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\SanTan_PremPar_112425.xlsx" #input excel file sheet_name = "SanTan_PremPar_112425" #excel worksheet output_gdb = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\GeocodeTesting_112425.gdb" #output gdb - best to create new gdb location to store outputs excel_table = os.path.join(output_gdb, "SanTan_PremPar") #output table created from excel sheet feature_class = r"G:\GIS\Packages\Geocoder\EPCOR Customers Geocode.gdb\A_W_WW_SanTan_2375" #existing prem par geocoded feature class join_field_fc = "Premises_Id" # Field to join on in feature class - shouldn't need to change this join_field_excel = "Premises_Id" # Field to join on in Excel table - shouldn't need to change this locator_apn = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\Pinal_APN_Locator_Revised.loc" #single field APN locator - change depending on county you are working in locator_address = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\Pinal_Composite_Locator.loc" #composite locator that includes address locator created from county parcel data and the ESRI world locator - change depending on county you are working in apn_field_map = "'Single Line Input' Assessor_ParcelNumber VISIBLE NONE" #Change to the field name that holds the APN apn_field_to_clean = "Assessor_ParcelNumber" address_field_map = ("\'Address or Place\' Address_Line_1 VISIBLE NONE;Address2 <None> VISIBLE NONE;Address3 <None> VISIBLE NONE;Neighborhood <None> VISIBLE NONE;City City_Name VISIBLE NONE;County <None> VISIBLE NONE;State State_Province_Code VISIBLE NONE;ZIP ZIP Postal_Code VISIBLE NONE;ZIP4 <None> VISIBLE NONE;Country <None> VISIBLE NONE") #should not need to change this geocoded_apn = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\GeocodeTesting_112425.gdb\Geocoded_APN" #output feature class that stores output of running the apn geocoder geocoded_address = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\GeocodeTesting_112425.gdb\Geocoded_Address" #output feature class that stores output of running the address composite locator apn_match = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\GeocodeTesting_112425.gdb\Geocoded_APN_Match" #output feature class of only matched records from apn geocoder apn_unmatched = r"G:\GIS\00-GIS\3.0 Customer Care\Geocode Testing\GeocodeTesting_112425.gdb\Geocoded_APN_Unmatched" #output gdb table of unmatched records from apn geocoder - to be fed into composite locator try: # --- Step 1: Convert Excel to Table --- if not os.path.exists(excel_file): raise FileNotFoundError(f"Excel file not found: {excel_file}") arcpy.ExcelToTable_conversion(excel_file, excel_table, sheet_name) print("Excel To Table Complete ") # --- Step 2: Create a feature layer from the feature class if not arcpy.Exists(feature_class): raise FileNotFoundError(f"Feature class not found: {feature_class}") feature_layer = "featurelayer" arcpy.MakeFeatureLayer_management(feature_class, feature_layer) # --- Step 3: Create a table view from the join table (if it's not already a table view) if not arcpy.Exists(excel_table): raise FileNotFoundError(f"Geodatabase table not found: {excel_table}") table_view = "tableview" arcpy.MakeTableView_management(excel_table, table_view) # --- Step 4: Add the join arcpy.management.AddJoin(table_view, join_field_excel, feature_layer, join_field_fc) # --- Step 5: Select Features That Did Not Join --- # These will have NULLs in the joined table field joined_field = f"{os.path.basename(feature_class)}.{join_field_fc}" # Z_W_WW_SanTan_Prem_Par_Final.Premises_Id print("Joined Field Name: " + joined_field) selection = arcpy.SelectLayerByAttribute_management(table_view, "NEW_SELECTION", f"{joined_field} IS NULL") count = arcpy.GetCount_management(table_view).getOutput(0) print(count + " New Customers Selected") # --- Step 6: Remove Join --- arcpy.management.RemoveJoin(table_view) print("Join Removed") # --- Step 7: Export Unmatched Features --- output_unmatched = os.path.join(output_gdb, "UnmatchedFeatures") arcpy.CopyRows_management(table_view, output_unmatched) print("Exported unmatched features to:", output_unmatched) # --- Step 8: Remove dashes and spaces from APN field # Check if the workspace and table exist if not arcpy.Exists(output_unmatched): raise FileNotFoundError(f"Table not found: {output_unmatched}") # Check if the field exists field_names = [f.name for f in arcpy.ListFields(output_unmatched)] if apn_field_to_clean not in field_names: raise ValueError(f"Field '{apn_field_to_clean}' not found in table '{output_unmatched}'.") # Update the field values with arcpy.da.UpdateCursor(output_unmatched, [apn_field_to_clean]) as cursor: for row in cursor: original_value = row[0] if original_value: cleaned_value = original_value.replace("-", "").replace(" ", "") row[0] = cleaned_value cursor.updateRow(row) print("✅ Dashes and spaces removed successfully.") # --- Step 9: Geocode Unmatched Features by APN if not arcpy.Exists(locator_apn): raise FileNotFoundError(f"APN locator not found: {locator_apn}") arcpy.GeocodeAddresses_geocoding(output_unmatched, locator_apn, apn_field_map, geocoded_apn, output_fields="MINIMAL") print("APN Geocoding complete.") # --- Step 10: Export only matched records (Status = 'M') arcpy.Select_analysis( in_features=geocoded_apn, out_feature_class=apn_match, where_clause="Status = 'M'" ) print("Matched results exported to:", apn_match) # --- Step 11: Create a layer with unmatched and tied records unmatched_layer = "Unmatched_Tied_Layer" arcpy.MakeFeatureLayer_management( in_features=geocoded_apn, out_layer=unmatched_layer, where_clause="Status IN ('U', 'T')" ) # Copy rows to a geodatabase table arcpy.CopyRows_management( in_rows=unmatched_layer, out_table=apn_unmatched ) print("Unmatched and tied results exported to: ", apn_unmatched) # --- Step 12: Delete unwanted fields from unmatched table fields_to_delete = ["Status", "Score", "Match_type", "Match_addr", "Addr_type"] arcpy.DeleteField_management(apn_unmatched, fields_to_delete) print("Fields deleted successfully.") # --- Step 13: Geocode APN Unmatched features with Composite Locator (county parcel addresses & ESRI geocoder) if not arcpy.Exists(locator_address): raise FileNotFoundError(f"Address locator not found: {locator_address}") arcpy.GeocodeAddresses_geocoding(apn_unmatched, locator_address, address_field_map, geocoded_address, output_fields="ALL") print("Address Geocoding complete.") except FileNotFoundError as fnf_error: print(f"❌ File error: {fnf_error}") except ValueError as val_error: print(f"❌ Value error: {val_error}") except arcpy.ExecuteError: print("❌ ArcPy error:") print(arcpy.GetMessages(2)) except Exception as e: print("❌ Unexpected error occurred:") traceback.print_exc()   ... View more

Would love to see this.  I am trying to do a similar thing: https://community.esri.com/t5/arcgis-pro-questions/creating-a-composite-locator-from-parcel-data/m-p/1662225#M99859   ... View more

Hi @MatheusSparapani, I actually haven't looked into this much lately.  Have you made any progress?  There has to be a way to load data into a utility network dataset that participates in the topology of the utility network. ... View more

A nearmap historical imagery widget!!!  I've been looking for this for quite awhile now.  Does anyone know of any live site that has this widget?  We will be upgrading to enterprise 11.3 later this year.  How difficult will it be to incorporate this into an experience builder site?  We are currently hosting nearmap imagery on our portal via the arcgis marketplace.  Any advice or suggestions regarding this app would be greatly appreciated! ... View more

Thank you for your help.  Is is possible that the "Is Dirty" field is the same as the "Status" field?  Regardless, both are set to true, so that probably isn't the issue.  Below is a snip of what happens when trying to run the export subnetwork tool.  Do you know if the entire utility network database (which includes multiple subnetworks that don't work or are useless to us) needs to be "clean"?  Or does the subnetwork that you are attempting to delete just need to be "clean"?  We will probably need to get some help from Esri technical support regarding this or from some other outside resource.   ... View more

Thank you, I will for sure look into adding some type of a device to represent the river.   Regarding deleting subnetworks, the Is deleted field is set to "True".  But I cannot locate a "Status" field.  The "Is dirty" field is also set to True, but when I validate topology, no dirty areas are returned.   ... View more

@MikeMillerGIS wrote: Then I update the subnetwork using the find subnetwork pane or geoprocessing tool successfully.  When I run the export subnetwork too, the tier parameter says that there are no clean subnetworks discovered. Check your Subnetwork Definition.  Do you have Manage Is Dirty set to false?  If so, your subnetwork will always report Dirty and you cannot run Export Subnetwork.  We typically ship the models with this set to False as there is cost managing a system tier and you need to opt into managing Is Dirty When I open the subnetwork table and view field details, the "ISDIRTY" field has a default value of True and the subnetwork records that I want to delete are all attributed with "True" Does there need to be an asset that serves as a subnetwork controller at the beginning of the pink line to represent the supply (river)?  No, but you could add a intake and set it up as a controller in the system tier.  This subnetwork would be a Raw water subnetwork. Any ideas on what type of feature or asset would represent the supply from a body of water such as a river?  This is not something we have currently in our data model. If I set the pumps at the plant as subnetwork controllers for a pressure subnetwork, all assets are assigned to the system subnetwork.  Wouldn't you think that everything after the pumps would be the pressure subnetwork? Yes. If you are using a pressure zone tier.  I would evaluate dropping the system tier and using the Pressure Zone tier as the rank 1 tier.  There is cost to managing a system tier if you just have one system.   We have multiple independent systems within the same utility network.  My thought was that each system would have a system subnetwork and then one or more multiple pressure systems.  In the example I referenced, maybe the raw water line from the river would be one pressure system, and a second pressure subnetwork after treatment?  How difficult is it to drop an entire system tier? How do you handle wells that feed a treatment plant? What about bodies of water that serve as a source for a system? You can set wells and intakes as controllers and create a subnetwork that feeds the plant.  The system tier really should not be one subnetwork If you have one system subnetwork, you are taking a big cost on validate.  As Validate has to trace the system and if everything is one big system, that could be costly.  If you plan on having a pressure zone tier, you can evaluate dropping the system tier and just using pressure zones.   Maybe it makes more sense to split these up into separate system subnetworks for each water system?  On the other hand, I'm not really sure what the purpose is for a system subnetwork.  We really would like to use subnetworks as the basis for isolation, upstream, and downstream tracing.  I'm thinking just having several pressure subnetworks would solve this?   ... View more

Thank you for your help with this!  Any ideas on what type of device you would use to represent a body of water like a river?  It's not something we currently have in our data model. When I view the subnetworks table, it is showing multiple records with the same subnetwork name with different subnetwork controllers.  I have removed all of the controllers, so i'm confused as to why they are still showing up?   ... View more

My post is getting marked as spam @JesseCloutier.  Can you help? https://community.esri.com/t5/arcgis-utility-network-questions/subnetwork-management/m-p/1585514   ... View more

Thank you very much for this excellent insight!  Enabling the clear cache option has seemed to improve performance.  But the other suggestions may help us as well.  I'm thinking ESRI should put together a webinar or presentation at a future conference on this topic.  I think it is something that all ESRI users would appreciate. ... View more

Thanks Todd, any thoughts as to how to create a task that would add a specific set of layers to a map?  This would be after loading in a predefined map package with UN datasets.  I'm guessing, the best way would be to just republish map packages with the layers already in them. ... View more