topic Re: Address Error Checking in Data Management Questions

Address Error Checking

CharlesBuzzard — Mon, 09 May 2011 22:53:04 GMT

In ArcInfo Workstation there is a tool called AddressErrors which checks a street layer with address attributes for a collection of possible errors. This tool generates an info table that can be related back to the street layer and helps identfy issues that can cause problems during geocoding. Errors like address range overlaps, even/odd side flips, segment direction flips and a few other errors are identified.

For those ArcGIS users that support 911 dispatch centers, these tools are a huge help. The ESRI Seattle Office wrote a python script that could to do similar error checking, but it was very slow and could only process about 5000 segments at a time.

If you need similar tools or think that it could be helpful, please add to this thread. We really need ESRI to write this with ArcObjects and optimize it for production sized datasets.

Re: Address Error Checking

JoeBorgione — Tue, 10 May 2011 10:27:26 GMT

I am using 9.3.1; is this a tool in 10.x? What 'brand' CAD are you using? The two that I use (in different 9-1-1 centers) both provide utilities that check for address attribute errors.

It would be a great tool for anyone who does a lot of geocoding.

[Edited moments after initial post] Just read your other post; I misunderstood that this was an older ArcInfo tool. So, absolutely, an ArcMap version of the tool would be great. Seems to me there is a users 'wish-list' forum or blog somewhere in ESRI-cyberland that accepts suggestions like this

Re: Address Error Checking

BruceHarold — Tue, 10 May 2011 22:52:35 GMT

Charles, Joe

Please see here:

http://resources.arcgis.com/gallery/file/geocoding/details?entryID=1A290038-1422-2418-88FC-098400376B88

Regards

Re: Address Error Checking

JoeBorgione — Wed, 11 May 2011 13:39:28 GMT

Charles, Joe

Please see here:

http://resources.arcgis.com/gallery/file/geocoding/details?entryID=1A290038-1422-2418-88FC-098400376B88

Regards

Nice! thanks Bruce!

Re: Address Error Checking

GarriGrossi — Fri, 09 Mar 2012 12:57:52 GMT

So I've downloaded the script, and added the included toolbox to ArcMap. The variable dialogue opens and I fill in the required fields. Upon running the script, I get the error 'Script associated with this toolbox does not exist.'

After a bit of help-thyself searching I found a solution may be the 'relative paths' option, which I checked and ran. With the same problem.
Then I un-checked it and ran the tool. Same error.

Is there something I'm missing? Can I load the script into Model Builder?

Garri

Re: Address Error Checking

ToddLusk — Tue, 12 Aug 2014 19:23:04 GMT

I think you have to check the "relative paths" option then "reload" the script so that the tool picks up on the new relative path.

Re: Address Error Checking

SuhanLi — Thu, 03 Oct 2019 14:31:05 GMT

Hi Bruce,

The link does not exist anymore. Is it possible that you provide the new link?

Thanks,

Re: Address Error Checking

BruceHarold — Thu, 03 Oct 2019 14:40:00 GMT

Hello Suhan

The scripted tool I made stopped working at some release and I didn't find out what the problem is.

I suggest you convert this discussion to an idea and get some votes on it. Kory Kramer‌ is there an existing idea?

Thanks.

Re: Address Error Checking

JoeBorgione — Thu, 03 Oct 2019 14:58:14 GMT

This discussion took place 8 years ago and I have hard time remembering what I had for dinner last night (I think it was a pesto pasta thing my lovely wife whipped up. Or was that the night before?). At any rate, your might want to start a new thread, describe your needs and see what responses you get. Clearly, in the past 8 years, there have been a lot of discoveries made.

Re: Address Error Checking

BruceHarold — Thu, 03 Oct 2019 15:10:03 GMT

Joe you had fish.

Re: Address Error Checking

SuhanLi — Thu, 03 Oct 2019 15:11:42 GMT

I am struggling for my address error issue during Geoprocessing and I am working on the book, Python Scripting for ArcGIS, by Paul Zandbergen. When I found this python script sample in the book, I assume that I saw the dawn from the horizon

This is a very useful tool.

Regards,

Re: Address Error Checking

JoeBorgione — Thu, 03 Oct 2019 15:31:21 GMT

Re: Address Error Checking

KoryKramer — Thu, 03 Oct 2019 15:37:32 GMT

I believe the current link would be https://www.arcgis.com/home/item.html?id=d34959c8f11940c08143440e7fcf585e but like Bruce said, the script may not work at current releases...

There is not an idea for this right now as far as I can tell on ArcGIS Ideas‌

Re: Address Error Checking

SuhanLi — Thu, 03 Oct 2019 15:41:42 GMT

This helps!

Thanks!

Re: Address Error Checking

SuhanLi — Thu, 03 Oct 2019 15:43:49 GMT

From the link that Kory provided, Bruce actually uploaded it two years ago...

Eat more fish!

Regards,

Re: Address Error Checking

MichaelVolz — Thu, 03 Oct 2019 15:45:05 GMT

Is there any chance you could resurrect this script for a modern version of ArcMap?

Re: Address Error Checking

SuhanLi — Thu, 03 Oct 2019 15:47:21 GMT

Regards,

Re: Address Error Checking

BruceHarold — Thu, 03 Oct 2019 15:53:58 GMT

I don't think I can realistically get back to it. This thread has gone to the right dev folks today so it will be discussed, but the first thing that will come up is the question is street address range geocoding going to be done into the future? We see data going point-based as it not only geocodes with more precision, it natively validates an address (a house/premise actually exists).

Re: Address Error Checking

JoeBorgione — Thu, 03 Oct 2019 15:56:59 GMT

I assume the tool is written in python? Is there a way to tease that out of the tool box?

edited to add; just download it, and extract the zip file someh were. Open the tool box in ArcCatalog, right click on the script tool itself and the python code is revealed...

Re: Address Error Checking

CharlesBuzzard — Sat, 11 Dec 2021 20:05:50 GMT

Try the following script. Save the text as addressCheck.py; open in idle; change the local variables as neede and run the script. If you send me an email, I'll send you the script since it looks like all the indents have been stripped. Good luck

Chuck.Buzzard@PierceCountyWA.gov

# This Python script searches a GIS roads feature class and
# codes an error field depending on a series of address errors
# Addressing rules:
# Road segments must point in direction of increasing house numbers (FLIP)
# Even and Odd sides of street must remain consistant (EVENODD)
# From range value must be smaller that To Range value (FROMTO)
# Ranges can not overlap from one segment to another (OVRLAP)
# A check but not an error would be a missing street segment (GAP)
# Errors checked for are
# Even Odd Flips (EVENODD)
# Overlap in the range (OVRLAP)
# FromTo flip in address range (FROMTO)
# Flip of underlying segments (FLIP)
# Alerts are coded
# Gaps in the network (GAP)
#Dependencies:
# Requires ArcGIS Desktop Advanced License
# Requires standard python 2.7 libraries and ESRI's arcpy library
#Notes:
# Review Local variable section and modify as needed
#Author:
# Chuck Buzzard
#Updates:
# 6/2011;4/2014;9/2016
import sys, os, shutil, time, arcpy
def prepWksp(wksp,wkdb):
 if os.path.exists(wksp+wkdb):
 arcpy.Delete_management(wksp+wkdb)
 arcpy.CreateFileGDB_management(wksp, wkdb)
def hideShowFlds(srclyr,fldLst):
 srcFlds = arcpy.ListFields(srclyr)
 fldinfo = arcpy.FieldInfo()
 for fld in srcFlds:
 if fld.name in fldLst:
 #print fld.name
 fldinfo.addField(fld.name, fld.name, "VISIBLE", "")
 else:
 fldinfo.addField(fld.name, fld.name, "HIDDEN", "")
def print2Log(logTxt,logLoc):
 temp = sys.stdout 
 sys.stdout = open(logLoc,'a') 
 print(logTxt+os.linesep) 
 sys.stdout.close() 
 sys.stdout = temp
#Set Local Variables:
wsLog = "C:\\wkspace\\addr\\logs\\addrerr.log"
wsTrg = "C:\\wkspace\\addr\\"
wsSrc = ""
dbSrc = "\\\\data\\TransportationGDB.gdb\\"
dbTNm = "Staging.gdb"
dbTrg = wsTrg+dbTNm
fcRds = "Roads"
flRds = ["OBJECTID","Shape","LFROM","LTO","RFROM","RTO","PREDIR","NAME","TYPE","DIR","FULLNAME","LZIP","RZIP","LCITY","RCITY","MAPCLASS"]
print "Start Address Error Check: ("+time.ctime()+")"
print2Log("Start Address Error Check: ("+time.ctime()+")",wsLog)
#Prep Target Workspace:
prepWksp(wsTrg,dbTNm)
# Set Geoprocessing environments:
arcpy.env.scratchWorkspace = dbTrg
arcpy.env.workspace = dbTrg
arcpy.env.overwriteOutput = True
#Copy Production Data To Work Area:
arcpy.CopyFeatures_management(dbSrc+fcRds,fcRds)
print "#Prepare Data For Processing:"
print2Log("Prepare Data For Processing:",wsLog)
arcpy.MakeFeatureLayer_management(fcRds,fcRds+"_lyr")
hideShowFlds(fcRds+"_lyr",flRds)
#Code Address Errors
print "Make Nodes: ("+time.ctime()+")"
arcpy.AddField_management(fcRds+"_lyr","sX","LONG")
arcpy.AddField_management(fcRds+"_lyr","sY","LONG")
arcpy.AddField_management(fcRds+"_lyr","FNODE","TEXT",13)
arcpy.CalculateField_management(fcRds+"_lyr","sX","!SHAPE.FIRSTPOINT!.split()[0]","PYTHON")
arcpy.CalculateField_management(fcRds+"_lyr","sY","!SHAPE.FIRSTPOINT!.split()[1]","PYTHON")
arcpy.CalculateField_management(fcRds+"_lyr","FNODE","str(!sX!)+str(!sY!)","PYTHON")
arcpy.AddField_management(fcRds+"_lyr","eX","LONG")
arcpy.AddField_management(fcRds+"_lyr","eY","LONG")
arcpy.AddField_management(fcRds+"_lyr","TNODE","TEXT",13)
arcpy.CalculateField_management(fcRds+"_lyr","eX","!SHAPE.LASTPOINT!.split()[0]","PYTHON")
arcpy.CalculateField_management(fcRds+"_lyr","eY","!SHAPE.LASTPOINT!.split()[1]","PYTHON")
arcpy.CalculateField_management(fcRds+"_lyr","TNODE","str(!eX!)+str(!eY!)","PYTHON")
arcpy.AddField_management(fcRds+"_lyr","ADDERR","TEXT",50)
arcpy.Sort_management(fcRds+"_lyr","cadRoadsLSort",[["LCITY","ASCENDING"],["FULLNAME","ASCENDING"],["LFROM","ASCENDING"]])
print "Code Leftside: ("+time.ctime()+")"
fc="cadRoadsLSort"
flds = ('FNODE','TNODE','LCITY','FULLNAME','LFROM','LTO','ADDERR')
fn = ""
tn = ""
nm = ""
ct = ""
fh = -1
th = -1
er = ""
cnt = 0
with arcpy.da.UpdateCursor(fc,flds) as cursor:
 for row in cursor:
 if ((row[2] == ct) and (row[3] == nm)):
 if (row[4]>row[5]):
 er=str(er)+"FROMTO"
 if (row[4]<=th):
 er=str(er)+"OVERLAP"
 if ((row[4]%2==0 and fh%2!=0) or (row[4]%2!=0 and fh%2==0)):
 er=str(er)+"EVENODD"
 if (row[1]==tn):
 er=str(er)+"FLIP"
 if (row[0]!=tn):
 er=str(er)+"GAP"
 row[6]=str(er)
 fn=row[0]
 tn=row[1]
 ct=row[2]
 nm=row[3]
 fh=row[4]
 th=row[5]
 cursor.updateRow(row)
 er=""
 else :
 fn=row[0]
 tn=row[1]
 ct=row[2]
 nm=row[3]
 fh=row[4]
 th=row[5]
 er=""
print "Code Rightside: ("+time.ctime()+")"
arcpy.Sort_management("cadRoadsLSort","cadRoadsRSort",[["RCITY","ASCENDING"],["FULLNAME","ASCENDING"],["RFROM","ASCENDING"]])
fc="cadRoadsRSort"
flds = ('FNODE','TNODE','RCITY','FULLNAME','RFROM','RTO','ADDERR')
fn = ""
tn = ""
nm = ""
ct = ""
fh = -1
th = -1
er = ""
with arcpy.da.UpdateCursor(fc,flds) as cursor:
 for row in cursor:
 if ((row[2] == ct) and (row[3] == nm)):
 if (row[4]>row[5]):
 er=str(er)+"FROMTO"
 if (row[4]<=th):
 er=str(er)+"OVERLAP"
 if ((row[4]%2==0 and fh%2!=0) or (row[4]%2!=0 and fh%2==0)):
 er=str(er)+"EVENODD"
 if (row[1]==tn):
 er=str(er)+"FLIP"
 if (row[0]!=tn):
 er=str(er)+"GAP"
 row[6]=str(er)
 fn=row[0]
 tn=row[1]
 ct=row[2]
 nm=row[3]
 fh=row[4]
 th=row[5]
 cursor.updateRow(row)
 er=""
 else :
 fn=row[0]
 tn=row[1]
 ct=row[2]
 nm=row[3]
 fh=row[4]
 th=row[5]
 er=""
print "End Address Error Check: ("+time.ctime()+")"
print2Log("End Address Error Check: ("+time.ctime()+")",wsLog)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍