Latest Contributions by GeoffreyWest

I have a feature class where there are multiple values duplicated in a row, i.e. SRNumber and RESOLUTION_CODE. I would like to delete all rows where my SRNumber and RESOLUTION_CODE are found in multiple rows. I have got a good start with this script, everything works aside from actually deleting the rows. How can I fix this so that my duplicate rows are deleted? So if SRNumber = 1-23456 and Resolution_Code = 'A' and appears twice, I would like to delete one. I have taken this example for GIS Stackexchange, but the del rows does not work correctly. import arcpy ... ... in_table = r"ServiceRequest.DBO.SO_Dead_Animal" ... fields = ["NumberCYLA","RESOLUTION_CODE"] #replace with own ... curStrings = arcpy.da.SearchCursor(in_table,fields,"NumberCYLA is not null") ... ... stringsKeysList = [] ... numbersValuesList = [] ... tableDict = {} ... ... for row in curStrings: ...     print row[0],row[1] ...     stringsKeysList.append(row[0]) ... del curStrings ... uniqueStringsList = list(set(stringsKeysList)) #only unique values from Strings field ... ... for uniqueString in uniqueStringsList: ...     emptyTempValues = [] ...     curValues = arcpy.da.SearchCursor(in_table,fields,"""NumberCYLA = '{0}'""".format(str(uniqueString))) ...     for row in curValues: ...         print row[1] ...         emptyTempValues.append(row[1]) ...         uniqueEmptyTempValues = list(set(emptyTempValues)) ...     tableDict[uniqueString] = uniqueEmptyTempValues ... ... print tableDict ... ... rowsToDelete = [k for k, v in tableDict.iteritems() if v == [-1]] #find which rows to delete ... print "list: ", rowsToDelete ... stringRows = "," ... updRows = stringRows.join(rowsToDelete) ... updRows = updRows.replace(",","','") ... print updRows #update the string to be used with proper syntax in where clause ... ... where_clause = """NumberCYLA in ('{0}')""".format(updRows) ... upd_cur = arcpy.da.UpdateCursor(in_table,fields,where_clause) ... for row in upd_cur: ...     print row[0],row[1] ...     del rowsToDelete ... View more

This is more of a general Python question which will set me up to send this data from a NumPyArray to Feature Class.  I am trying to parse through a web-service and retrieve certain records, however I am consistently receiving a KeyError for responses with more than one object. These records are returned in intervals, so sometimes I might receive one record and others I might receive 300. If I receive one record, the logic of my code works, if there are multiple items then the code doesn't work. Here is an example of an output with one object. I have posted to StackOverFlow and no luck, so this is cross-posted. {    "status": {    "code": 311,    "message": "Service Request Successfully Queried.",    "cause": ""    },    "Response": {    "NumOutputObjects": "1",    "ListOfServiceRequest": {    "ServiceRequest": [    {    "AddressVerified": "Y",    "SRNumber": "1-13967451",    "SRType": "Service Not Complete",    "CreatedDate": "05/08/2015 10:00:38",    "UpdatedDate": "05/08/2015 10:00:49",    "IntegrationId": "05082015100148678",    "Status": "Open",    "CreatedByUserLogin": "PROXYE",    "UpdatedByUserLogin": "PROXYE",    "Anonymous": "N",    "Zipcode": "90032",    "Latitude": "34.0843242531",    "Longitude": "-118.171015007",    "CustomerAccessNumber": "",    "LADWPAccountNo": "",    "NewContactFirstName": "jj",    "NewContactLastName": "rambo",    "NewContactPhone": "",    "NewContactEmail": "",    "ParentSRNumber": "1-10552271",    "Priority": "Normal",    "Language": "",    "ReasonCode": "",    "ServiceDate": "",    "Source": "",    "ClosedDate": "",    "Email": "",    "FirstName": "",    "HomePhone": "",    "LastName": "",    "LoginUser": "",    "ResolutionCode": "",    "SRUnitNumber": "",    "MobilOS": "",    "SRAddress": "5163 E TEMPLETON ST, 90032",    "SRAddressName": "",    "SRAreaPlanningCommission": "East Los Angeles APC",    "SRCommunityPoliceStation": "CENTRAL BUREAU",    "SRCouncilDistrictMember": "Jose Huizar",    "SRCouncilDistrictNo": "14",    "SRDirection": "E",    "SRNeighborhoodCouncilId": "48",    "SRNeighborhoodCouncilName": "LA-32 NC",    "SRStreetName": "TEMPLETON",    "SRSuffix": "ST",    "SRTBColumn": "F",    "SRTBMapGridPage": "595",    "SRTBRow": "6",    "SRXCoordinate": "6509897",    "SRYCoordinate": "1853117",    "AssignTo": "NC",    "Assignee": "NC eWaste Supervisor 01",    "Owner": "BOS",    "ParentSRStatus": "Open",    "ParentSRType": "Electronic Waste",    "ParentSRLinkDate": "05/08/2015 10:00:39",    "ParentSRLinkUser": "PROXYE",    "SRAreaPlanningCommissionId": "5",    "SRCommunityPoliceStationAPREC": "HOLLENBECK",    "SRCommunityPoliceStationPREC": "4",    "SRCrossStreet": "",    "ActionTaken": "",    "SRCity": "",    "RescheduleCounter": "",    "SRHouseNumber": "5163",    "SourceofRequestCouncil": "",    "CCBPremiseType": "",    "ContainerBlackCount": "",    "ContainerBrownCount": "",    "SRIntersectionDirection": "",    "SRApproximateAddress": "N",    "ContainerGreenCount": "",    "OtherBureauName": "",    "AssigneeName": "",    "AssigneeOrganization": "E-Waste, NC",    "AnotherBureauEmailId": "",    "ListOfLa311BarricadeRemoval": {},    "ListOfLa311BulkyItem": {},    "ListOfLa311DeadAnimalRemoval": {},    "ListOfLa311GraffitiRemoval": {},    "ListOfLa311InformationOnly": {},    "ListOfLa311MultipleStreetlightIssue": {},    "ListOfLa311SingleStreetlightIssue": {},    "ListOfLa311SrPhotoId": {    "La311SrPhotoId": []    },    "ListOfLa311BusPadLanding": {},    "ListOfLa311CurbRepair": {},    "ListOfLa311Flooding": {},    "ListOfLa311GeneralStreetInspection": {},    "ListOfLa311GuardWarningRailMaintenance": {},    "ListOfLa311GutterRepair": {},    "ListOfLa311LandMudSlide": {},    "ListOfLa311Pothole": {},    "ListOfLa311Resurfacing": {},    "ListOfLa311SidewalkRepair": {},    "ListOfLa311StreetSweeping": {},    "ListOfLa311BeesOrBeehive": {},    "ListOfLa311MedianIslandMaintenance": {},    "ListOfLa311OvergrownVegetationPlants": {},    "ListOfLa311PalmFrondsDown": {},    "ListOfLa311StreetTreeInspection": {},    "ListOfLa311StreetTreeViolations": {},    "ListOfLa311TreeEmergency": {},    "ListOfLa311TreeObstruction": {},    "ListOfLa311TreePermits": {},    "ListOfLa311BrushItemsPickup": {},    "ListOfLa311Containers": {},    "ListOfLa311ElectronicWaste": {},    "ListOfLa311IllegalDumpingPickup": {},    "ListOfLa311ManualPickup": {},    "ListOfLa311MetalHouseholdAppliancesPickup": {},    "ListOfLa311MoveInMoveOut": {},    "ListOfLa311HomelessEncampment": {},    "ListOfLa311IllegalAutoRepair": {},    "ListOfLa311IllegalConstruction": {},    "ListOfLa311IllegalConstructionFence": {},    "ListOfLa311IllegalDischargeOfWater": {},    "ListOfLa311IllegalDumpingInProgress": {},    "ListOfLa311IllegalExcavation": {},    "ListOfLa311IllegalSignRemoval": {},    "ListOfLa311IllegalVending": {},    "ListOfLa311LeafBlowerViolation": {},    "ListOfLa311NewsRackViolation": {},    "ListOfLa311Obstructions": {},    "ListOfLa311TablesAndChairsObstructing": {},    "ListOfLa311GisLayer": {    "La311GisLayer": [    {    "A_Call_No": "",    "Area": "0",    "Day": "MONDAY",    "DirectionSuffix": "",    "DistrictAbbr": "",    "DistrictName": "NC",    "DistrictNumber": "",    "DistrictOffice": "",    "Fraction": "",    "R_Call_No": "",    "SectionId": "",    "ShortDay": "",    "StreetFrom": "",    "StreetTo": "",    "StreetLightId": "",    "StreetLightStatus": "",    "Type": "GIS",    "Y_Call_No": "",    "Name": "05082015100148678100",    "CommunityPlanningArea": "",    "LastUpdatedBy": "",    "BOSRadioHolderName": ""    }    ]    },    "ListOfLa311ServiceRequestNotes": {    "La311ServiceRequestNotes": [    {    "CreatedDate": "05/08/2015 10:00:39",    "Comment": "Materials have been out in a normal collection area, unsure why driver missed the e-waste items.",    "CreatedByUser": "PROXYE",    "IsSrNoAvailable": "",    "CommentType": "External",    "Notification": "N",    "FeedbackSRType": "",    "IntegrationId": "050820151001486782",    "Date1": "",    "Date2": "",    "Date3": "",    "Text1": "",    "AnotherBureau": "",    "EmailAddress": "",    "ListOfLa311SrNotesAuditTrail": {}    },    {    "CreatedDate": "05/08/2015 10:00:39",    "Comment": "",    "CreatedByUser": "PROXYE",    "IsSrNoAvailable": "",    "CommentType": "Address Comments",    "Notification": "N",    "FeedbackSRType": "",    "IntegrationId": "050820151001486781",    "Date1": "",    "Date2": "",    "Date3": "",    "Text1": "",    "AnotherBureau": "",    "EmailAddress": "",    "ListOfLa311SrNotesAuditTrail": {}    }    ]    },    "ListOfLa311SubscribeDuplicateSr": {},    "ListOfChildServiceRequest": {},    "ListOfLa311BillingCsscAdjustment": {},    "ListOfLa311BillingEccAdjustment": {},    "ListOfLa311BillingRsscAdjustment": {},    "ListOfLa311BillingRsscExemption": {},    "ListOfLa311SanitationBillingBif": {},    "ListOfLa311SanitationBillingCssc": {},    "ListOfLa311SanitationBillingEcc": {},    "ListOfLa311SanitationBillingLifeline": {},    "ListOfLa311SanitationBillingRssc": {},    "ListOfLa311SanitationBillingSrf": {},    "ListOfLa311DocumentLog": {},    "ListOfAuditTrailItem2": {    "AuditTrailItem2": [    {    "Date": "05/08/2015 10:00:49",    "EmployeeLogin": "SADMIN",    "Field": "Assignee",    "NewValue": "NC eWaste Supervisor 01",    "OldValue": ""    }    ]    },    "ListOfLa311GenericBc": {    "La311GenericBc": [    {    "ATTRIB_08": "",    "NAME": "05082015100148678100",    "PAR_ROW_ID": "1-8BDCR",    "ROW_ID": "1-8BOCG",    "TYPE": "GIS",    "ATTRIB_16": "",    "ListOfLa311GenericbcAuditTrail": {}    },    {    "ATTRIB_08": "",    "NAME": "05082015100148678",    "PAR_ROW_ID": "1-8BDCR",    "ROW_ID": "1-8BOCJ",    "TYPE": "Service Not Complete",    "ATTRIB_16": "",    "ListOfLa311GenericbcAuditTrail": {}    }    ]    },    "ListOfLa311ServiceNotComplete": {    "La311ServiceNotComplete": [    {    "ContainerLocation": "",    "ContainerType": "",    "DriverFirstName": "",    "DriverLastName": "",    "MissedCollectionService": "Electronic Waste",    "OtherServiceMissedReason": "",    "ServiceDateRendered": "",    "ServiceMissedReason": "I'm not sure",    "TruckNo": "",    "Type": "Service Not Complete",    "WireBasketLocation": "",    "LastUpdatedBy": "",    "Name": "05082015100148678"    }    ]    },    "ListOfLa311Other": {},    "ListOfLa311WeedAbatementForPrivateParcels": {},    "ListOfLa311SanitationBillingInquiry": {}    }    ]    }    } } The code is below; data2 = jsonpickle.decode((f2.read())) Start = datetime.datetime.now() data2 = jsonpickle.encode(data2) url2 = "myURL" headers2 = {'Content-type': 'text/plain', 'Accept': '/'} r2 = requests.post(url2, data=data2, headers=headers2) decoded2 = json.loads(r2.text) try:   r2 except requests.exceptions.ConnectTimeout as e:    print "Too slow Mojo!" items = [] for sr in decoded2['Response']['ListOfServiceRequest']['ServiceRequest']:    SRAddress = sr['SRAddress']    Latitude = sr['Latitude']    Longitude = sr['Longitude']    ReasonCode = sr['ReasonCode']    SRNumber = sr['SRNumber']    FirstName = sr['FirstName']    LastName = sr['LastName']    ResolutionCode = sr['ResolutionCode']    HomePhone = sr['HomePhone']    CreatedDate = sr['CreatedDate']    UpdatedDate = sr['UpdatedDate']    CreatedDate = datetime.datetime.strptime(CreatedDate, "%m/%d/%Y %H:%M:%S")    UpdatedDate = datetime.datetime.strptime(UpdatedDate, "%m/%d/%Y %H:%M:%S")    print SRAddress    print SRNumber ItemInfo = " " for ew in sr["ListOfLa311ServiceRequestNotes"][u"La311ServiceRequestNotes"]: Comment = ew['Comment'] print Comment Output Materials have been out in a normal collection area, unsure why driver missed the e-waste items. If I use the logic above for a response with more than one object returned I receive a KeyError value and am unable to access the array that I want to parse. Example of code with multiple objects returned; Output when I use; I receive a key error if I attempt to do something along the lines of CommodityType = sr['ListOfLa311ElectronicWaste']['ElectronicWasteType'] below for sr in decoded2['Response']['ListOfServiceRequest']['ServiceRequest']:    CommodityType = sr['ListOfLa311ElectronicWaste']    # ItemType = sr['ElectronicWestType']    # DriverFirstName = sr ['DriverFirstName']    # DriverLastName = sr ['DriverLastName']    # ItemCount = sr['ItemCount']    # ItemInfo += '{0}, {1}, '.format(ItemType, ItemCount)    # ParentNumber = sr['Name']    #    print CommodityType {u'La311ElectronicWaste': [{u'IllegallyDumped': u'N', u'OtherElectronicWestType': u'hash', u'ItemCount': u'5', u'Name': u'6a31f058-ece1-4e7d-b682-7d9052a512f4', u'MobileHomeSpace': u'', u'DriverLastName': u'', u'ActiveStatus': u'Y', u'DriverFirstName': u'', u'LastUpdatedBy': u'', u'GatedCommunityMultifamilyDwelling': u'Outside the main gate', u'IllegalDumpCollectionLoc': u'', u'ElectronicWestType': u'Other', u'CollectionLocation': u'Gated Community', u'Type': u'Electronic Waste', u'ServiceDateRendered': u'', u'TruckNo': u''}]} {u'La311ElectronicWaste': [{u'IllegallyDumped': u'Y', u'OtherElectronicWestType': u'', u'ItemCount': u'5', u'Name': u'3f4d9d20-a712-4be3-822f-e6a45219c1cf', u'MobileHomeSpace': u'', u'DriverLastName': u'', u'ActiveStatus': u'Y', u'DriverFirstName': u'', u'LastUpdatedBy': u'', u'GatedCommunityMultifamilyDwelling': u'', u'IllegalDumpCollectionLoc': u'Cul De Sac', u'ElectronicWestType': u'Electronic Equipment', u'CollectionLocation': u'Alley', u'Type': u'Electronic Waste', u'ServiceDateRendered': u'', u'TruckNo': u''}]} ... View more

I would like to consume hosted features from ArcGIS Online into a local file geodatabase.  I am consistently receving a 498 error.  I am generating a token but when passing into ArcGIS server it is invalid.  A couple of questions. a.) Do I need to use my organization url, i.e. myorg.maps.arcgis.com for my referrer? b.) When I am creating a replica; should this data be hosted in arcgis.com? I am making some changes to the script  linked below which I found on github that uses urllib2, it doesn't work and isn't as elegant as the Requests.  And for my purposes I do not need to add attachments to the database, just consume a table locally. Python script to pull hosted features with attachments into a local file geodatabase. See ReadMe below. Here are my script and results url = 'https://www.arcgis.com/sharing/generateToken' payload  = {'username' : 'myUser, 'password' : 'myPass!', 'referer' : 'www.arcgis.com', 'f' : 'json' } r = requests.post(url, data=payload) token =json.loads (r.text) aToken = token['token'] print aToken # Create Replica ### # Update service url HERE ### url2 = 'http://myIP:6080/arcgis/rest/services/FeatureMapService/FeatureServer/CreateReplica' # # payload2 = {'f' : 'json', 'layers' : '1', 'returnAttachments' : 'false', 'token' : token } r2 = requests.post(url2, data=payload2) repLoad = json.loads (r2.text) print repLoad C:\Python27\ArcGIS10.2\python.exe C:/Users/GIS/Documents/ArcGIS/timequery.py lOg8435-zLN8aeWknNveul8EzYlmbKb2h5GXVHCazEEbs0VgvyKH-0rr-iZ3RNwN_HP0BfykxtuzgZaw_Bm8LMZoOoJ9KtydsLze2mEX5qcFKBKltW_goPIH9w43jvgtCqHGAbotdyGMTAZZ217QEVTNqnW74rgBtjf1eB7XFMUb1miuJbU2YhPDnpbQB1S-9alNOrp6loXtBzJFEN-oAA.. {u'error': {u'message': u'Invalid Token', u'code': 498, u'details': []}} ... View more

This is a general python question, I would like to write a function that essentially states if data is available do this, if not raise an error, and a finally block which does something else. In another function I would like write another if statement that says if function 1 raised an error do this, if not then do this. My question is, how do I reference this raised user-defined exception from my first function?  Here is a code-block that I am working with.  For example, if there is a raised error for NoData, I would like to say in another function, if NoData is raised then do this.... This block returns: Traceback (most recent call last):   File "C:/Users/Administrator/Desktop/DevSummitJSON_PySeminar.py", line 231, in <module>     servicequery(CreatedDate, now_minus_10)   File "C:/Users/Administrator/Desktop/DevSummitJSON_PySeminar.py", line 227, in servicequery     raise DataError, "Exception: Data is older than 10 minutes" __main__.DataError: Exception: Data is older than 10 minutes # severely edited, since improper indentation etc, precludes providing a test environment import arcpy    # not in original arr = #####     # not in original fc = ####        # not in original sr = ####       # not in original NumPyArray = arcpy.da.NumPyArrayToFeatureClass(arr, fc, ['longitudeshape', 'latitudeshape'], sr)  i = 5  i2= 10  now_minus_5 = Start - datetime.timedelta(minutes =i)  now_minus_10 = Start - datetime.timedelta(minutes =i2)  class DataError(Exception):   pass  class NoDatainLast5(Exception):    message = '\nException: NumberTooBigError:\nYour number is too big. \nTry a smaller one!'  class NoDatainLast10(Exception):    message = '\nException: NumberTooBigError:\nYour number is too big. \nTry a smaller one!'  def checkData(CreatedDate):    if CreatedDate > now_minus_10:      raise NoDatainLast10    elif CreatedDate > now_minus_10:      raise NoDatainLast5    elif CreatedDate is NULL :      raise DataError  def servicequery(CreatedDate, now_minus_10):    if CreatedDate > now_minus_10:      NumPyArray  #see at the top   elif CreatedDate < now_minus_10:      raise DataError, "Exception: Data is older than 10 minutes"    else:      print "test"  servicequery(CreatedDate, now_minus_10) Message was edited by: Dan Patterson I had to reformat the whole script due either to an incorrect format selection or source code was wrong. Added lines at the top of the code to facilitate testing using the edited script. ... View more