Best way to monitor for new features

lightpro — Sun, 27 Dec 2020 11:16:08 GMT

Hi, I'm looking for any tips on the best way to monitor an AGOL feature service for newly added features. Basically I have a public feature service that I want to monitor for when new features are added. I want to run some follow on scripts on new features only.

Right now, I think my best bet is to just set up a pythonanywhere script that runs every hour and checks the "created date" field for any features created in the last hour. Another option might be to create a custom "tracking field" that is NULL by default, then I create a script to check for features where this field is null, then when my script is finished I update this field to be not null.

Are these my basic options?

Re: Best way to monitor for new features

MehdiPira1 — Tue, 05 Jan 2021 02:57:41 GMT

@lightpro

I reckon the following script can help.

This is from @JakeSkinner which sends email when a feature is added to a hosted feature service.

import urllib2, json, urllib, datetime, time, smtplib from datetime import timedelta # Variables username = 'jskinner_CountySandbox' # AGOL Username password = '******' # AGOL Password URL = 'https://services1.arcgis.com/vdNDkVykv9vEWFX4/arcgis/rest/services/address_errors/FeatureServer/0/qu...' # Feature Service URL uniqueID = 'OBJECTID' # i.e. OBJECTID dateField = 'CreationDate' # Date field to query hoursValue = 1 # Number of hours to check when a feature was added fromEmail = 'test@esri.com' # Email sender toEmail = 'test@esri.com' # Email receiver smtpServer = 'smtp.gis.com' # SMPT Server Name portNumber = 25 # SMTP Server port # Create empty list for uniqueIDs oidList = [] # Generate AGOL token try: print('Generating Token') tokenURL = 'https://www.arcgis.com/sharing/rest/generateToken' params = {'f': 'pjson', 'username': username, 'password': password, 'referer': 'http://www.arcgis.com'} req = urllib2.Request(tokenURL, urllib.urlencode(params)) response = urllib2.urlopen(req) data = json.load(response) token = data['token'] except: token = '' # Query service and check if created_date time is within the last hour params = {'f': 'pjson', 'where': "1=1", 'outfields' : '{0}, {1}'.format(uniqueID, dateField), 'returnGeometry' : 'false', 'token' : token} req = urllib2.Request(URL, urllib.urlencode(params)) response = urllib2.urlopen(req) data = json.load(response) for feat in data['features']: createDate = feat['attributes'][dateField] createDate = int(str(createDate)[0:-3]) t = datetime.datetime.now() - timedelta(hours=hoursValue) t = time.mktime(t.timetuple()) if createDate > t: oidList.append(feat['attributes'][uniqueID]) print(oidList) # Email Info FROM = fromEmail TO = [toEmail] SUBJECT = 'New Features Added' TEXT = "Features with {0}s {1} were added.".format(uniqueID, oidList) message = """\ From: %s To: %s Subject: %s %s """ % (FROM, ", ".join(TO), SUBJECT, TEXT) # If new features exist, send email if len(oidList) > 0: smtpObj = smtplib.SMTP(host=smtpServer, port=portNumber) smtpObj.sendmail(FROM, TO, message) print "Successfully sent email" smtpObj.quit()

The other option is using webhooks.

You can use a webhook for feature service view (tile, scene, etc.), to receive notification for updates.

https://www.esri.com/arcgis-blog/products/arcgis-online/sharing-collaboration/how-to-create-a-hosted-feature-service-webhook/

I hope these give you some ideas.

Cheers

Mehdi

======================================================================

Please give a like if helpful and Accept as Solution if it's answered your query.

Re: Best way to monitor for new features

lightpro — Thu, 07 Jan 2021 21:21:27 GMT

Excellent, this is great thanks!

topic Best way to monitor for new features in ArcGIS API for Python Questions

Best way to monitor for new features

Re: Best way to monitor for new features

Re: Best way to monitor for new features