Latest Contributions by DrewDowling

In the end we created a notebook script that runs as a scheduled task. The script uses the AGOL rest api to check velocity status and errors. It then emails group members if it finds an issue. Setting it to run at 15 minute intervals consumes approx 2.5 credits a day.  Here's a copy of the script in case someone finds it useful.   from arcgis.gis import GIS gis = GIS("home") import requests import json def emailWarning(errormessage): emengencyMapGroupID = 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' # Replace with your actual group ID # Get the group object using the group ID emengencyMapGroup = gis.groups.get(emengencyMapGroupID) emailSubject = 'Test Errors recorded in the Genasys Velocity Feeds Test' # Users have to be in the group to receive the email emengencyMapGroup.notify(users=['OES_Dev'], subject=emailSubject, message=errormessage) # Check that the source data wfs endpoint is up and running url='https://source.feed.com/geoserver/z/wfs' payload={'authkey':'mykey', 'SERVICE':'WFS', 'REQUEST':'GetFeature', 'VERSION':'2.0.0', 'TYPENAMES':'z:evacuation_zone', 'srsName':'EPSG:4326', 'outputFormat':'application/json', 'CQL_FILTER': 'zone_status<>\'Normal\''} r = requests.get(url, params=payload) print(r.status_code) # Check if the request was successful if (r.status_code != 200): emailWarning('Failed to connect to the source WFS endpoint. Confirm source is up and running') # Check the status of the Velocity feeds # Get the Velocity feeds velocity = gis.velocity # velocity feeds = gis.velocity.feeds # feeds Sample_feed = feeds.get("XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX") status = Sample_feed.status # print(status) print(status['status']) # Check if the feed is started if(status['status'] != 'started'): emailWarning('MY poller ingest feed is not started. Please log in to Velocity and restart it.') sample_metric = Sample_feed.metrics # print(sample_metric) print(sample_metric['numErrors']) # Check if there are any errors in the feed metrics if sample_metric['numErrors'] > 0: emailWarning('MY poller ingest feed is recording errors. Please log in and investigate.') # Check the status of the real-time analytics # Get the real-time analytics real_time_analyitics= gis.velocity.realtime_analytics real_time_analyitics event_inget_analytic =real_time_analyitics.get('XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX') event_inget_analytic.status print( event_inget_analytic.status['status']) # Check if the real-time analytics process is started if event_inget_analytic.status['status'] != 'started': emailWarning('My Real time Analytic processes is not started. Please log in to Velocity and check the status. ') # Check if there are any errors in the real-time analytics metrics for value in event_inget_analytic.metrics.items(): # metrics are in a list of dictionaries if( type(value[1])==list): if(len(value[1])> 0): for dic in value[1]: # Check if the dictionary has an 'errorCount' key if 'errorCount' in dic: if dic['errorCount'] > 0: emailWarning('One of the My Real time Analytic processes had an error. Please log in to Velocity and check the logs. ') print('we have a problem')    ... View more

Thanks you for the update @PeterNasuti  ... View more

The feed we are pulling from is a 3rd party feed we have no control over, does this mean the approach won't work? I'm unfamiliar with WatchDog transactions but it's an approach I'd like to know more about if you think  it will help in my situation. ... View more

Thank you Michael. The link is very informative but unfortunately unhelpful in our case.  The detect gaps tool doesn't work on polygon data 99% of the time there is no data to pull, the source has no current active polygons. One user suggested using scripts to test the source. I will look into using a notebook script to test the response of the feed source, but then the question becomes: how do I get a warning if the notebook script fails to run?   So the ideal solution would be a warning from the feed itself. ... View more

Lifesaver, thank you. ... View more

Thanks Jeff. Yes I was using realtime analytics. Your suggestion of using a time filter was correct. I learned from as Esri expert to use a field calculation of the data and then filter off of 'Date within last X minutes' where the date field is calculated to Now() every time the Analytic is run. This would hide the features in the map. They also suggested a scheduled Notebook script to delete the older features from the hosted feature service.     ... View more

I misread your post Jeff. I'm doing a real time analytic, not a Big Data one. That is why I don't see the option to replace all features every time the analytic runs. ... View more

I'm probably missing something obvious here but I don't see how to get that option. The closest I can get is Each time the analytic starts Replace existing features and schema   When I'm setting up an output these are the options I see   ... View more

Thank you for confirming Peter. ... View more

Just came across this issue today. Here is the code I used to get it working. I'm on Pro 3.2.3 import pandas as pd from arcgis.features import GeoAccessor, GeoSeriesAccessor import arcpy LeaseOut = pd.read_csv(filepath_or_buffer=f"Z:\\Work\\xyzx") #do pandas manipulation LeaseOut_sp =LeaseOut.spatial.to_table('in_memory/processed_table') LeaseOutCSV = arcpy.CopyRows_management(LeaseOut_sp, 'LeaseOutCSV') ... View more