Latest Contributions by Bud

Related: Introduction to ArcGIS Data Pipelines Webinar: Q&A Can it be used for geoprocessing services? Data Pipelines cannot run the analysis tools that you find in Map Viewer. Instead, Data Pipelines is a data integration and data engineering solution and the tools it supports are specifically for that. If your goal is to automate the use of analysis tools, you might check out creating a Notebook.   ... View more

ArcGIS Architecture Center > Webhooks Webhooks are generally considered an effective, but not foolproof integration method. As they are loosely coupled to the destination endpoint, there is no guarantee that a message from the source system will reach the destination. Issues like network outages, a failed endpoint, or a badly constructed message body could cause that message to fail. This means that webhooks are not perfectly reliable, though not significantly different from any other REST API or endpoint which could suffer from the same reliability challenges. Webhooks require line of sight network connectivity. When an event occurs, webhooks are sent immediately, and if any network access or outage interrupts this request, it can mean that the payload never reaches the final destination. While some systems support automatic retry logic to re-send a webhook payload, this cannot always be relied on, and may result in lost messages in inconsistent network conditions. Webhooks do not guarantee delivery. While retry intervals and attempts can try to achieve a higher rate of success, webhooks do not guarantee that every event or trigger will result in data reaching the destination system. While this can be acceptable for many workflows, consider whether a post-process to validate data completeness may be required to guarantee that all events were properly processed. ... View more

Thanks, Akshay. On a side note, a contact had this take on webhooks: I have used webhooks in the past, but I always used them slightly differently from how they were designed. I just use the webhook to trigger a workflow that uses a query; this way, you pick up things that misfired. I also run the workflow on a schedule to pick up things should it all go bad. I have had IT suddenly block the incoming, ESRI side broke, etc., and users never noticed. I had the workflow logging processed records and what fired. If you watch those, you quickly see that a webhook has broken. I think they call what I do a tickler rather than a webhook. I just use it as a tickler even though it is designed to send the data in the hook. ... View more

@erica_poisson  ArcGIS Connectors for Power Automate > Set up the ArcGIS Enterprise connector https://doc.arcgis.com/en/power-automate/latest/get-started/set-up-the-arcgis-enterprise-connector.htm I haven't tried it. I would need to get I.T. to set up the connector and pay for a Power Automate premium license ($15/month per user). Can non-admin users manage their own AGOL/Power Automate flows? ... View more

Can Data Pipelines for Enterprise call a Power Automate flow (to send an email)? ... View more

Pipelines Question: Can Data Pipelines for Enterprise call a Power Automate flow (to send an email)? ... View more

This doesn't address the need for scheduled, server-based, emailed reports, but it might address the scheduled jobs side of things, to a degree: Introducing ArcGIS Data Pipelines (Beta) in ArcGIS Enterprise 12.0 ... View more

As ZachBodenner said in Stable alternatives to Power Automate: This isn't a criticism necessarily so much as an honest question: Other software has native/built-in automated process type stuff - why doesn't ESRI? It seems like something that should be included in the AGO/Portal suite... ... View more

@ZachBodenner I’ve wondered about this too. For example, with IBM Maximo, all the automation is built right into the product. No third party apps needed. How reliable are ArcGIS Online webhooks? ... View more

This isn’t strictly about reliability, but it talks about timing, which seems relevant: Why is there such a big delay between a trigger and the action? While some flows can be instant, there are many cases in which there is a delay between a trigger and an action and vice versa. For example, when using the ArcGIS connector in conjunction with a Microsoft SharePoint connector, there is a delay (one to three minutes) when processing information. https://doc.arcgis.com/en/power-automate/latest/get-started/faqs.htm  A few related posts: Power Automate triggers not working since 9th Oct Power Automate - Re-Establish Connection Power automate ArcGIS Connectors for AGOL Feature layer (hosted, view) Stable alternatives to Power Automate Survey123 Power Automate Error 'GetWebhookPayloadSchema' is too large Power Automate Trigger Issue ... View more