Latest Contributions by Bud

@Sarah_Hanson  Thanks for the FAQ. Very helpful, especially the product comparison section. For anyone who's interested, there's a similar product comparison page here: ArcGIS Architecture Center > ArcGIS Data Pipelines and ETLs https://architecture.arcgis.com/en/framework/architecture-pillars/integration/methods/data-pipelines-and-etls.html As a follow-up: Do you have any insight into this question? Can an Enterprise Data Pipeline call a Power Automate flow (to send an email)? ... View more

@Sarah_Hanson  Is there any way to host the output data on ArcGIS Server rather than hosting on ArcGIS Online? No, this is not possible. The only supported output option today is a hosted feature layer (or a hosted table if there is no geometry) in ArcGIS Online. Just checking, is that statement still accurate? The post is roughly two years old, so I'm wondering if anything has changed. What if the Enterprise feature layer is served up to AGOL using a distributed collaboration? This one might be out of date too: Can you get notifications if a scheduled task fails? No, but this is functionality we are considering for a future release. ... View more

Related: Introduction to ArcGIS Data Pipelines Webinar: Q&A Can it be used for geoprocessing services? Data Pipelines cannot run the analysis tools that you find in Map Viewer. Instead, Data Pipelines is a data integration and data engineering solution and the tools it supports are specifically for that. If your goal is to automate the use of analysis tools, you might check out creating a Notebook.   ... View more

ArcGIS Architecture Center > Webhooks Webhooks are generally considered an effective, but not foolproof integration method. As they are loosely coupled to the destination endpoint, there is no guarantee that a message from the source system will reach the destination. Issues like network outages, a failed endpoint, or a badly constructed message body could cause that message to fail. This means that webhooks are not perfectly reliable, though not significantly different from any other REST API or endpoint which could suffer from the same reliability challenges. Webhooks require line of sight network connectivity. When an event occurs, webhooks are sent immediately, and if any network access or outage interrupts this request, it can mean that the payload never reaches the final destination. While some systems support automatic retry logic to re-send a webhook payload, this cannot always be relied on, and may result in lost messages in inconsistent network conditions. Webhooks do not guarantee delivery. While retry intervals and attempts can try to achieve a higher rate of success, webhooks do not guarantee that every event or trigger will result in data reaching the destination system. While this can be acceptable for many workflows, consider whether a post-process to validate data completeness may be required to guarantee that all events were properly processed. ... View more

Thanks, Akshay. On a side note, a contact had this take on webhooks: I have used webhooks in the past, but I always used them slightly differently from how they were designed. I just use the webhook to trigger a workflow that uses a query; this way, you pick up things that misfired. I also run the workflow on a schedule to pick up things should it all go bad. I have had IT suddenly block the incoming, ESRI side broke, etc., and users never noticed. I had the workflow logging processed records and what fired. If you watch those, you quickly see that a webhook has broken. I think they call what I do a tickler rather than a webhook. I just use it as a tickler even though it is designed to send the data in the hook. ... View more

@erica_poisson  ArcGIS Connectors for Power Automate > Set up the ArcGIS Enterprise connector https://doc.arcgis.com/en/power-automate/latest/get-started/set-up-the-arcgis-enterprise-connector.htm I haven't tried it. I would need to get I.T. to set up the connector and pay for a Power Automate premium license ($15/month per user). Can non-admin users manage their own AGOL/Power Automate flows? ... View more

Can Data Pipelines for Enterprise call a Power Automate flow (to send an email)? ... View more

Pipelines Question: Can Data Pipelines for Enterprise call a Power Automate flow (to send an email)? ... View more