topic Re: Survey123 web form inconsistently triggering Integromat Webhook in ArcGIS Survey123 Questions

Survey123 web form inconsistently triggering Integromat Webhook

PhilipMcCarthy — Thu, 06 Jun 2019 04:40:52 GMT

Hi All

I have a number of Survey123 forms that I've built and have configured webhooks in Integromat to output submitted data for each into a Google Sheet, and in some cases save submitted photos to Google Drive.

During testing using the Web App, everything worked just fine - data went through the google sheet and photos saved to google drive. I am not using the Field App

However after deploying to users I'm discovering that some of their submitted records don't appear to be triggering the webhooks (happens across multiple forms), though all records are appearing in the 'Data' tab for the form in Survey123.arcgis.com. I can't reproduce the problem, I've arranged for these users to submit test records whilst watching the webhook and it gets triggered ok each time. Everytime I submit a test record it goes through ok.

I've examined the logs for the Integromat webhook, and the missing records do not appear in the history and there are no incomplete executions. Its like the webhook is randomly not getting triggered.

To say this is alarming is an understatement, I have no explanation and the random nature of the issue is making it extremely difficult to resolve. Attached is a screenshot of the 'webhook' section in a Survey123 form that has this issue. I just put in a Microsoft Flow webhook to be notified about any new records so I can see how that service performs.

Thanks, Phil

Re: Survey123 web form inconsistently triggering Integromat Webhook

PhilipMcCarthy — Fri, 28 Jun 2019 06:52:08 GMT

Further to my question. I can now reproduce the problem simply by submitting records repeatedly from the online form on my iPhone. I use the same form over and over, with the same data, and some records trigger the webhook, and some don't. There is no rhyme or reason for this pattern. I even have Microsoft Flow triggers setup as well, and it along with Integromat gets triggered inconsistently. Yet all records appear in the 'Data' section in Survey123.com.

The silence here is, deafening, surely someone from ESRI can assist?

Thanks, Phil.

Re: Survey123 web form inconsistently triggering Integromat Webhook

PhilipMcCarthy — Sun, 21 Jul 2019 23:37:41 GMT

Dear All

For the benefit of anyone else experiencing this problem, I abandoned Survey123 as I could not find a solution to the problem, moved to another online forms provider that works as it should. A real shame, weeks of work down the tube.

Phil

Re: Survey123 web form inconsistently triggering Integromat Webhook

Anonymous User — Mon, 22 Jul 2019 00:09:40 GMT

Hi Philip,

Sorry your first post was missed, and subsequent reply, only just saw this now. As I'm sure you know, we get a lot of new posts and replies every day on GeoNet, so sometimes one or two slip through. However, if the issue is high priority and needs urgent attention, the best avenue is to log a support ticket with Esri Support.

What version of the field app and web app were you using on the devices? Also what make/model and OS version did you see this happen on?

After you added the webhook in Flow and/or Integromat, did you re-download the survey on the device? This is important otherwise the webhook information will be missing.

Have you tried using Charles or Fiddler to analyse the network traffic when you submit, do you see the webhook payload being sent every time, along with the feature payload to ArcGIS? Also did you review the app logs to see if the webhook is actually being sent. It would be good to know where the webhook is going a miss, at the app level or not being received by webhook provider?

We have other customers with surveys that use webhooks that send hundreds and in some cases thousands of surveys a day from the web app and field app, and for each one a webhook also gets sent. Once customer is sending 3,000 a day, all without failure and every feature and webhook being submitted successfully.

It is a shame you decided to abandon Survey123 so quickly, as I am sure we can get the bottom of the issue you are experiencing with webhooks.

If you want to troubleshoot this more, please let me know.

Phil.

Re: Survey123 web form inconsistently triggering Integromat Webhook

JessieShapiro — Wed, 12 Aug 2020 21:19:57 GMT

Hi,

Has this issue been resolved? I am also experiencing the same issue. My survey submissions are inconsistently triggering my integromat workflow and I haven't been able to replicate the problem. In my webhook, it doesn't show a survey was submitted but on AGOL, it successfully updates the feature layer. Please let me know what information I can provide.

Re: Survey123 web form inconsistently triggering Integromat Webhook

Anonymous User — Wed, 12 Aug 2020 23:46:38 GMT

Hi Jessie,

What version of the Survey123 field app are you using?

There are currently no known issues with webhooks being triggered by the field app or web app on submission. At the same time the data is sent to feature service, the webhook is also sent to webhook provider. Once the webhook is sent, it is up to the webhook provider to receive it and process it and run your workflow.

Do you have a paid Integromat account, for free accounts there are some limitations on the amount of webhooks that can be submitted and how frequently, could this be the issues?

Regards,

Phil.

Re: Survey123 web form inconsistently triggering Integromat Webhook

AndreaRyffel — Thu, 13 Aug 2020 11:49:30 GMT

Hello Jessie,
We use FME Server (not Integromat), but I have encountered submission problems as well: Webhooks are only triggered if the Survey123 form is sent from an Iphone / Ipad. Submitting surveys from Android devices does not trigger the webhook. What devices are you submitting your surveys from?

Best,

Andrea

Re: Survey123 web form inconsistently triggering Integromat Webhook

JessieShapiro — Thu, 13 Aug 2020 14:23:49 GMT

Thanks for your response Andrea. That is really great to know as I have never been able to replicate the problem and I use an iPhone. Users submit surveys from both iPhones and Android devices.

Re: Survey123 web form inconsistently triggering Integromat Webhook

JessieShapiro — Thu, 13 Aug 2020 14:26:21 GMT

Thanks for the response Philip. All users are using the latest Survey123 version on their devices. We are currently using the free account with Integromat since we don't hit our data transfer limit each month. Some surveys aren't even found in the Integromat history and don't seem to be triggered by the webhook at all.

Re: Survey123 web form inconsistently triggering Integromat Webhook

JessieShapiro — Thu, 13 Aug 2020 16:35:40 GMT

After further investigation, using an Android versus iPhone does not seem to solve to problem. The webhook is still inconsistently not being triggered even when a survey is submitted through an iPhone.

Re: Survey123 web form inconsistently triggering Integromat Webhook

AndreaRyffel — Fri, 14 Aug 2020 09:44:03 GMT

Thank you for letting me know, Jessie. It looks like these are two different problems, then. I'll set up a new question with my Android vs. Iphone issue.

Re: Survey123 web form inconsistently triggering Integromat Webhook

JessieShapiro — Fri, 14 Aug 2020 16:16:46 GMT

Hi Philip,

How do I get this issue resolved? Our users are pretty unhappy they don't always get an email notification that a survey was submitted. Do I need to open a case with ESRI? We also tried using zappier and were getting the same inconsistencies.

Re: Survey123 web form inconsistently triggering Integromat Webhook

BrackenDavis — Fri, 29 Jan 2021 19:53:51 GMT

I have had similar problems when sending the webhooks to FME Server. What I've noticed is that if I trigger the webhook more than twice in a few minutes, the 3rd + edits/new records (triggers) don't get sent to FME Server.

@Anonymous User, have you heard anything on solving these issues with the webhooks?

Re: Survey123 web form inconsistently triggering Integromat Webhook

PaulSweeney3 — Tue, 16 Mar 2021 20:53:37 GMT

We use survey123 and integromat extensively and it seems generally very reliable however recently I have users mention they have a small percentage of forms submitted, with a webhook attached , but no record of it on integromat. The record is successfully submitted to Survey123 but it did not trigger in integromat. I am unsure as to who I should raise a support ticket with. I note the comment above about multiple submissions in a short period of time. I think this could be a similar pattern but not able to reproduce it consistently. @Anonymous User

Re: Survey123 web form inconsistently triggering Integromat Webhook

m3 — Wed, 29 Dec 2021 18:05:15 GMT

I too am having this problem, using Power Automate, Integromat, Android, iPhone, web form. Not seemingly related to submission rate here

Re: Survey123 web form inconsistently triggering Integromat Webhook

JamesSerendip1 — Thu, 01 Jun 2023 16:13:10 GMT

I am really disappointed to see so little response from ESRI about this. I had put many hours into developing data back-up systems for my Survey123 data collection apps on MS Power Automate, and then abandonded it for unsolvable inconsistencies -- submitted ESRI trouble ticket, and after several days of the support folks getting nowhere, I decided to switch to Integromat ("Make") which has been great, but lately I am experiencing the exact same issue presented here. All devices using current updated versions. In fact, there is only 1 device being used in the field currently, and on a given day I may get 4 submissions from that device out of which 1 or 2 will trigger the web hook, and the others will not.

This is not a minor issue! To be able to easily access a back-up of the data is integral to our use of Survey123 as a data gathering platform, and so for it to have these inexplicable and unsolvable inconsistencies is not acceptable. And the fact that a given user can successfully trigger thousands of webhooks a day is completely immaterial to it being a critical error for other users! As a response, that to me says "user error" which mayvery well in fact be the case! But here are multiple folks, obviously with some experience in using these systems, still finding errors that essentially invalidate the integrity of our data, making the entire Survey123 platform somewhat useless. Alas, I also tried to pursue the issue with Integromat and got absolutely nowhere. After 3 weeks of no response and multiple requests I eventually received a video from a tech going over basic concepts that was completely unhelpful, and recorded speaking so fast I couldn't even make out what he was saying. I reply to say as much, and that this did not resolve my issue and I still needed support. That was 3 months ago and I NEVER got another response, so that isn't an option. Plus, from this thread it seems obvious that the issue is with Survey123.

I am submitting another ticket about this issue with ESRI, and if I find any resolution I will pot it here, and if I do NOT receive any resolution I will post that here as well as a caveat emptor!

Re: Survey123 web form inconsistently triggering Integromat Webhook

AmyNewsam — Tue, 13 Jun 2023 19:03:14 GMT

Hi All, I am also experiencing this problem with Power Automate and Survey 123. The data so far has successfully shown up in the table, but the web hooks are not consistently processing. Please do post a solution if one is found. I will also go through Esri support and post any solutions that may arise.

Re: Survey123 web form inconsistently triggering Integromat Webhook

DuncanC — Tue, 12 Dec 2023 17:09:46 GMT

Did anybody ever find a resolution to this? I'm running into the same problem. Webhook fires inconsistantly. Seems to be more likely to not fire if it's a second submission within the hour. Nothing shows up in my make logs as incomplete, that record just shows up in the Survey123 data view without my make automation being triggered. Worked fine for a month. Now I've had 2 issues in 2 days.

Re: Survey123 web form inconsistently triggering Integromat Webhook

AmyNewsam — Tue, 12 Dec 2023 18:26:13 GMT

It seems to be working for us now... looks like it was just failing when I tried to test it (perhaps because I'm the owner?) and the solution is using an incognito window. But it sounds like that's not the same issue that others are experiencing.