topic Re: Webhook problems in ArcGIS Survey123 Questions

Webhook problems

KenMorefield — Tue, 17 Jul 2018 21:38:17 GMT

I'm experimenting with setting up webhooks in both Integromat and Microsoft Flow. I'm new to webhooks, so I could easily be doing something wrong... The workflow that I'm trying to implement is to send an email on survey submission. I can't seem to get the Microsoft Flow webhook to work at all. I'm using the Office 365 Outlook Connector and utilizing my work email. It seems simple enough. When I test it out, I get no results.

With Integromat, I'm using "Webhooks" and "Office 365 Email". It works great when I submit the survey through the web interface, but does not work if I submit the survey through the Survey123 app on my iPad. Why would it not work when submitting through the iPad?

I would also be interested to know more about how to attach 1 or more attachments (photos captured in a repeat within a survey) within an email using Integromat, Microsoft Flow, etc.

James Tedrick Ismael Chivite - There was mention at the Conference that there would be some tutorial writeups on webhooks coming out soon. I sure can't wait to see them!

Re: Webhook problems

JohnathanHasthorpe — Thu, 19 Jul 2018 02:27:25 GMT

Hi Ken

To address your questions:

I'm using the Office 365 Outlook Connector and utilizing my work email. It seems simple enough. When I test it out, I get no results.

When you run a test in flow are you getting any errors at all. Or is it just that the emails are not being sent?

With Integromat, I'm using "Webhooks" and "Office 365 Email". It works great when I submit the survey through the web interface but does not work if I submit the survey through the Survey123 app on my iPad. Why would it not work when submitting through the iPad?

Once you created the webhook in the website, did you re-download the survey to the field app? It is possible that the field app is not submitting as the survey does not have the webhook configuration information in it.

In general, you should test your scenarios/flows in the respective builders. Both Inegromat and flow provide feedback in the UI on where there are successes and failures in each step of the process. Also, you can use Fiddler (or an alternative) to listen to HTTP requests and confirm that the app is calling the webhook URL. You may need to use the Windows or Mac version of the Survey123 field app to test this.

I have shared a workflow on working with attachments and will create another one for related records next week. Please see the attached document for working with attachments.

Thanks

John

Re: Webhook problems

KenMorefield — Thu, 19 Jul 2018 16:41:21 GMT

John,

Thanks so much for this tutorial! I will work through this and see how far I get. I look forward to additional tutorial scenarios - especially for related records. I'll post back soon with my results.

Ken

Re: Webhook problems

KassandraRodriguez — Thu, 19 Jul 2018 17:39:48 GMT

I had the same issue with the webhooks not sending the email, turns out you have to re-download the survey once your done configuring the webhook with Microsoft Flow. Also I made sure when I made any changes to my webhook that I disconnected it from the survey, saved it, then connect it again, saved it. The new time stamp should show on on survey settings and then re-download the survey and your good to go.

Re: Webhook problems

KenMorefield — Thu, 19 Jul 2018 19:56:08 GMT

Hi John,

I seem to be stuck at this point in your tutorial: On page 7 you state - "In the same way delete the objectid value and replace it with feature: result: objected (from the Custom webhook)"

I don't have a feature result parameter. Any idea why that is?

Thanks for all of your help!

Ken

Re: Webhook problems

JohnathanHasthorpe — Mon, 23 Jul 2018 02:01:14 GMT

Hi Ken

Can you confirm that you have done a test run with Integromat? i.e. click the play button and submit a survey through the Survey123 field or web app.

Re: Webhook problems

KenMorefield — Mon, 23 Jul 2018 18:12:02 GMT

Hi John,

I was able to get it successfully working using your tutorial. The only slight difference was on the first "HTTP" module, where you replace the objectId with feature: result: objectId - I did not have that parameter available. I did have response: addResults: objectId. This parameter worked for me. I believe the problem that I was encountering with the integromat scenario not working when sending a survey on my iPad had to do with needing to re-download the survey once my scenario was completely finished in integromat. I don't think the downloaded survey on my iPad was seeing the webhook. Consider this case closed! Thanks so much for your help! I look forward to seeing additional tutorials on different integromat scenarios - especially working with related records!

Ken

Re: Webhook problems

ChelseaRozek — Fri, 03 Aug 2018 18:01:17 GMT

I'm trying to get emails to send via Microsoft Flow. You mentioned redownloading the survey, what if we're just using the web version of the survey? I've tried clearing my cache, but it doesn't help.

Re: Webhook problems

JohnathanHasthorpe — Tue, 07 Aug 2018 01:39:24 GMT

Hi Chelsea - did you do a test run in Flow, and if so, did it return any errors?

Could you also test with the field app to see if this works?

Re: Webhook problems

ChelseaRozek — Fri, 10 Aug 2018 18:01:52 GMT

Hi John, Thanks for the reply. I got it working. I missed the toggle (that's not on the Edit Workflow page) that enables and disables the flow. I certainly won't forget that again!

Re: Webhook problems

MarkLache1 — Fri, 24 Aug 2018 17:53:23 GMT

Created this in Integromat and appear to be having a glitch Johnathan Hasthorpe The entire process runs but the 2nd HTTP request and Google Photos doesn't have any results bubbles like the other tools. Each step had a run and survey data submitted. No errors, says the scenario run was completed.

Google Photos has no attachment in the album.

Cant figure out why its not working. How did you get it to work in Microsoft Flow Chelsea Rozek

Re: Webhook problems

JohnathanHasthorpe — Tue, 28 Aug 2018 11:51:49 GMT

Hi Mark - click on the last result bubble for the first http request.

Take a look at the URL that was used and the response. Please feel free to share a print screen.

Also are you submitting the survey from the web form or that field app?

Re: Webhook problems

MarkLache1 — Tue, 28 Aug 2018 13:34:13 GMT

Hi Johnathan,

Output from repose is attached. Submit using the web form.

Thanks

Re: Webhook problems

MarkLache1 — Tue, 04 Sep 2018 19:22:10 GMT

John,

Attached is the screenshot from the first HTTP request.

Mark

Re: Webhook problems

JohnathanHasthorpe — Thu, 06 Sep 2018 04:32:46 GMT

Hi Mark

Thanks for this. It looks like the attachment information is not being included in the response from the query attachments. First of all make sure that you only have one browser tab open when you are using Integromat.

Next ensure that the data structure for the payload has bee correctly defined - see the following from the documentation:

Were you getting the response above (you should have information in the attachmentInfos) and did you use it to define the data structure later on in the workflow?

Thanks

John

Re: Webhook problems

MarkLache1 — Thu, 06 Sep 2018 13:13:22 GMT

This is what my JSON response looks like (which I copied into notepad as per the instructions):

{
"fields" : [
    {
      "name" : "objectid",
      "type" : "esriFieldTypeOID",
      "alias" : "ObjectID",
      "sqlType" : "sqlTypeOther",
      "domain" : null,
      "defaultValue" : null
    },
    {
      "name" : "globalid",
      "type" : "esriFieldTypeGlobalID",
      "alias" : "GlobalID",
      "sqlType" : "sqlTypeGUID",
      "length" : 38,
      "domain" : null,
      "defaultValue" : null
    }
],
"attachmentGroups" : [

    {
      "parentObjectId" : 18,
      "parentGlobalId" : "xyz123",

      "attachmentInfos" : [
        {
          "id" : 11,
          "globalId" : "xzy123",
          "name" : "Image-1.jpg",
          "contentType" : "image/jpeg",
          "size" : 313749,
          "keywords" : "Picture_1"
        }
      ]
    }
]
}

Re: Webhook problems

MarkLache1 — Thu, 06 Sep 2018 21:28:05 GMT

Got it to work. I had to change both my HTTP requests to include the dynamic data from the webhook regarding surveyInfo instead of hardcoding it in. In the end my first HTTP request looked like this:

{{7.surveyInfo.serviceUrl}}/0/queryAttachments?objectIds={{7.response[].addResults[].objectId}}&globalIds=&definitionExpression=&attachmentTypes=&size=&keywords=&resultOffset=&resultRecordCount=&f=pjson&token={{7.portalInfo.token}}

The second looked like this:

{{7.surveyInfo.serviceUrl}}/0/{{7.response[].addResults[].objectId}}/attachments/{{14.id}}?token={{7.portalInfo.token}}

Re: Webhook problems

JohnathanHasthorpe — Fri, 07 Sep 2018 03:40:29 GMT

Hi Mark

Yes, you were expected to replace the url with your own url. But your solution is better and I will update the doco to use it.

Thanks

Re: Webhook problems

MarkLache1 — Fri, 21 Sep 2018 18:08:42 GMT

John,

I'm trying to do a similar operation...a post on webhook trigger. Using a HTTP post with JSON:

[

{
"attributes" : {
"OBJECTID" : 1,
"Selection" : "here"}
}
]

I'm successful with REST module on services page, but not with this script

Re: Webhook problems

JohnathanHasthorpe — Tue, 25 Sep 2018 02:32:26 GMT

Hi Mark

Could you explain the workflow in a bit more detail. Also are you getting any errors in Integromat?