Yesterday (2021-07-29) beginning around 3pm EST all the Survey123 submissions through Integromat that generate feature reports began failing due to a time out error. This was not a single survey, but multiple different surveys using different feature reports.
I went directly to the Survey123 web site and tried creating the reports manually from there. That failed too, and continued to fail all the way up until around 7:30pm EST when it began working again. There were 23 surveys backed up in the Integromat queue.
Clearly there was an issue with one of the hosting processes at ESRI that was failing to process these feature reports from the Survey123 web site since trying to generate any of them manually from the web site failed.
There were (3) reports that were skipped – never even made it to Integromat since the trigger never executed because the Survey123 site must have been unreachable. I had to identify and process those ones manually.
Yet, the ArcGIS Online Health dashboard showed all green – no issues - and still does the following day.
That dashboard seems to be pretty much useless. It would be nice if it actually identified issues when they happened in real-time, but even after the fact when they don’t show up is even more frustrating – like there never was an issue.
I'm opening a case with ESRI on this issue to hopefully generate some action. We have many people depending on these reports and we hear about it immediately when they don't receive them. It is understood there will be outages and problems from time to time, but having no acknowledgement of the issue by ESRI so we can pass along the information while waiting for a resolution is unacceptable.
