Internal server-side error - Reports

Hello @ZhifangWang ,

I can confirm it's working in both Portals without any issues. Special thanks to you, Zhifang, and also @ZacharySutherby and the rest of the team for your support!

Greetings,

-Luis

mniluka

Thanks for resolving this issue. It's working now without any errors.

ZhifangWang

Hi All,

The "Internal server-side error" has been resolved on the production website. Please let us know if you continue to experience any issues.

To provide more context, the issue was caused by the `type` property being absent in the layer object of `layers` within the JSON response for a hosted feature layer in ArcGIS Enterprise 11.0 and earlier versions. As a result, this affected surveys published in ArcGIS Enterprise 11.0 and earlier versions.

Thank you all for the feedback.

mniluka

When will you release the fix? We're still encountering the internal server-side error.

mniluka

When will you release the fix? We're still encountering the internal server-side error.

RLS

We are still getting an internal server error when trying to generate reports for Survey123 on enterprise.

JessieBrain

Hi! I'm having the same issue. Is there an expected time this fix will be rolled out today?

P.D. for 10.8.1:

ArcGIS Data Store Validation: successful
Sample hosted feature service creation in Portal: succesful

For 10.9.1:

ArcGIS Data Store validation: succesful, except for Tile Cache Data Store (attachment is down below)
Sample hosted feature service creation in Portal: succesful

-Luis

data_store_validation.PNG

survey123beta.arcgis.com-1726497224604.log

Hi @ZacharySutherby ,

I'm sending you 2 .txt files representing console messages and a relatedItem request, respectively. There are also some screenshots in case you want to check out some of the messages that appeared at "My surveys page" reloaded page.

This only occurs on Survey123 Beta website for both Portals: 10.8.1 and 10.9.1.

I hope this can be helpful.

Thank you,

-Luis

relatedItems_request.txt

console_messages.PNG

network_messages.PNG

ahagopian_coj

The reporting issues we were having are fixed in the beta site for us. Looks like the hotfix successfully repaired the issue.

Oh I should clarify for myself, I am NOT using Enterprise, simply ArcGIS Online.

PeterMacKenzie2

I came across the 500 internal server error today when I was trying to simply create a new sample template.
I switched to the Beta site to test, and it now works.
running : Enterprise 10.8.1
hope that helps.

HarmondSantos1

Thanks for the update Zach! I've tested exporting on the beta website and works very well!

ZhifangWang

Hi @lmendez_sp ,

On the Beta website, we have applied another potential fix today. Can you please try again?

If you are still having issues when generating a report, please share with us the screenshot and the failed job id so we can investigate further.

If the issue still occurs on My surveys page, please follow with Zach's suggestion.

Thanks,

ZacharySutherby

Hey @lmendez_sp,

Do you see the same behavior in the production Survey123 website? It looks like the Survey123 website isn't able to find the feature services that the surveys point to. Does your ArcGIS Data Store validate successfully in ArcGIS Server Manager / Are you able to create a sample hosted feature service in your Portal?

If you capture the network traffic while you load the My surveys page there should be a handful of relatedItems requests. What is the response for one of those relatedItems requests?

Hi Zach,

For some reason, Survey123 Beta is not displaying data in my surveys, neither in one portal nor other. In both Portals, there are the same issues described in this post (report generation failing since the beginning of this week, so that's why I wanted to test the fix in Survey123 Beta website).

One portal is 10.8.1 and the other one is 10.9.1.

Best wishes,

-Luis

gismapas_s123_beta_1.PNG

gismapas_s123_beta_2.PNG

Thank you for the update Zach!

I just tested and it seems to resolve the Data page loading issues I was having as well! (even the issue with the form view I've been having for ages because of hosted tables and null geopoints seems resolved)

ZacharySutherby

Hey all,

We have identified the cause of the report errors observed and are working through a fix. We are planning on releasing a hot fix on September 17th to address the error. We currently have the fix for the issues on our https://survey123beta.arcgis.com/?portalUrl=<yourPortal> site to test and verify the errors are resolved.

I'm SUPER curious what the issue is. Seems odd that it has affected this many, but not everyone.

I do not currently for the Data page not loading from the CSV issue, an Esri staff member replied to my linked post about there being a hotfix planned for next week to resolve it, I asked if there is a BUG number so we shall see what they say.

ahagopian_coj

Do you have the link for the BUG? We are experiencing the same thing (I think) and would like to read the details about it.

Along with this update I've also seemingly encountered an escalated bug with some surveys I have that I created with null geopoints (I am working on re-creating to publish them to feature layers as expected, I just need the time).

The Data page will not load for these surveys now Re: Survey123 Website Data Page No Longer Loading ... - Esri Community

ZacharySutherby

Hello all,

The Survey123 team is aware of the issue and are actively investigating the cause. Tech Support has logged BUG-000170665 for this.

AprilChipman

I've started a ticket with ESRI and so far no helpful response. A tech got on my system and checked things and took screen shots. It's been a day and a half now. I'm getting very behind in my report creation.

EricLacoursierePQ

We do have the same issue here as well. (!!)

Geotechnickal

Located in North America (North Carolina).

Terry_Bearb

We are receiving that exact error regarding the "jobStatusInfo" - "detailedStatus".

Terry_Bearb

Located in North America (Alabama).

Strategic

We are in North America (Canada West) and experiencing the same issue. There are no entries in the Log so I suspect there is an issue on ESRI's side

Could not find any extra error information using Developer Tools

"jobStatusInfo": {
    "detailedStatus": "prepareFailed",
    "startTime": 1726068524477,
     "progress": 0
},
"submitted": 1726068463728,
"completed": 1726068524498,
...
    "messages": [
        "Internal server-side error. "
    ]

Still working fine on my end (I would expect an update to hit me by now).

Since the issue happens directly from the S123 website, we can assume it's an Enterprise or Esri issue and nothing to do with your flow's configuration.

Can you access the Data page in Portal?
Can you generate reports through the Beta S123 Website (and if not, do you get a different error)?
Have you tried restarting Portal yet?
This happened a few weeks ago now, but a Node update on Esri's end changed how Headers were parsed from IIS. Maybe it was slow to roll out in different regions. Have you checked IIS settings? A little convoluted, but open IIS > Server > Default Website > HTTPS Response Headers (double click) > Strict-Transport-Security (double click) > inspect the entry and ensure no extra characters (e.g., spaces at the end of the string) are present.

@Terry_Bearb @nnolasco @Sunil_Ghimire @Geotechnickal Out of curiosity, which region are you guys in? North America, Europe, etc?

Terry_Bearb

I just created a ticket with Esri support as well. We're currently experiencing the same issue when attempting to generate a report. Hopefully we get an answer soon.

nnolasco

It happens from the Survey123 Website as well. I do have an open ticket with them and did a screen share with an Analyst yesterday. Nothing looked off on our system, and given the issue is affecting other Orgs as well is an indicator it is on the ESRI side of things. I am only getting this from surveys within Enterprise/Portal.

I'd recommend opening a support ticket with Esri. If this is related to a server updates, there isn't much we can do here, unfortunately.

Sunil_Ghimire

I am also having the same issue on Enterprise. It was working fine until Yesterday. Please Help!

I always seem to be at the tail end of updates, so if that's the case, I will likely see issues by late tonight/early tomorrow.

Fingers crossed it's just a temporary thing then.

I just tried as well with ArcGIS Online and am not facing any issues.

I am wondering if there are some stability issues with their Survey123 services right now or an attempted update of some kind, surveys I was having issues viewing the Data page form view before, are just not loading the Data page at all today... so that's fun.

I'm on Enterprise and still generating reports. They may have released a patch that hasn't reached me yet though.

However, Enterprise and AGO should be using the same report generation service. Have you checked your Connection yet? Is it timed out? Can you generate reports via the S123 website?

nnolasco

Same here in the City of Virginia Beach. This is occuring on Surveys hosted on Enterprise I do not get the issue on those in AGOL.

Geotechnickal

Having the same server-side error on all of my Surveys, regardless of whether a repeat is present or not. Please advise!

Are you able to generate a report from the S123 website successfully?

After you confirm that, what automation process are you using to generate a report?

I am using Power Automate, and I am receiving no errors/issues with report generation.

Wolpertingerjack

I am having the same issue. I am relatively new to Survey123 reports, but I think I followed Ismael Chivite's webinar walkthru for creating reports and attaching to emails, (as far as I can tell,) to a tee, and when I run a test, I get the "A value must be provided for source path." error in the Upload file from URL step, which Ismael says in a thread, is an indication there must be an error in the Create Report step. Opening up the Output>Body I see Message: Internal server side error

Lrob23

I am experiencing this too when trying to preview sample reports.