topic Re: Survey123 excessive load time with CSV file in ArcGIS Survey123 Questions

Survey123 excessive load time with CSV file

BurlingtonStrachan1 — Sat, 03 Nov 2018 04:32:12 GMT

I am using the pulldata function of suvey123 with a csv file of approx. 6MB. Since adding this function the load time of the survey has increased from seconds to hours. Is this normal for a file of this size. The device I am using has over 40Gb of available space and the load is being done over a 100Mb wifi connection.

Re: Survey123 excessive load time with CSV file

Anonymous User — Sun, 11 Nov 2018 23:50:50 GMT

Hi Burlington,

How many rows of data are in the CSV file? We are aware of issues with slow load times and performance with large choice lists and using pulldata() with external csv files. Could you please share your xlsx file and external csv file so we can take a closer look?

Regards,

Phil.

Re: Survey123 excessive load time with CSV file

DougBrowning — Tue, 13 Nov 2018 17:53:47 GMT

Are you in a repeat? I had this issue for months and finally tracked it down.

If you have a drop down in a repeat and that drop down has a choice_filter that uses a field that (like fulllist=${fulllist}) and that field is also in the repeat it is super slow. All I did was move the field used in the choice_filter outside of the repeat and my form went from 20 seconds to 1!

Check to see if you are doing this.

Re: Survey123 excessive load time with CSV file

tomhughson — Thu, 19 Mar 2020 08:01:00 GMT

Hi Doug, I also have a slow-loading web-form and came across your answer above from over a year ago. However, the field I have in the choice filter is already outside the repeat (as shown below). I can't really follow how this would improve the loading time for the form but do you still believe that this type of scenario was causing your form to load slowly or with the passage of time do you think it was something else? Thanks in advance, Tom.

Re: Survey123 excessive load time with CSV file

DougBrowning — Thu, 19 Mar 2020 13:18:26 GMT

In my case it was a select_one external. You just have a regular choice list. If your list is long moving it to external_choices should help a lot. So that could be it. Start there.

Hope that helps

Re: Survey123 excessive load time with CSV file

PaigeRichardson — Thu, 25 Feb 2021 20:52:19 GMT

Hi Phil,

We are also running into this problem on mobile devices accessing the survey from safari browser. Did ESRI happen to find a solution or workaround to this slow load time using the 'select_one_from_file' field type? (We are using the pulldata() function to hit a csv with 4 columns approximately 40,000 rows - 6MB in size).

Thanks!

Re: Survey123 excessive load time with CSV file

Anonymous User — Fri, 05 Mar 2021 06:27:04 GMT

Hi @PaigeRichardson,

In the latest release we have made signifcant improvement to using large choice lists and select one from file in the Survey123 field app. We utilize improved database performance, cahcing and indexing to achieve this. Unfortunately the web app can not use the same techniques due to the nature of the browser, and while some improvements have been made to increase performance, the time it takes to load a survey with 40,000 records in a list, will still be significantly impacted in a web browser.

Refer to the following blog for the latest 3.12 release and updates:

https://community.esri.com/t5/arcgis-survey123-blog/what-s-new-in-arcgis-survey123-february-2021/ba-p/1030586

Regards,

Phil.