topic Re: Why does my answered survey have no records ? in ArcGIS Survey123 Questions

Why does my answered survey have no records ?

FatmaŞenol — Sat, 04 Mar 2017 09:32:12 GMT

Dear All,

I posted a similar question yesterday but haven't received any comment so far. I guess I didn't make my question

clear enough.

I designed and published a survey to collect data of certain aspects of historical buildings in a small town. The number of questions in the survey is 51 and so far 899 surveys have been filled and submitted (Survey Overview.jpg). The problem is that when I check the results on Survey123.arcgis.com all I can see is the location of data points and the picture taken at the data point (Survey Data.jpg). I'm quite confused on why the data table looks empty as if a survey was submitted without entering any data.

I need immediate help on this matter. I would be grateful if anyone at ESRI could share a solution as soon as possible. I would appreciate any immediate contribution.

Regards

Re: Why does my answered survey have no records ?

JamesTedrick — Sun, 05 Mar 2017 21:08:12 GMT

Hi Omur,

When was this survey authored? Was it authored via Survey123Connect or using the Survey123 website? The results you are seeing look like the issue that caused us to post a blog post on Friday - https://community.esri.com/groups/survey123/blog/2017/03/03/known-issue-with-public-surveys-made-via-the-website

Re: Why does my answered survey have no records ?

FatmaŞenol — Mon, 06 Mar 2017 07:02:32 GMT

Hi James,

The survey was authored on March 2nd. It was authored via Survey123 website. I don't know if this is the same issue but this survey is not public so each user has to sign in. This issue is quite critical to me and the most important thing is to be able to download survey as gdb and create maps and reports as soon as possible.

Re: Why does my answered survey have no records ?

FatmaŞenol — Mon, 06 Mar 2017 16:41:12 GMT

Hi James,

I truly hope there would be a solution as soon as possible. I would share the survey results as gdb or csv if you want to look at the problem closely. I'm sorry for bringing up the same issue again but there is huge pressure on my side to fix this problem. Best Regards

Re: Why does my answered survey have no records ?

JamesTedrick — Mon, 06 Mar 2017 17:09:25 GMT

We will be doing a hot fix a little later this week as we get the fix completed and verified. Note that this will not recover existing data, just ensure that surveys published in the future do not experience this problem. If the surveys were collected using the mobile application, it may be possible to recover the original surveys by extracting the data from the phones.

Re: Why does my answered survey have no records ?

FatmaŞenol — Mon, 06 Mar 2017 19:51:03 GMT

Hello James,

I'm glad to hear that this issue will be fixed soon. But, I'm extremely concerned about the existing data since the field work is finished and total number of record is 2923. As I mentioned in my first response, the survey was not public and data were collected by 23 participants. Since there was no notification on this unexpected result of March 1st update of ArcGIS Online I published my survey and started collecting data .It's quite unfortunate the hot fix will not recover existing data collected after March 1st. It's impossible to collect the same data again after you get the fix completed. ESRI has to find a way to recover almost 3000 existing records.

I can hardly understand why existing data could not be recovered. Yes, the surveys were collected using the mobile application but I don't have detailed information on how original surveys could be recovered. Should we create a new survey with the same questions and re-submit the original survey ? What is the workflow to extract the data from the phones ? I would appreciate if you could let me know the possible solutions.

Regards

Re: Why does my answered survey have no records ?

FatmaŞenol — Thu, 09 Mar 2017 18:00:05 GMT

Hi James,

I want to ask you if there is any solution to recover the existing data as we approach end of the week. The number of surveys increased to 3215 since some of the students sent additional surveys. Apparently, new surveys can be sent from phones but there is still no data shown in the table. The current situation remains the same. I can only see data points and pictures as an attachment. Is it possible to transfer existing records to another survey? In our case this would be a copy of the original survey. We need a working solution as soon as possible. I would appreciate if you could let me know if there is any progress.

Regards

Re: Why does my answered survey have no records ?

RobertMarros — Thu, 09 Mar 2017 20:58:07 GMT

James,

Is there an ETA on when the hot fix will be made available for this issue? I finally came across this post after posting two of my own dealing with this same issue.

Thanks

Re: Why does my answered survey have no records ?

JamesTedrick — Thu, 09 Mar 2017 21:43:42 GMT

Hi Robert, the fix was applied to the website early this morning and is operating as expected.

Re: Why does my answered survey have no records ?

JamesTedrick — Thu, 09 Mar 2017 21:49:19 GMT

Hi Omur,

In reviewing with our technical support, it was misdiagnosed as only affecting public users because of the permission levels the technical support people had - they were acting as administrators when duplicating and had elevated permissions.

In terms of recovering, the best method for you should be:

1) enable the fields to be shown in the destination fieldworker service - this was documented in the blog post I had previously placed in this forum and must be done for the existing feature service - see Enable anonymous submittal - 03/2017 workaround - YouTube

2) have the students resubmit their surveys, by going to the sent folder, clicking on their responses, and then submit the form again

Re: Why does my answered survey have no records ?

FatmaŞenol — Fri, 10 Mar 2017 20:02:34 GMT

Hi James,

I followed the steps you suggested and asked one of my students to submit the form again.

The number of records increased after she submitted the forms again.Unfortunately, the table still looks empty. I attached screenshots showing each step. I'm not sure if I missed something but I'm still confused. I have a question at this point :

Would there be duplicated records for each student after they submit the forms ? If so, should I delete all existing records to avoid any possible confusion ?

I'm willing to invite tech support people to our AGOL organizational account or moreover I can share my administrator account information to check the survey and any other related layers. The only downside is the survey form is not in English.

I would appreciate it if you could kindly let me know what you think.

Regards

Step 1

Step 2

Re: Why does my answered survey have no records ?

FatmaŞenol — Tue, 14 Mar 2017 18:53:37 GMT

Hi James,

As I mentioned in my previous message, we are still unable to view any records in the table. I have two questions;

1) Is it possible to copy all records of the original survey to another survey which has exact same structure ?
I'm not sure if this approach makes sense but it has come to my mind.

2) I managed to extract SQLite files from phones and copy a SQLite file to C:\Users\Saygins\ArcGIS\My Surveys\Databases (Survey123 for Desktop). This way, I'm able to see the surveys which each student has
collected on the field. I opened a survey and tried to send them again without any modification.
However this method has failed since adding attachments are never finished for some reason.
Is it possible to use this method to resubmit surveys ?

I urgently need to find a solution or workaround ASAP. Please let me know if you have any other suggestion.

Regards

Re: Why does my answered survey have no records ?

JamesTedrick — Tue, 14 Mar 2017 18:58:03 GMT

Hi Omur,

Given where you're at, submittal from your computer or extraction is the best option. If you've copied the images over along with the sqlite databases, place them in the 'My Survey Attachments' folder to have submit properly.

Alternatively, I have a python script that can read the sqlite database and extract the data- let me know if you want to pursue that route.

Re: Why does my answered survey have no records ?

FatmaŞenol — Tue, 14 Mar 2017 19:19:19 GMT

Hi James,

Thank you for your prompt response. I guess this is the best option that I tried so far.

One thing in my mind is that if it is possible to place all the surveys into the outbox.

So that, I can resubmit all surveys at once, instead of sending them one by one by each student.

Yes, I would like to use the phyton script you referred to.

Regards

Re: Why does my answered survey have no records ?

FatmaŞenol — Mon, 20 Mar 2017 19:23:10 GMT

Hello James,

I've copied `My Survey Attachments` folder and the sqlite databases from each student's phone. I sent them instructions on how to re-submit their surveys from their computers and they've done it last weekend. However, I'm still struggling with technical issues. All I can see is `empty` table when I check the survey records on Survey123.arcgis.com

Additionally, the total number of submitted records seems to be 6133 but something is not right here since, actual number of surveys is almost half of 5000. I just can't understand why I can't see any record after re-submittal

I really need urgent technical support here. I would appreciate if you could kindly inform me on solution or workarounds as soon as possible..

Re: Why does my answered survey have no records ?

JamesTedrick — Mon, 20 Mar 2017 21:36:09 GMT

I followed up with Omur offline and identified the issue.

Re: Why does my answered survey have no records ?

NicholasMoore — Tue, 01 Aug 2017 06:49:10 GMT

Hi James,

Would it be possible to get this python Script too. We have some old Orphaned Records too in a SQLite Database that we would like to extract and this would be really helpful. We were going to code our own at some point. However is this is available it will help us tremendously

Nick

Re: Why does my answered survey have no records ?

DaveMcPherson — Tue, 01 Aug 2017 07:00:30 GMT

Hi James, we would very much like to get the python script you say you have developed to extract the data directly out of the .SQLite database...I'm not sure if my colleague nick.moore‌ has already asked?

Re: Why does my answered survey have no records ?

JamesTedrick — Tue, 01 Aug 2017 19:39:10 GMT

Hi Nick,

Attached is the basic script to extract to a CSV file. Note that this wasn't engineered necessarily to create related tables. We're working on a more thorough tool for processing

Re: Why does my answered survey have no records ?

JamesTedrick — Tue, 01 Aug 2017 19:39:31 GMT

Hi Dave,

I just replied to Nick's message in this thread.