topic Re: Data Lost When Saved as Draft in ArcGIS Survey123 Questions

Data Lost When Saved as Draft

JonMarks — Fri, 06 Jul 2018 00:40:21 GMT

Hi all, I've found since I've updated the Survey123 App on my phone (iPhone 8 using 11.3.1), that some surveys saved as a draft often lose some data when I re-edit the survey (but not all), this occurs quite regularly with my version of the Survey123 app (2.8.2). It didn’t seem to be an issue with the previous version that I was using (not sure of the version). A colleague using an iPhone 7 and IOS 11.4 is having the same issue. It's slightly random which values get lost, and sometimes on re-editing again, some values re-appear.

Re: Data Lost When Saved as Draft

Anonymous User — Tue, 10 Jul 2018 01:03:37 GMT

Hi Jon,

Have you tried the latest version of the app 3.0 which was released last week. Please let us know if you still experience this problem.

Phil.

Re: Data Lost When Saved as Draft

Fco_JavierRomero — Wed, 11 Jul 2018 05:52:42 GMT

Buenos dias, al igual que Jon, hemos detectado que al guardar como borrador se han perdido datos al recuperar la encuesta. En nuestro caso la perdida de datos se ha producido dentro una repetición, y en concreto en la primera de una serie de ellas. Dentro de esa primera repetición solo se han mantenido los datos de las preguntas que no tienen ninguna condición en la columna relevant . Por el contrario todas las respuestas en las siguientes repeticiones o fuera de ellas se mantienen, tenga o no una condición en relevant.

Saludos.

Romero Sanchez, Francisco Javier
Responsable de Actuaciones y Proyectos
Sevilla / Proyectos Agsa-Mapi

Grupo Tragsa - SEPI

Calle Parsi 5; nº 8 Polígono Parque Sevilla Industrial - 41016 Sevilla
Tel.: 954296934 - 89291/638005860
fromero@tragsa.es
www.tragsa.es

Re: Data Lost When Saved as Draft

JeremyMcDonald1 — Wed, 11 Jul 2018 13:56:21 GMT

Good Morning,

We are experiencing the same issue as above, the surveys are being filled in over a couple of days. The person filling out the reports says when they open the report the next time some but not all of the pictures are missing. The pictures are required however he is still able to submit the report. I believe the program has recognized the pictures have been taken however they are not showing up. In the typical work flow the report shouldn't be able to be submitted if no pictures were taken. Are we able to recover the missing pictures from the device?

Thanks,

Re: Data Lost When Saved as Draft

Anonymous User — Fri, 13 Jul 2018 17:05:41 GMT

Hi Jon,

Does the missing data from drafts only happen when you have saved photos in the survey to drafts folder as well?

Phil.

Re: Data Lost When Saved as Draft

JonMarks — Fri, 13 Jul 2018 19:50:22 GMT

No. There are no photos in the surveys

Jon

Re: Data Lost When Saved as Draft

TonyDaSilva1 — Mon, 16 Jul 2018 23:25:47 GMT

Same here. Our users in the field lost data today due to this bug. Looks like it is associated with fields dependent on values in other fields.

Re: Data Lost When Saved as Draft

ScottBailey3 — Tue, 24 Jul 2018 23:24:39 GMT

I am also seeing this issue. I have it narrowed down to this: the first record in a repeat gets cleared after reopening the form from Draft or Outbox. Repeats are set to minimal appearance although they seem to populate a record by default.

Re: Data Lost When Saved as Draft

ScottBailey3 — Wed, 25 Jul 2018 14:42:14 GMT

I have tested, and as long as they don't reopen the form before submitting, all the records will be submitted. It looks like it clears the data when the form is reopened. I think this has only been happening since the 3.0 update. I tried reverting back to an older version but no joy, problem still persisted. I have also republished the survey since the 3.0 update and the issue still persists.

I have one new survey created since the 3.0 update, repeats have calculations, relevant, and default parameters too, but this problem doesn't occur.

Is it possible that this is only related to surveys originally published before the 3.0 update?

If so, what is the best way to copy existing survey to a new one and point it back to the original data, without losing the data?

Re: Data Lost When Saved as Draft

ScottBailey3 — Wed, 25 Jul 2018 14:51:23 GMT

As per Francisco, (thanks to google translate), I checked and the clearing of the first record in a repeat after reopening the form only occurs when there is a 'relevant' condition set within the repeat which is calculated from outside the repeat.

Re: Data Lost When Saved as Draft

ScottBailey3 — Wed, 25 Jul 2018 15:36:18 GMT

Hi Amy, I was able to fix this issue by removing the 'relevant' condition within the fields in the repeat that are calculated from fields outside the repeat. For my purpose I was able to keep the 'relevant' condition on the 'begin repeat'. It also was able to keep the relevant condition for questions that are calculated from other questions WITHIN the repeat. So again the bug only occurs if there is a relevant condition within a repeat that is calculated from outside the repeat.

Re: Data Lost When Saved as Draft

Anonymous User — Wed, 25 Jul 2018 23:06:01 GMT

Hi Amy,

We have identified this issue and are planning to fix it in a future hotfix for 3.0 app. Currently the only workaround would be to remove the relevant condition as mentioned by Scott below.

Phil.

Re: Data Lost When Saved as Draft

Anonymous User — Wed, 25 Jul 2018 23:07:06 GMT

Hi Scott,

Thanks for your feedback and solution that worked for you. As mentioned in my reply to Amy, we are planning to fix this issues in a future hotfix release for 3.0

Phil.

Re: Data Lost When Saved as Draft

Anonymous User — Thu, 26 Jul 2018 00:28:19 GMT

Hi Jon,

Just wanted to confirm if you tested this with 3.0 version of the app? Do you still experience the issue?

It is likely related to the questions that have calculations and relevant statements, and the process that happens to refresh then when opening from Drafts. We have seen this with surveys with repeats, however I notice you do not have repeats in your survey?

Phil.

Re: Data Lost When Saved as Draft

JonMarks — Thu, 26 Jul 2018 01:08:26 GMT

Hi Phil, yes we’re using V3 (3.0.132) and no there are no repeats on this survey, but there are plenty of relevants and calculations!

Thanks for looking into this

Regards

Jon Marks | Senior Analyst, Environmental Science

GREATER WELLINGTON REGIONAL COUNCIL

Te Pane Matua Taiao

2 Fryatt Quay, Pipitea | Wellington 6011

T: 04 830 4140 | M: 027 609 8912

www.gw.govt.nz

Re: Data Lost When Saved as Draft

Peters_Amy — Sat, 28 Jul 2018 13:24:14 GMT

Hi Philip,

Thanks to you and Scott for your reply. I don't have any relevant statements that reference a field outside the repeat. All of them are inside the begin repeat and end repeat and they only reference fields in that repeat. Any other ideas?

Amy

Re: Data Lost When Saved as Draft

GeoffLewis — Thu, 16 Aug 2018 20:39:06 GMT

Hi Philip

Any time line when we'll get a fix for this?

We're using 3.0.144 and still losing first repeat data in the form if a survey is reopened to edit.

We aren't in a position to remove relevant statement and the fields are compulsory so if the app thinks the data isn't there we can't edit or save.

Re: Data Lost When Saved as Draft

JonMarks — Thu, 16 Aug 2018 23:00:57 GMT

Hey Geoff. After discussions with Hui yesterday I had a bit of a play with some of our forms. It turns out that if u save a form as a draft, then open it again, any data that appears missing is in fact still there and will save/upload fine. I also tried editing the form, including apparent “missing” fields and they saved fine as well. So there’s actually no danger of losing any data. But it would still be nice to get this fixed!

Jon

Re: Data Lost When Saved as Draft

JohnathanHasthorpe — Tue, 21 Aug 2018 01:34:54 GMT

Please note that we have added a fix for records not appearing in the first repeat when made relevant and accessed through sent, drafts, outbox, and Inbox. It is available for testing through the Beta version on EAC: Welcome to our Feedback Community

Re: Data Lost When Saved as Draft

LynnBerni — Tue, 18 Sep 2018 23:23:58 GMT

I'm having the same problem. Data in first repeat is lost when the survey is reopened from Drafts or Outbox. It's only data in relevant fields (which is just about all of them), and all are referenced within the repeat. The repeat also includes a date/time field, with default set to now(). That gets reset too, to the current date/time (ugh).

I just saw the blog post https://community.esri.com/groups/survey123/blog/2018/08/30/minor-update-to-survey123-available-august-30-2018, which states that this problem has been resolved. So I:

confirmed that we are on the latest version of the ios app (3.0.149)
installed the latest version of Connect (3.0.142)
republished surveys
downloaded "updated" surveys to ipad

Nada. It's still deleting/resetting relevant fields in the first repeat.