topic Re: Mapping with Survey123 within a polygon or admin unit in ArcGIS Survey123 Questions

Mapping with Survey123 within a polygon or admin unit

Indra_SharanKC — Fri, 14 Sep 2018 12:31:10 GMT

Is there a way to use ArcGIS online web map in Survey123? I need to search an administrative unit by its name from search window either on Survey123 app or on Survey123 web form, then once the admin unit flashes and zooms to its extent, i need to tap on the map within the boundary and identify a point location to fill up with its attributes data and then submit. The approach of using tiles does not seem fit in this case.

Thank you.

Re: Mapping with Survey123 within a polygon or admin unit

JohnathanHasthorpe — Sat, 15 Sep 2018 02:30:00 GMT

Hi Indra

There are a few enhancement requests in your requirement:

- Support for web maps - this is not supported yet, but we are looking to add support in a future release

- Searching reference layers - again not supported yet, but under consideration

- Spatial inheritance - again not supported yet, but under consideration

I'll add your requirements to the internal issues in our repo.

One option is to look into the new beta Javascript functionality. You could incorporate code that would do the search against a polygon layer (based on your location) and pull through the values to populate the survey. Take a look at the EAC documentation here: Welcome to our Feedback Community

Thanks

John

Re: Mapping with Survey123 within a polygon or admin unit

Indra_SharanKC — Mon, 17 Sep 2018 03:56:10 GMT

Hi John,

Great to hear that these requirements are going to be met. The first important thing would be being able to use web map. Which version of Survey123 will have this addressed, any idea?

Thank you for your considering this to the internal issue, and pointing at other resources.

Kind regards

Indra

Re: Mapping with Survey123 within a polygon or admin unit

JohnathanHasthorpe — Thu, 20 Sep 2018 05:13:54 GMT

Hi Indra

This issue is our backlog. Could you share your requirements - i.e. why do you need web map support?

I'll add your feedback to our repo.

Thanks

John

Re: Mapping with Survey123 within a polygon or admin unit

Indra_SharanKC — Thu, 20 Sep 2018 13:13:15 GMT

Hi John,

I can give you a number of reasons justifying the need for a web map in Survey123. I will include two cases here:

1. Election observation and monitoring: During a national or local election, a number of international and national election observers are deployed by the National Election Commission. These observers go to far and remote places, most of the times by walking very long distance. They observe election and record their observation following an international / national protocol, and then visit the next polling station. Paper based data recording and processing takes long time. We replaced the paper based data collection, submission and summary generation with Survey123.

We have web map of all the polling stations, with every details of the polling station and local surroundings. But, we could not use this and esri's global base map only serves as a surface on earth. The election observers could not really correctly relate their reporting with the polling station they were visiting. We made paper maps, but there is no point when the web map itself can not be used.

2. Distribution of educational materials to schools: When city based organizations are assigned the job of distributing education materials to the schools in remote rural areas, we need to monitor whether the material was delivered to proper school. This can be done if we are able to use web map of the schools and ability to search and find specific school on the Survey itself.

Hope this helps. If you need more examples, i can provide you.

Thank you

Re: Mapping with Survey123 within a polygon or admin unit

DougBrowning — Fri, 21 Sep 2018 15:11:40 GMT

Use the web map in collector then launch survey123 passing a key and any other attributes over. Whenever you want a map or spatial use collector - that is what it is good at.

Re: Mapping with Survey123 within a polygon or admin unit

Indra_SharanKC — Wed, 26 Sep 2018 09:12:31 GMT

Hi Doug, thank you for pointing at another method. Our field staff are not very tech savvy, and like Survey123 with nice looking questions. But will try your approach. Do you suggest links to such resource? Thank you

Re: Mapping with Survey123 within a polygon or admin unit

DougBrowning — Thu, 27 Sep 2018 14:34:14 GMT

You can still use Survey123 for the questions just use collector for the spatial side. But if it is just a few you can do it in collector.

I had 175 tablet users with an avg age of 60 with many never seeing a smartphone before. They picked it up quick if you just showed them. Worth a test since it does not take long to build.

Full esri post on it is here https://community.esri.com/groups/survey123/blog/2016/07/30/understanding-survey123s-custom-url-scheme

My workflow is this

Create the form and publish.

Download the form feature service as a gdb.

Create a new GDB in catalog - this holds your collector features.

Add the FS that collector is going to use (point, line, whatever).

Add a key field to the collector class then pass this value to Survey123 (like you have been doing).

Copy the Survey123 FC you downloaded into the collector gdb.

Create a Relationship class from the Collector FC to the Survey123 FC.

Publish this gdb as a service.

Go into the Survey123 form and set the submission_url to the new HFS you just published.

Republish the form.

Now you can add the collector service to a map and all the relationship classes come along. Now you have your collector features connected to your forms. Forms to lines or polygons or whatever does not matter.

I have this working with 9 forms/9 relationships classes and works great. I can list all the forms for a feature or open a form and backtrack to the feature. Plus if you export the HFS to a GDB all the relationships classes come with it. They also works in ArcMap when connecting to the HFS directly. Oh and you can even see the linked forms in Collector - even other peoples forms!

Also what I did was add a field called XForm and put the item id in that field. Then in the collector map I can use that field to construct the URL. It then launches and prefills in the "Key" field you decided to use. This way you can actually mix and match forms if you want. Say 2017 features link to the 2017 form but the 2018 features link to the 2018 form.

Hope that makes sense and helps you.

Re: Mapping with Survey123 within a polygon or admin unit

Indra_SharanKC — Fri, 28 Sep 2018 08:07:05 GMT

Thank you Doug. I appreciate sharing your approach and the link. I will try this.

Eventually, if ESRI upgrades Survey123 for using an existing web map with it, it would be boon to a large population.

Re: Mapping with Survey123 within a polygon or admin unit

daveostrander — Wed, 16 Jan 2019 19:53:25 GMT

Hi Doug,

I had attempted to do something similar in the spring of 2017, but at the time that effort was met with a bug in Survey123 software that didn't allow using forms as related records. Like you I love the idea of merging map centric (collector) with form centric (Survey123). Now that it seems this workflow is possible I am excited to revisit this once again. Unfortunately, the workflow I was going by still doesn't seem to be working out. In researching that I came upon your workflow, which you seem to have had success with, but I was hoping for some clarification on a few of the steps.

1. Create the form and publish.

2. Download the form feature service as a gdb.

3. Create a new GDB in catalog - this holds your collector features.

4. Add the FS that collector is going to use (point, line, whatever).

Add a key field to the collector class then pass this value to Survey123 (like you have been doing).

5. Copy the Survey123 FC you downloaded into the collector gdb.

6. Create a Relationship class from the Collector FC to the Survey123 FC.

7. Publish this gdb as a service. Do you mean that the Geodatabase need to be published as a Geodata Service?

8. Go into the Survey123 form and set the submission_url to the new HFS you just published. By HFS do you mean set the submission_url to service url of the Geodata Service?

9. Republish the form.

In case you are wondering below are steps for the previous workflow I was using that still hasn't quite worked:

Steps in ArcMap/Catalog:

In a file geodatabase or an enterprise geodatabase, create a new point feature class. Add global ID’s to this feature class
Create a new table in the geodatabase. Add a GUID field.
Create a relationship class between the feature class and the table:
1. Origin table/feature class is the point feature class; Destination is the table
2. Can use a simple relationship or composite relationship
3. Where the labels are specified in the relationship class, it’s important for Survey123 that these have the same name
4. It’s ok to set the messages to “None”
5. 1:M cardinality
6. “No, I do not want to add attributes to this relationship class”
7. The primary key for the origin is the GlobalID, the foreign key for the table is the GUID field
Add FC and Table to ArcMap and publish as a HFS

Steps in Survey123:

Launch Survey123 Connect:
Click New Survey > Click the radio button "Feature Service" > Click the feature service published from the data created in the first part of this document > Create Survey
In Survey123 Connect click the "Settings" button > Inbox > Enable "Inbox mode" > Disable the setting to "Apply a spatial filter when the map view of surveys is visible"
Publish this survey to ArcGIS Online

Steps in AGOL:

Create a web map and add the published HFS to the web map
Configure the popup to use URL Scheming to open Survey123, pass the Global ID field to the GUID field, pass any other parameters as necessary
Save web map
Open in Collector and Done!

Any help would be appreciated. I really want this to work!!!

Re: Mapping with Survey123 within a polygon or admin unit

DougBrowning — Wed, 16 Jan 2019 20:12:12 GMT

Your two questions in Red.

7. No I mean a regular Feature Service. So in ArcMap - Share As Service then check the Feature access box.

8. Use the Feature Service URL from 7 above. Paste this in to the Settings page then give the Form name that matches the name of that layer in the Feature Service. So if you published it as Feature Layer Xname put Xname in the Form name and the URL in the settings tab in Excel to match. Then you just republish so that the URL change is up on the web. Then the original Survey123 service will not be used anymore but the Form Item will be.

I do see errors in the workflow you posted. This part is wrong

""Steps in Survey123:

Launch Survey123 Connect:
Click New Survey > Click the radio button "Feature Service" > Click the feature service published from the data created in the first part of this document > Create Survey
In Survey123 Connect click the "Settings" button > Inbox > Enable "Inbox mode" > Disable the setting to "Apply a spatial filter when the map view of surveys is visible"

Publish this survey to ArcGIS Online""

You do not Create the Survey123 from the FS. You first create it in Survery123, then download and paste, - then create the FS using ArcMap then just point Survey123 to it. Remember you are just repointing Survey123 to a different Hosted Feature Service. Also you are not going to use the Inbox feature. Not sure where this part came from.

So to some up. First you create a new Feature Service from Survey123 like always. Then download this service template gdb and add it to the "master" gdb. Publish this "master" gdb as a totally new Feature Service *using ArcMap. Then point Survey123 form to this new service that ArcMap created. Republish the form so that this repointing is in the Form on the web (but no Feature services will be changed at all in this step - you are only repointing the form).

Also using Gloabal ID can be funky (but I think not anymore). I would use another key.

Hope that helps. You can PM me if you like. I am on furlough and bored so I can help you out if you like.

Re: Mapping with Survey123 within a polygon or admin unit

daveostrander — Wed, 16 Jan 2019 21:48:39 GMT

Doug thanks so much for getting back to me on this!

"Also you are not going to use the Inbox feature. Not sure where this part came from."

That came from Esri support when they were working with me on implementing this setup back in 2017. I will just ignore that step going forward.

"Also using Gloabal ID can be funky (but I think not anymore). I would use another key."

I was using Ismael's blog post "Working with existing Feature Services in Survey123 for ArcGIS" as my reference, which seemed to mandate using GlobalIDs for the keys (see screen shot below of the pre-requisites). I typically use GlobalIDs for all my relationship classes as they are the most unique field type.

Anyway, thanks for the suggestions, and I will be in touch should I get into more trouble with this.

Re: Mapping with Survey123 within a polygon or admin unit

AnthonyJonesRSK — Mon, 18 Feb 2019 14:07:39 GMT

Hi Doug,

Thanks for outlining your methodology on this. I managed to implement this on one of my own jobs and it works brilliantly. It's so good being able to use Collector for the geometry but then have the survey results as a related table in my web app.

I just wanted to know though whether in your examples if your survey123 form contained repeats? On another job I tried this on our form has around 8 repeats so obviously these appear as related tables in my geodatabase once I'd downloaded my initial survey. I can't seem to get these related tables to work once I publish my related Collector and Survey123 data back online. Under the data tab of my layer it lists a number of related tables but the name of the relationships just appear blank. I've included the related tables in my Pro project before uploading but they don't appear to publish properly.

I need to do some more investigation around this but just wondered if you had seen anything similar to this?

Thanks

Anthony

Re: Mapping with Survey123 within a polygon or admin unit

DougBrowning — Mon, 18 Feb 2019 18:54:14 GMT

Mine has 9 forms with almost all of them having repeats. I did notice, as you say, that Survey123 seems to be leaving the To and From labels of the Relationship class blank. It tends to name the RC itself a number also. At least when you download a GDB that is what you see. I have not worried about it much but it does mean the drop downs for the RCs in the attribute table are blank. So it would be nice if this was fixed. You could try adding a label then republish but I am not sure you can change those names after the fact. Everything seems to work ok since it uses numbers internally.

Survey123 - why are these attributes in the Relationship classes being left blank?

Thanks

Re: Mapping with Survey123 within a polygon or admin unit

AnthonyJonesRSK — Wed, 27 Feb 2019 14:17:19 GMT

Thanks for your response Doug. I managed to get this working in the end, not sure what was causing the issue the first time but can see all my relationships now so again thanks for outlining your method it's been really useful.

I attempted to expand on it a bit myself as I tried to build a survey on top of the related table/repeat of another survey. This was because there is a repeat in my survey that may need to be completed at a later date and although I could access it via the Inbox the repeat has attachments so these would not be editable from the inbox. I thought then that if I create a url link to this other survey from my main survey that passes the globalid to the parentglobalid then data could be added to the repeat at a later date, attachments and all. Unfortunately I couldn't find a way to expose the globalid of my underlying feature service of my main survey for use in my url. Do you know if it's possible to include the globalid in any calculations?

Sorry, this may be a question for the wider Survey123 team but you seem to be a man in the know!

Thanks

Anthony

Re: Mapping with Survey123 within a polygon or admin unit

DougBrowning — Wed, 27 Feb 2019 16:03:30 GMT

ParentGlobalID is probably protected or something but I am not sure. You cannot edit an existing record either yet.

You could try to use your own ID fields and then create a second relationship class that ties them together using your ID instead. You can use a calc field in the repeat that adds that ID to each repeat record. I do this a lot so that when you are way down in a repeat you still have that PrimaryKey. That way I never really use globlaid and parentglobalid at all.

For me if a part of a form will be done later I like to make it its own form. That way I have editor tracking, GPS (shows me if they went to the wrong spot), etc. Putting revisits in a repeat is not a good workflow in my opinion - 2 visits should be 2 forms.

Sorry I am not much help on this one.

Re: Mapping with Survey123 within a polygon or admin unit

NaomiBegg2 — Tue, 09 Apr 2019 02:29:48 GMT

Hi Doug

"Go into the Survey123 form and set the submission_url to the new HFS you just published."

Is there any way that this can be done using the online survey builder or must it go through Connect?

Re: Mapping with Survey123 within a polygon or admin unit

DougBrowning — Tue, 09 Apr 2019 13:32:00 GMT

Sorry I have only ever used Connect. I think you can import into Connect though. I looked on the web version and did not see it.

Re: Mapping with Survey123 within a polygon or admin unit

NaomiBegg2 — Tue, 09 Apr 2019 21:18:20 GMT

Hi Doug, I'm still getting confused with this submission url thing.

The below from Survey123 documentation has me completely confused! https://doc.arcgis.com/en/survey123/desktop/create-surveys/survey123withexistingfeatureservices.htm

You need to provide the URL of the feature service item, as seen above. A common mistake is to use the feature service URL instead, which is not supported.

I am getting this error message when I try to publish.

This here is my Feature Service item URL? https://services7.arcgis.com/S7DHOirgbYgdtrbR/arcgis/rest/services/survey123_536269680eb04998a5baf980af0623a1/FeatureServer/0?token=omdRAkgx4DeownL9nu0hTRXDJLLEMGejfUdxcQafevLPVy0MgqWJzIVtwGu-vFyu3-4mViABkGvPDZWKbC3thwPG-qcmmV3nA6xdrMMe6YGYb7gOo2PB0Ll7jETMjnH8FuYVRrTpJ3OaacHTR3JxQaslRa_vp65uiSvDcDIrjUav7pNTsdi8lMGYj0C1OHhgZ6Smci0Srx8A272j-hwl-s3ocAbLSwazUXUKVZdJYDcB89YtAiK1_fo9qRDyjZtJ

Re: Mapping with Survey123 within a polygon or admin unit

DougBrowning — Tue, 09 Apr 2019 21:39:07 GMT

You should not have the /0 in there. Just end with FeatureServer. Also no token at the end of course.

So this

https://services7.arcgis.com/S7DHOirgbYgdtrbR/arcgis/rest/services/survey123_536269680eb04998a5baf980af0623a1/FeatureServer

Then you set form_id (also in settings) which is used to find the right layer instead of the /0. So your /0 layer is called surveyPoint. Put that in form_id.

On another not you have some crazy long field names. I would watch that, could get you.