topic Re: Store Survey 123 Table in local SDE in ArcGIS Survey123 Questions

Store Survey 123 Table in local SDE

jaykapalczynski — Wed, 02 Nov 2016 20:39:54 GMT

I created a collection in Survey 123 but when it publishes it stores the table and attachements in ArcGIS Online. This is not much of an issues other than the fact that I need to Join this table to data that is on my local SDE environment. I cant seem to figure that part out.

Can I create a Relationship Class to a table created from Survey 123 that resides in ArcGIS online to a local Feature Class in my local servers SDE.
Can I move the location of the table and Attachments created by Survey123 to my local SDE Server?
1. Is there some sort of setting that forces the creation of tables etc to my server not ArcGIS Online?
2. Set a workspace to my server instead of ArcGIS online????
Can I create a Relationship class in ArcGIS online that relates the table created in Survey123 (located in AGO) to a feature class on my local server?

Re: Store Survey 123 Table in local SDE

JamesTedrick — Wed, 02 Nov 2016 21:40:05 GMT

Hi Jay,

Relationship classes can only be created between tables and feature classes within the same geodatabase.

In terms of migrating your Survey123 data to an enterprise geodatabase, we're just finishing up a blog post describing it; in the meantime, you could try out a sample script designed to synchronize the data - GitHub - tedrick/SyncSurvey: Synchronize a Hosted Featuer Service to an Enterprise Geodatabase (it's not foolproof; another user was having some issues that I had trouble replicating).

In terms of the survey going directly to your own ArcGIS Server service, it's a planned expansion of the the submission_url property of the survey - Submission URL—Survey123 for ArcGIS | ArcGIS . Currently submission_url only supports other hosted services, whether using Portal or ArcGIS Online.

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Thu, 03 Nov 2016 14:41:51 GMT

First off thanks fro the response...Much Appreciated.

So if I get you right....Synchronize the data portion of you response. I would have a second copy of the Survey123 FS on my EGDB and simply sync the two. When Survey123 updates the copy on my EGDB would update as well.

Is that what you are getting at?

EDIT: I haven't checked but does this sync Attachments as well....I have a bunch of images attached to each record in Survey123 FC

Re: Store Survey 123 Table in local SDE

JamesTedrick — Thu, 03 Nov 2016 15:27:25 GMT

The synchronization script downloads the data in the Survey123 Feature Service and then creates/updates a set of tables in the EGDB. It maintains relationships and attachments.

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Thu, 03 Nov 2016 15:48:46 GMT

OK thanks...gonna give that a try.

I assume that I have to create a scheduled Task every few hours to run the script?

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 15:40:01 GMT

Question:

Where and how do I specify the exact folder in AGO that the feature class resides?

I see the get Token getToken(username, password=None, portal_URL = 'https://www.arcgis.com'

but dont see where I am grabbing the specific workspace (folder) in AGO that was created by Survey123

Re: Store Survey 123 Table in local SDE

JamesTedrick — Fri, 04 Nov 2016 15:47:12 GMT

You can get a list of folders at the user content REST endpoint ArcGIS REST API and do a match on the Survey name to the folder's id. This is for auto-scanning a user's content to discover survey feature services?

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 16:00:17 GMT

So I can run the script as is and it will find all the Survey123 projects in AGO?

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 16:01:03 GMT

Where do I specify my Server/instance?

Re: Store Survey 123 Table in local SDE

JamesTedrick — Fri, 04 Nov 2016 16:02:51 GMT

No, I thought you were modifying the script. The script itself takes the service endpoint as input.

Re: Store Survey 123 Table in local SDE

JamesTedrick — Fri, 04 Nov 2016 16:10:09 GMT

The 'Hosted Feature Service' is where you enter the service endpoint.

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 16:29:19 GMT

trying to run script...I get

>>> ================================ RESTART ================================
>>>

Traceback (most recent call last):
File "C:\Users\tjv35563\Desktop\PythonSync\pytz.py", line 10, in <module>
import pytz, sys, os, os.path
File "C:\Users\tjv35563\Desktop\PythonSync\pytz.py", line 36, in <module>
version=pytz.VERSION,
AttributeError: 'module' object has no attribute 'VERSION'

Trying to install pytz and error out on the line version=pytz.VERSION

setup (
name='pytz',
version=pytz.VERSION,
zip_safe=True,

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 16:41:07 GMT

I much not have things setup properly....very confused.

Re: Store Survey 123 Table in local SDE

JamesTedrick — Fri, 04 Nov 2016 16:56:54 GMT

What version of ArcMap do you have? pytz is included with 10.4.

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 16:58:29 GMT

10.3...I guess I could upgrade

EDIT: I will upgrade and try again

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 18:21:15 GMT

I upgraded to 10.4. Getting this error...

What are the key areas of the Python Script that I have to modify...still confused on that...

>>> ================================ RESTART ================================
>>>

Traceback (most recent call last):
File "C:\Users\tjv36463\Desktop\PythonSync\SyncBoatRamps.py", line 578, in <module>
main()
File "C:\Users\tjv36463\Desktop\PythonSync\SyncBoatRamps.py", line 572, in main
process(sde_conn, prefix, featureService, timezone, portal, username, password)
File "C:\Users\tjv36463\Desktop\PythonSync\SyncBoatRamps.py", line 514, in process
now = getUTCTimestamp(timezone)
File "C:\Users\tjv36463\Desktop\PythonSync\SyncBoatRamps.py", line 47, in getUTCTimestamp
timeZone = pytz.timezone(timezone)
File "C:\Python27\ArcGISx6410.4\lib\site-packages\pytz\__init__.py", line 180, in timezone
raise UnknownTimeZoneError(zone)
UnknownTimeZoneError: ''

Re: Store Survey 123 Table in local SDE

JamesTedrick — Fri, 04 Nov 2016 18:25:31 GMT

Can you provide the original input parameters? It doesn't look like your time zone was specified - that's used in the synchronization process since times are stored in UTC in ArcGIS Online (it's used it to determine which features have already been synchronized)

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 18:35:18 GMT

Hey James thanks....I think this is where I am getting confused...All I have it the downloaded python script. I am confused where to set the input parameters etc. Do I need to run this from a specific location/on a specific server?

The only thing I modified at this point was the TOKEN info in the script

def getToken(vxxxx, password='Dxxxxxx1n', portal_URL = 'https://www.arcgis.com'):
'''Gets a token from ArcGIS Online/Portal with the given username/password'''
arcpy.AddMessage('\t-Getting Token')
if password == None:
password = getpass.getpass()

Re: Store Survey 123 Table in local SDE

JamesTedrick — Fri, 04 Nov 2016 18:46:16 GMT

Ah. There are a couple of ways to proceed.

The script's current form is designed to be used as a geoprocessing tool (the toolbox in the repo has the script embedded)

The python script's syntax is

syncSurvey.py <SDE Connection File> <table prefix text> <Feature Service URL> <time zone> <portal url> <username> <password>

If you wanted to hard code these values into the script, you could do so at the bottom of the script, in the main() function.

A somewhat better alternative is to create a config text file (looks at the tests template.txt) and then modify main() to be:

test(<config name>)

and then alter the test function with appropriate directory and file name for your config file.

You shouldn't have to modify the getToken function.

Re: Store Survey 123 Table in local SDE

jaykapalczynski — Fri, 04 Nov 2016 18:50:30 GMT

OK that makes sense now...I will try and setup as a GP Tool for now and see if I can get it to work...thanks for your patience.