topic Re: Manual Sync with Database using SQLite database from ArcGIS Collector in ArcGIS Collector Questions

Manual Sync with Database using SQLite database from ArcGIS Collector

BrianHiller — Wed, 28 May 2014 16:45:52 GMT

We are using the ArcGIS Collector on an iPad Air to edit existing features and add new features while disconnected. The application collects the data fine, but we are having issues trying to synchronize with an ArcGIS Server 10.2.2 feature service.

Is it possible to use the file sharing capability through iTunes to copy the the SQLite database off of the iPad and manually synchronize the database with ArcGIS Server and the ArcSDE geodatabase?

Brian

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

RussRoberts — Sat, 11 Dec 2021 09:45:04 GMT

Here is the python script..watch out for any white spaces that may be generated when copying and pasting..onnce the KB article is released I will point to that support page.

First copy the .geodatabase file to your computer. You can get to the .geodatabase file under the ArcGIS_Collector folder > offline data > folder with user account name associated with downloaded data > folder with the webmap id > copy the .geodatabase and you paste it onto your computer.

def main(argv):
   input_gdb = 'Enter .geodatabase location'
   output_gdb = 'Enter in an existing fgdb location you want data to be exported into'
   try:
      opts, args = getopt.getopt(argv,"hi:o:",["ifile=","ofile="])
   except getopt.GetoptError:
      print 'test.py -i <input_gdb> -o <input_gdb>'
      sys.exit(2)
   for opt, arg in opts:
      if opt == '-h':
         print 'test.py -i <input_gdb> -o <output_gdb>'
         sys.exit()
      elif opt in ("-i", "--ifile"):
         input_gdb = arg
      elif opt in ("-o", "--ofile"):
         output_gdb = arg
   print 'Input gdb is: "', input_gdb
   print 'Output gdb is: "', output_gdb

   Temp_xml = "temp.xml"

   # Delete the xml workspace document if it exists.
   arcpy.Delete_management(Temp_xml)

   # Export XML Workspace Document
   arcpy.ExportXMLWorkspaceDocument_management(input_gdb, Temp_xml, "DATA", "BINARY", "METADATA")

   # Import XML Workspace Document. This assumes that the outputfile geodatabase is EMPTY.
   arcpy.ImportXMLWorkspaceDocument_management(output_gdb, Temp_xml, "DATA", "")

   # Delete the xml workspace document if it exists.
   arcpy.Delete_management(Temp_xml)

if __name__ == "__main__":
   main(sys.argv[1:])

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

RandyWeaver — Tue, 11 Nov 2014 22:10:42 GMT

Russell,

Can you please elaborate on the python script your wrote in response to this topic from Brian? I have the same issue with an offline geodatabase but cannot seem to get the python script to do anything. There are not any coding or syntax errors that I can see when comparing it to yours listed. Is this run from within Desktop, from within IDLE or just as a stand-alone file.

Thanks,

Randy Weaver

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

Anonymous User — Tue, 31 Mar 2015 22:07:43 GMT

Randy: if you add the modules to the beginning, this will run as a standalone script. Add this to the top of the script: import sys, getopt, arcpy

Russell: the result of this script is delta tables, not actual data. I expected to see the actual data. Is there a recommended workflow for using these tables to get the ArcGIS Server/iPad data to synchronize back to the parent database?

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

MichaelDavis3 — Tue, 31 Mar 2015 22:37:36 GMT

ArcGIS 10.3 has a toolbox tool to convert the SQLite .geodatabase file to a FGDB. Once converted you can add the data to your SDE however you choose. It's a manual sync, but better than no sync at all.

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

Anonymous User — Tue, 31 Mar 2015 22:47:27 GMT

Thanks for the tip, but I must still be missing something. Running that tool (runtime to fgdb) still results in delta tables, not the actual data. The result is identical to the output of Russell's script, so I still have the same question.

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

MichaelDavis3 — Wed, 01 Apr 2015 01:27:26 GMT

Strange - every time I've used it the tool produces a geodatabase, and it takes care of merging all the delta tables together.

Is it possible that your SQLite database was modified after you pulled it from the mobile device?

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

RandyWeaver — Wed, 01 Apr 2015 02:58:33 GMT

Thanks Marianne, the script ended up working like you had mentioned. I did not however have the issue that you are currently having.

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

Anonymous User — Wed, 01 Apr 2015 04:00:30 GMT

Well... I'm not doing exactly what is prescribed here. Our IT does not allow iTunes (but they do issue everyone iPads...). So, what I'm doing is pulling the sqlite off of the ArcGIS Server. I was hoping, since the iPad reported a successful sync, that I might find data there. But I didn't, just the tables I referenced above.

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

MichaelDavis3 — Wed, 01 Apr 2015 04:41:22 GMT

Yeah - that's your problem.

You need to tell your IT department to get over their hang up with iTunes. Pulling the geodatabase off the iPad with iTunes is the ONLY way to recover the data so you can convert it and sync.

Before we started using iOS runtime apps iTunes was a no-go with our IT folks as well... But eventually even they have to wake up to progress.

- Mike

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

AhjungKim4 — Tue, 15 Sep 2015 19:41:56 GMT

Is there a way to manually sync offline data collection to a hosted feature class?

My client successfully tested syncing his offline data collection, so he went out and used Collector for a real inspection. But the real inspection would not sync(tried connecting to different network for faster Internet connection), so I ended up getting his SQLite database from his iPad, and appending it to the original SDE geodatabase that was used to publish the hosted feature class and then re-published feature service to AGOL. It was very time-consuming since the data contained GlobalID fields, which are assigned with new ID values when you append/load data. This broke relationships formed off the GlobalIDs that was originally assigned to it, such as related tables and attachments.

I am wondering if there's a way I can sync replicas using REST API (ArcGIS REST API ) and the SQLite file.

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

MichaelDavis3 — Tue, 15 Sep 2015 20:01:38 GMT

Not really - and trying to "sync" the database from the device can be a bit of a pain, especially if there are edits to existing data and you need to figure out what changed and what didn't.

There is a shortcut you can take that might help though. When you sync, ArcServer saves a copy of the data that the device transmits to a folder like this:

\\servername\ArcGISServer\directories\arcgissystem\arcgisuploads\services\servicename\

In there you will find a folder containing a sqlite geodatabase with the diff data (adds/deletes/edits) for your feature service. If you grab these files and convert them to a file geodatabase you can take care of adding/replacing/deleting features in an ArcMap session.

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

FrankPotempa — Mon, 05 Oct 2015 14:25:30 GMT

Hi Russel, does this script work in ArcGIS Desktop 10.1? My field clients will only have that version whereas in house we use 10.2+.

thankx

Frank

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

RussRoberts — Mon, 05 Oct 2015 15:54:44 GMT

The main issue with that script is that any edited features will not come through and could cause errors either in the script or the output in the resulting gdb. The script really only works well when new features have been added. I would really recommend if you can use the 10.3 tool that will migrate the data over into a fgdb.

Re: Manual Sync with Database using SQLite database from ArcGIS Collector

FrankPotempa — Mon, 05 Oct 2015 16:35:01 GMT

Thanks Russell thanks for the information. I would prefer to have clients use 10.3 as well. My constraint unfortunately is that my field clients only have access to 10.1 Basic and I'm trying to utilize the script at that version. My field clients don't have internet access in their locations for days sometimes weeks. Without internet the ability to sync from Collector or even email the .geodatabase file to in house staff is limited. So finding an alternative for the field user to get the data into ArcMAP 10.1 would be beneficial. Any other suggestions?