Latest Contributions by DougBrowning

Try using ArcRest.  It gives you a full replica copy locally in a GDB including attachments.  It has been working great for me until I hit 33,000+ records.  I have a ticket open on it. I assume it will do tables also but not sure. Download ArcREST and install it.  Then here is the simple code. Python code from arcrest.security import AGOLTokenSecurityHandler from arcrest.agol import FeatureService from arcrest.common.filters import LayerDefinitionFilter import arcpy import datetime # Set these based on your FS and credentials username = "" password = "" url = "http://services2.arcgis.com/as3H1x8rqlUMyL6s/ArcGIS/rest/services/ETC..." outDir = r"C:\temp" #Get a local replica of the HFS  note set layers properly proxy_port = None proxy_url = None #_defaultTokenExpiration = 60 #Minutes agolSH = AGOLTokenSecurityHandler(username=username,password=password) fs = FeatureService(url=url,securityHandler=agolSH,proxy_port=proxy_port,proxy_url=proxy_url,initialize=True) result = fs.createReplica(replicaName='Demo', layers='0,1,2,3,4', keep_replica=False, layerQueries=None, geometryFilter=None, returnAttachments=True,returnAttachmentDatabyURL=False,returnAsFeatureClass=True, out_path=outDir) ... View more

I am pretty sure it is JSON being returned since 1.  I have ran this script 20+ times just fine when there were less records. 2.  I can take some of the layers out and it works fine.  It crashes between 33,517 and 34,178 records.  3.  I can also download any layer by itself with no issues so not a data issue. This does have definition queries in it which I noticed split the data into different layers when publishing to AGO then combines then back together when bringing down a replica.  Not sure if that matters but wanted to mention it. I also am not sure it is a timeout issue as it does not take very long to do all but one of the layers (which is just 661 records).  I can do any combination of layers 0-4 just not all of them at once.  If I go into AGO and ask for a JSON file the file I get is 66 MB.  Seems high since there are only 5 fields in each layer. Thanks a lot ... View more

You must be looking at the other guys code.  Mine is this. from arcrest.security import AGOLTokenSecurityHandler from arcrest.agol import FeatureService from arcrest.common.filters import LayerDefinitionFilter #Get a local replica of the HFS proxy_port = None proxy_url = None agolSH = AGOLTokenSecurityHandler(username=username,password=password) fs = FeatureService(url=url,securityHandler=agolSH,proxy_port=proxy_port,proxy_url=proxy_url,initialize=True) result = fs.createReplica(replicaName='Demo', layers='0,1,2,3', keep_replica=False, layerQueries=None, geometryFilter=None, returnAttachments=True,returnAttachmentDatabyURL=False,returnAsFeatureClass=True, out_path=outDir) ... View more

Thanks but where do I put this?  No idea where to add that. Opps thought this was from REST.  Here is the code where do I add that? #Get a local replica of the HFS proxy_port = None proxy_url = None agolSH = AGOLTokenSecurityHandler(username=username,password=password) fs = FeatureService(url=url,securityHandler=agolSH,proxy_port=proxy_port,proxy_url=proxy_url,initialize=True) result = fs.createReplica(replicaName='Demo', layers='0,1,2,3', keep_replica=False, layerQueries=None, geometryFilter=None, returnAttachments=True,returnAttachmentDatabyURL=False,returnAsFeatureClass=True, out_path=outDir) ... View more

I have the same issue.  At 10,000 features it worked great.  Not at 32,000 and it dies with the same error as you. ... View more

I do not see my question on here.  Will there ever be a way to export to a PDF that looks like a form.  This is a forms based app but there is no way to get a traditional looking form out.  With no way to send a copy of a form that was just signed via email is a huge stopper for us.  Every other forms solution out there has this.  Please consider it. ... View more

The issue is the extent of the cache is wrong in the xml - way bigger than the extent of the actual data.  So say you had one image in Oregon, Texas, and New York.  You set the AOI so that only tiles are built in those 3 areas not the entire country.  But the tool sets the extent of the whole country anyway.  Then when AGO sees the extent it guesses the number of tiles to be massive. Same basic thing with the export tool. The extents are not set correctly in the xml which causes all kinds of problems. In my case I am using the tools in ArcMap.  Not the server tools and not having AGO build the tiles.  I build the tpk then upload it. ... View more

Can multiple forms use the same external choices sheet?  If so can I then update itemsets.csv in AGO and the new choices are available to all the forms? thanks ... View more

Thanks. I do not necessarily think the number of tiles is wrong since this is high res imagery.  But what I can not understand is why it goes from 8 GB to 1 PB. ... View more

Do you use the rest to get around the feature return limit?  That seems to be an issue with using the layer file - it will only return the first X records as set in the service. The create replica script worked great. The query script gave me this error C:\Python27\ArcGIS10.2\lib\site-packages\requests\packages\urllib3\util\ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.   InsecurePlatformWarning C:\Python27\ArcGIS10.2\lib\site-packages\requests\packages\urllib3\util\ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.   InsecurePlatformWarning initialExtent  - attribute not implmented in Feature Layer. spatialReference  - attribute not implmented in Feature Layer. size  - attribute not implmented in Feature Layer. layers  - attribute not implmented in Feature Layer. tables  - attribute not implmented in Feature Layer. syncCapabilities  - attribute not implmented in Feature Layer. units  - attribute not implmented in Feature Layer. xssPreventionInfo  - attribute not implmented in Feature Layer. hasVersionedData  - attribute not implmented in Feature Layer. fullExtent  - attribute not implmented in Feature Layer. serviceDescription  - attribute not implmented in Feature Layer. editorTrackingInfo  - attribute not implmented in Feature Layer. supportsDisconnectedEditing  - attribute not implmented in Feature Layer. syncEnabled  - attribute not implmented in Feature Layer. Traceback (most recent call last):   File "<module1>", line 21, in <module>   File "C:\Python27\ArcGIS10.2\lib\site-packages\arcrest\agol\layer.py", line 740, in query     return FeatureSet.fromJSON(json.dumps(results))   File "C:\Python27\ArcGIS10.2\lib\site-packages\arcrest\common\general.py", line 590, in fromJSON     for feat in jd['features']: KeyError: 'features' Also is there any docs on any of this.  There are many options in the Create Replica but nothing on what they mean.  I was wondering if I could get a locals copy that will show as a replica and then I can sync back and forth with it.  It seems like you can get a copy locally or keep the replica around but not both. All i can find is the comments in the code                replicaName - string of replica name                layers - layer id # as comma seperated string                keep_replica - if the replica does not have returnAsFeatureClass set to true,                               the feature service creates a permanent copy of the replica.                               If this is just a pull, then erase the replica in order to prevent                               build up of replicas.                layerQueries - In addition to the layers and geometry parameters, the layerQueries                               parameter can be used to further define what is replicated. This                               parameter allows you to set properties on a per layer or per table                               basis. Only the properties for the layers and tables that you want                               changed from the default are required.                                 Example:                                   layerQueries = {"0":{"queryOption": "useFilter", "useGeometry": true,                                                  "where": "requires_inspection = Yes"}}                geometryFilter - Geospatial filter applied to the replica to parse down data output.                returnAttachments - If true, attachments are added to the replica and returned in the                                    response. Otherwise, attachments are not included.                returnAttachmentDatabyURL -  If true, a reference to a URL will be provided for each                                             attachment returned from createReplica. Otherwise,                                             attachments are embedded in the response.                returnAsFeatureClass - If a local copy is desired, set this parameter to True, else                                       the service will return information on how to download the                                       json file.                out_path - Path where the FGDB will be saved.  Only used with returnAsFeatureClass is                           True. thanks ... View more

I now have it working in a toolbox run from within ArcMap.  Turns out my lyr file went bad somehow. Would still like any input on stand alone though. ... View more

Do you turn on edit tracking after you publish (in AGO) or before (in ArcMap)?  It creates totally different fields (for some reason) depending on when you do it. I have had luck turning on editor tracking first in ArcMap then publishing. ... View more