topic Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON? in ArcGIS Online Questions

How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

BenoitMetzger — Tue, 26 Mar 2013 02:06:00 GMT

Hi All,

I would like to automate publishing feature services - from an mxd using Python to my AG Online account.

I did this successfully manually using the menu: Share as -> Service, Publish a service - Feature Access Capabilities etc...

Using Python, I managed to publish the service definition file on AG Online using:
arcpy.mapping.CreateMapSDDraft()
arcpy.mapping.AnalyzeForSD()
arcpy.StageService_server()
arcpy.UploadServiceDefinition_server()

But I could not find a way to publish a feature service to AG Online! I must be missing something. Any help would be really appreciated.

Thanks in advance!

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

JeffMoulds — Fri, 29 Mar 2013 20:51:20 GMT

The following code will publish a hosted feature service. Change the following:

- Line 5, the workspace
- Line 11, the name you want to give the service
- Line 58, the username and password to your AGO account

import arcpy import xml.dom.minidom as DOM  import os  workspace = 'C:/Temp/hosted publishing/'  # Reference map document for CreateSDDraft function. mapDoc = arcpy.mapping.MapDocument(r'C:\Temp\betty4.mxd') # Create service and sddraft variables for CreateSDDraft function. sddraft = workspace + 'HostedMS.sddraft' service = 'FeatureService' arcpy.mapping.CreateMapSDDraft(mapDoc, sddraft, service, 'MY_HOSTED_SERVICES', summary="test", tags='test') con = 'My Hosted Services' sd = workspace + service + '.sd'  doc = DOM.parse(sddraft)  # Read the sddraft xml. doc = DOM.parse(sddraft) # Change service from map service to feature service typeNames = doc.getElementsByTagName('TypeName') for typeName in typeNames:     # Get the TypeName we want to disable.     if typeName.firstChild.data == "MapServer":      typeName.firstChild.data = "FeatureServer"  #Turn off caching configProps = doc.getElementsByTagName('ConfigurationProperties')[0] propArray = configProps.firstChild propSets = propArray.childNodes for propSet in propSets:     keyValues = propSet.childNodes     for keyValue in keyValues:         if keyValue.tagName == 'Key':             if keyValue.firstChild.data == "isCached":                 # turn on caching                 keyValue.nextSibling.firstChild.data = "false"  #Turn on feature access capabilities configProps = doc.getElementsByTagName('Info')[0] propArray = configProps.firstChild propSets = propArray.childNodes for propSet in propSets:     keyValues = propSet.childNodes     for keyValue in keyValues:         if keyValue.tagName == 'Key':             if keyValue.firstChild.data == "WebCapabilities":                 # turn on caching                 keyValue.nextSibling.firstChild.data = "Query,Create,Update,Delete,Uploads,Editing"  outXml = workspace + 'HostedMSNew.sddraft'  f = open(outXml, 'w')      doc.writexml( f )      f.close() analysis = arcpy.mapping.AnalyzeForSD(outXml) #print analysis #arcpy.SignOutFromPortal_server() arcpy.SignInToPortal_server("username","password","http://www.arcgis.com/") arcpy.StageService_server(outXml, sd) arcpy.UploadServiceDefinition_server(sd, con)

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

MaryEllen_Perko — Wed, 03 Apr 2013 20:18:54 GMT

This worked great for me! You saved me a bunch of time. Thanks.

Now, I'm just wondering if anyone knows how to set the sharing during publishing using python. I can see references to it in the documentation for UploadServiceDefinition_server, but I cannot figure out the syntax when it is the only optional setting you need. And, does it work in AGOL?

Thanks,
Mary Ellen

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

BenoitMetzger — Thu, 04 Apr 2013 23:28:42 GMT

Hi Jeff,

thanks for your help, I will give that a go... but from what i read it seems to be working 🙂

Mary Helen, not too sure if thsi is what you want... here is a line i wrote which worked a little while ago (it was sharing the service on AGOL from memory):
arcpy.UploadServiceDefinition_server("C:\\...", "My Hosted Services", '', '', "NEW", "folder", "STARTED","OVERRIDE_DEFINITION", "SHARE_ONLINE","PRIVATE", "NO_SHARE_ORGANIZATION", "")

Cheers.

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KaushalShah — Thu, 11 Apr 2013 13:36:16 GMT

Hi, I have manually created/published the ArcGIS online feature service from arcmap as a one time activity.
The data in the mxd will keep on changing and I have updated the data in the mxd.
Since the data is changing, each time I will have to update the already published feature service. Manually we can publishing the service and select overwrite existing service. The same I want to automatize through python script.

As the script for creating new feature service and also sharing the feature service was provided in the thread, can you please urgently help me by providing the python script for updating the data of the existing feature service. We do not have to change service definition of the already published feature service.

Urgent help would be appreciated.

Thanks and regards,
Kaushal Shah.

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KevinHibma — Sat, 11 Dec 2021 07:20:23 GMT

Add the following 2 pieces into Jeff's code and it'll allow you to use UploadService (after staging of course) on an existing service (because it overwrites the service).

typeReplace = 'esriServiceDefinitionType_Replacement'
statePublished = 'esriSDState_Published'
           
myTagsType = doc.getElementsByTagName('Type')
for myTagType in myTagsType:
    if myTagType.parentNode.tagName == 'SVCManifest':
        if myTagType.hasChildNodes():
            myTagType.firstChild.data = typeReplace

myTagsState = doc.getElementsByTagName('State')
for myTagState in myTagsState:
    if myTagState.parentNode.tagName == 'SVCManifest':
        if myTagState.hasChildNodes():
            myTagState.firstChild.data = statePublished

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KaushalShah — Mon, 22 Apr 2013 12:20:40 GMT

Thanks a ton for the help. This helped me overwrite the existing feature service without deleting it manually. I am saved.

But here I believe that we had to add the new part of the code that you provided BEFORE the staging of the service definition and not after the line arcpy.StageService_server(outXml, sd). You mentioned otherwise. So the new code comes before the "outXml = workspace + 'HostedMSNew.sddraft' of the main code.

Can you also help me provide an insight on the map service being overwritten. If we have already created the Map using the original feature service, and then overwrite the existing feature service, will the previous maps work with the same shared url. Hope I am clear in my requirement.

Lots of Regards,
Kaushal Shah.

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

TiagoRibeiro — Sat, 11 Dec 2021 07:20:26 GMT

I've been following this thread, which has helped me a lot, so let me start with a big THANK YOU! I already have a script that updates my feature service but... this needs the desktop installed to run right?
For example: If you publish this as gp task on ArcGIS for Server the upload part will throw this error:

ExecuteError: Failed to execute. Parameters are not valid.
ERROR 000732: Server: Dataset My Hosted Services does not exist or is not supported
Failed to execute (UploadServiceDefinition).

Is there a way around this or the way is to have ArcGIS For Desktop installed, and the "ArcGISConnection.exe" process running?

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KevinHibma — Mon, 22 Apr 2013 14:24:57 GMT

Kaushal Shah:
Right, the code is to modify the XML, thus it must go before stage.
As long as the service name doesn't change, the link should remain the same. The hosted service account id is a set of letters and numbers which to the best of my knowledge doesnt change. So to the best of my knowledge, it should be ok.

tribeiro:
You've made a GP Service to perform this publishing routine?
I'd strongly recommend against that. The Upload and Stage tools (which are required in this workflow) are not designed to be re-published in your own geoprocessing service. I'd suggest making it a scheduled task on one of your desktop machines.

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

TiagoRibeiro — Mon, 22 Apr 2013 14:31:33 GMT

tribeiro:
You've made a GP Service to perform this publishing routine?
I'd strongly recommend against that. The Upload and Stage tools (which are required in this workflow) are not designed to be re-published in your own geoprocessing service. I'd suggest making it a scheduled task on one of your desktop machines.

Thanks for the reply Kevin, that's what I thought, and the scheduled task approach was (and now will be) my next step.
Any plans of making those tools, Upload and Stage, available through geoprocessing services in the future?

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KevinHibma — Mon, 22 Apr 2013 15:06:09 GMT

Not in 10.2, and no plans to the best of my knowledge after that.
What these tools do, and how they work is not conducive to being used in a service. I'd say at best they would act like a scheduled task that could be modified slightly at execution time.
I say this as the server will most likely have to have the MXD + Data you want to publish. It would be a pretty involved service to that gets both the MXD and all required data from the client, extracts it somehow, and then publishes. So I'm making the assumption your server already has the data/mxds on it. If thats the case, setting it up as a scheduled task would probably be more straight forward.
I'm not saying these as a service cant be done - I'm just saying its something that we haven't tested and I could imagine a few areas which will be difficult to overcome. As such, I'd take the "easier" approach of just making a scheduled task.

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KevinHibma — Tue, 23 Apr 2013 15:29:17 GMT

Just for anyone else who comes upon this thread...
Jeff and I posted a blog with the python script to:
-CreateMapSDDraft, Analyze, Stage and Upload for map documents to be pushed to ArcGIS.com as a hosted feature service /w overwrite and shared to arcgis.com turned on.

http://blogs.esri.com/esri/arcgis/2013/04/23/updating-arcgis-com-hosted-feature-services-with-python/

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

ErikEndrulat — Mon, 09 Sep 2013 21:57:19 GMT

I've attempted to use this sample and am able to successfully update feature services with 10.1, but not with 10.2. I'm encountering the following error:

ExecuteError: Failed to execute. Parameters are not valid.
ERROR 000732: Server: Dataset My Hosted Services does not exist or is not supported
WARNING 001404: You are not signed in to ArcGIS Online.
Failed to execute (UploadServiceDefinition).

[ATTACH=CONFIG]27306[/ATTACH]

This appears to be an issue with the arcpy SignInToPortal function. I'm able to publish/overwrite the service with 10.2 only when I comment out the SignInToPortal line and sign in separately using ArcGIS Desktop. Is anyone else having this problem with ArcGIS 10.2? Are there any workarounds?

Thanks,
Erik

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

DanikBourdeau2 — Tue, 10 Sep 2013 00:26:06 GMT

I'm able to publish/overwrite the service with 10.2 only when I comment out the SignInToPortal line and sign in separately using ArcGIS Desktop. Is anyone else having this problem with ArcGIS 10.2? Are there any workarounds?

Thanks,
Erik

Since 10.2, this is how I have had to publish/overwrite services as well. Not that big of a deal but I do wish that somewhere it would have been stated that SignInToPortal doesn't work like it used to.

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KevinHibma — Tue, 10 Sep 2013 14:19:24 GMT

Danik, Erik,

With the 10.2 release, the authentication method for Portal has changed, as such the SignIntoPortal tool is no longer necessary.

We're currently investigating why the tool is causing these sorts of issues. (It should have just passed through the tool with a warning message indicating you need to Sign In from the ArcMap menu)

To get around the issue for now:

Dont use the SignIn tool in your script/workflows

Any machine you want to run this script from, must first open ArcMap, and use File > Sign In with the automatic option checked

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

ErikEndrulat — Tue, 10 Sep 2013 15:22:27 GMT

Kevin,

Great, thanks for weighing in on the changes in 10.2 regarding the SignIn function.

Do you have a recommended workflow to update feature services using a scheduled task when a user isn't logged into the machine. Is that no longer possible?

Thanks much,
Erik

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

KevinHibma — Tue, 10 Sep 2013 15:34:15 GMT

From the previous testing I've done, the following should do what you want:

Log on to the machine, open ArcMap, and sign in (make note of the account you logged into Windows with)

Make sure you've checked the automatic sign in on the Portal sign in box.

Create your scheduled task (it must run under the same windows user account from above)

The key here is to log in once, have it be remembered, then have the task run under the user account which had logged in previously.

Of course, make sure the SignInToPortal tool has been commented out.
If I get time later this afternoon I'll give this another go.

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

ErikEndrulat — Thu, 12 Sep 2013 15:09:47 GMT

I tried the approach you suggested but was unable to successfully publish the service as a scheduled task (or manually while not logged in through Desktop). I'm very interested in any other suggestions you or other folks may have that would enable running the update FS as a scheduled task.

Thanks!
Erik

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

JeffMoulds — Mon, 16 Sep 2013 17:54:33 GMT

Erik,

Are you getting an error when running the python script? Or are you having a problem creating a scheduled task?

Re: How to publish a feature service to ArcGIS Online from an mxd USING PYTHON?

ErikEndrulat — Mon, 16 Sep 2013 17:57:23 GMT

I get the error when running the python script, and the scheduled task fails (presumably from the same error but I haven't logged the errors yet).