topic Re: Upgraded to 10.5, can no longer publish services... in ArcGIS Enterprise Questions

Upgraded to 10.5, can no longer publish services...

MarkLittell — Wed, 22 Feb 2017 20:25:29 GMT

Upgraded from 10.4.1 to 10.5

I applied the 10.5 publishing patch

Copied the the st_geometry.so and libst_raster_pg.so from Desktop to the Linux server running the PostgreSQL 9.3

When I try to publish a new or update an existing service ArcMap returns the following error message:

Packaging succeeded, but publishing failed.

ERROR 001487: Failed to update the published service with the server-side data location. Please see the server's log for more details.

Please consult the GP Results Window for enhanced error description or contact your administrator for the server logs.

The Server Logs read:

Error executing tool. PublishServiceDefinition Job ID: j868d0fe80d114806ab528cf36ac3fe7f : ERROR 001487: Failed to update the published service with the server-side data location. Please see the server's log for more details. ERROR 001369: Failed to create the service. Failed to execute (Publish Service Definition).	System/PublishingTools.GPServer
Failed to create the service.: Updating the server connection string for layer Shelters - County failed. Attempted connection string was ENCRYPTED_PASSWORD=<snip>;SERVER=1XX.XXX.XXX.175;INSTANCE="DSID=<snip>";DBCLIENT=postgresql;DB_CONNECTION_PROPERTIES=1XX.XXX.XXX.175;DATABASE=sde;USER=sde;VERSION=sde.DEFAULT;AUTHENTICATION_MODE=DBMS. Table name is sde.sde.MyFeatureClass. Please verify the data exists on the server.	System/PublishingTools.GPServer
Failed to rename cache folder.	MyFolder/MyService _201702221422.MapServer
DoAfterSDExtraction failed.	System/PublishingTools.GPServer
SwizzleService failed.	System/PublishingTools.GPServer
Failed to rename cache folder.	MyFolder/MyService.MapServer
Method failed.HRESULT = 0x80070057 : The parameter is incorrect. .	MyFolder/MyService.MapServer
Method failed.HRESULT = 0x80070057 : The parameter is incorrect. .	MyFolder/MyService.MapServer
Service instance activation failed in 'MyFolder/MyService.MapServer'. AutomationException: 0x80004005 - Underlying DBMS error [FATAL: terminating connection due to administrator command could not receive data from server: Software caused connection abort (0x00002745/10053)::SQLSTATE=57P01] [sde.DEFAULT] in 'esriDataSourcesGDB.SdeWorkspace.1'	MyFolder/MyService.MapServer
Instance of service 'MyFolder/MyService.MapServer' failed to process a request.	MyFolder/MyService.MapServer

Re: Upgraded to 10.5, can no longer publish services...

MarkLittell — Wed, 22 Feb 2017 22:50:42 GMT

I've updated the SDE database to 10.5 - still get these errors.

Re: Upgraded to 10.5, can no longer publish services...

RebeccaStrauch__GISP — Wed, 22 Feb 2017 22:59:29 GMT

I haven't looked in detail about your issue, but a couple quick thoughts...

- make sure you still have the propper permissions to all the data, folders, etc.

- is the data still registered?

- I remember seeing post on the "swizzle" before, so did a quick search..

Server 10.4 and Snoop Dog: Failed to Swizzle..... which also points to

https://community.esri.com/thread/177553#comment-614422

Those are talking about 10.4, but still might help.

Re: Upgraded to 10.5, can no longer publish services...

CattyannCampbell — Thu, 23 Feb 2017 15:31:02 GMT

Having this issue after upgrading to 10.5, First I was told by tech support to upgrade the SQL Server 2008 R2 database which we did to SQL Server 2014 after the upgrade and upgrading our geodatabase to 10.5 we're still seeing the same problems trying to publish services from SDE although we can connect to the data in ArcCatalog. We're also having issues validating the sde instance in the data store. Although we can see the data in Catalog. The tech tried a bunch of stuff and six weeks later we're still having the same error. In addition, we also can't overwrite a service that's already been published without getting the 001369 error without get this changing the name of the MXD. It's a hot mess and I'm waiting on tech support for a resolution.

Re: Upgraded to 10.5, can no longer publish services...

MarkLittell — Thu, 23 Feb 2017 19:17:04 GMT

I have two of these servers.

Last night I ended up uninstalling and then reinstalling 10.5 on the secondary server - I was then able to publish all 80+ services. Most services were using SDE as the datasource, some were using PostgreSQL 9.3, some were using MS SQL 2012, all installed without issue.

Looks like 10.5 is not the problem, it's because I upgraded from 10.41 to 10.5.

To Clarify - I still have one 10.5 server that I am unable to publish new or republish services on.

ESRI support - have any thoughts?

Re: Upgraded to 10.5, can no longer publish services...

MarkLittell — Thu, 23 Feb 2017 19:23:59 GMT

Thanks for the thoughts.

Yes the data source is still registered and the arcgis account has full control over the arcgisserver folder and sub folders.

FWIW: If you scroll through that thread you posted about, # 177553, you will see I was a part of it and had issues with publishing a service from a SQL server as the data source. It took a patch (10.4.1) from ESRI to get it fixed. I'm kind of hoping ESRI would also have a solution to this so I don't have to rebuild the entire server.

Re: Upgraded to 10.5, can no longer publish services...

ScottFierro2 — Fri, 24 Feb 2017 15:02:27 GMT

So we had issues although I didn't go digging for the logs I immediately remembered the publishing patches in last few releases. Dug in and sure enough there is one for 10.5 already. Can't guarantee it's the silver lining as I don't know if you are doing publishing from Pro or not. If you install this I will say that after we did it our publishing was killed for not just Pro but desktop as well (desktop had been publishing fine prior to patch). Simple stop and restart of the publishing tools in manager fixed things and we have not seen issues since publishing from either. Can also say that a reboot of the server or the ArcServer service didn't correct things after the patch install either and only the recycling of the running Publishing Tools service resolved it.

http://support.esri.com/Products/Enterprise/arcgis-server/ArcGIS-GIS-Server/10-5#downloads?id=7464

Re: Upgraded to 10.5, can no longer publish services...

MarkLittell — Fri, 24 Feb 2017 17:53:42 GMT

Thank you Scott!

On my bad server, I was just about ready to uninstall ArcGIS and reinstall it - that's what fixed my other server - when I decided to stop the Publishing Tool per your suggestion.

I've rebooted the server multiple times over the past few days.

I stopped and restarted the Publishing Tool and am now able to publish new and update existing services.

Your suggestion just saved me 4 hours of work.

FWIW: I am using Desktop, not Pro. I tried the Publishing Patch on the first day I had issues, it did not resolve my problem.

Re: Upgraded to 10.5, can no longer publish services...

ScottFierro2 — Fri, 24 Feb 2017 18:09:48 GMT

Good to hear and can't say what causes this or why it fixes things. Logic would be that cycling the ArcServer service or entire server itself would work but we have seen this issue in servers back to 10.2. Happens every once in a while after we do OS updates/patching and all I have ever reasonably deduced is that the ArcServer service is a delayed start service but the publishing tools spin up within that service so possibly the delayed start isn't enough for other necessary things to come up at the time the publishing tools initialize. Not sure, just know its been another of our identified ESRI quirks but the recycle of the Publish Tools itself hasn't failed us yet.

Re: Upgraded to 10.5, can no longer publish services...

DavidWesterlind — Mon, 27 Feb 2017 04:04:09 GMT

This have been an issue with arcgis server since 10.1 at least. Something is fundamental wrong with the publishing process. I never had this kind of trouble with publishing in ArcGIS Server 10.0.

ArcGIS Server 10.0 was lightyears better to handle mapservices with larger number of layers. In my organisation we are in to radically limit number of layers of each mapservice. Otherwise the site goes really slow. We are also removing the removing the policy to use more than 1 server per cluster. It doesn work anyway.

There is a patch for publishing 10.5 with arcgis pro, but not from ArcGIS Desktop. I think we need a patch again.....

Re: Upgraded to 10.5, can no longer publish services...

Streltzer_Tracie — Thu, 20 Apr 2017 16:16:40 GMT

We had a lot of issues with the 10.4.1 upgrade. I have noticed that older SDE connections, even though they were direct connects, don't always open in 10.4.1 desktop. We ended up having to replace many of our SDE connections before publishing would work, long with the updated 10.4.1 publishing patch. Its still a problem every now and then, no apparent rhyme or reason, oracle or sql server, it just randomly happens. Only solution is to apply the patch, create a new SDE connection file and publish, then remove the old connection files. We re publishing with desktop 10.3.1 and 10.4.1.

Re: Upgraded to 10.5, can no longer publish services...

Anonymous User — Fri, 21 Apr 2017 07:15:53 GMT

Hi Scott,

ArcGIS Server 10.5 Service Publishing Patch

BUG-000101955 - Publishing a query layer with binding variables from ArcGIS Pro fails.
BUG-000101954 - Map Service does not report timeInfo correctly in the layer resources for a query layer is made time aware by binding it to a parameter.
BUG-000101953 - Map service query operation, on a "query layer with binding variables", without time parameter uses the time value from the previous rest request.

This one not works in this case.

Re: Upgraded to 10.5, can no longer publish services...

Anonymous User — Fri, 21 Apr 2017 07:19:29 GMT

Hello,

We have also upgraded to our ArcGIS server platforms from 10.4.1 to 10.5 and using oracle11g.

But no publishing error reported in our environment.

We are first created SD files then uploaded all SD files to AGS using ArcGIS server tools.

Our ArcGIS server deployed on Windows as well linux platform.

Re: Upgraded to 10.5, can no longer publish services...

MalcolmJ — Mon, 29 May 2017 21:48:26 GMT

I had the same problems as the original post after upgrading a 10.3 server to 10.5

Eventually resolved the problem by deleting all the records under Site > Data Stores and then re-adding them using database connection files created using ArcCatalog 10.5

Re: Upgraded to 10.5, can no longer publish services...

DionLiddell — Fri, 28 Jul 2017 09:33:18 GMT

I had the same problem upgrading from 10.3.1 to 10.5.1. I used your hint (thank you!), but instead of deleting the Data Stores, I imported the updated 10.5.1 SDE file for the database registrations that were giving me trouble.

Re: Upgraded to 10.5, can no longer publish services...

CattyannCampbell — Fri, 04 Aug 2017 13:30:26 GMT

Finally fixed our issue after a clean install of ArcGIS Server on my desktop and copying the data store profiles to the server. Once in a while we still get the 001369 error publishing error while re-publishing one of the older MXDs again renaming the MXD fixes the problem. Sometimes I noticed this happens when the server is busy...

Re: Upgraded to 10.5, can no longer publish services...

Javier_Pintos — Fri, 20 Apr 2018 11:55:27 GMT

Hello everyone,

I have some error after migrate Server 10.5.1 to 10.6.

Mark Littell‌ do you fix it issue?

Do you have any recommendation?

Thank you!

Javier

Re: Upgraded to 10.5, can no longer publish services...

WilliamWang — Wed, 09 May 2018 22:48:26 GMT

Thanks to Mark who initiated this and everyone's contribution.

I had similar issue in the last 24 hours after trying to overwrite an existing Map and Feature Service (MFS).

This was most likely caused by recent upgrade of our SQL db and ArcGIS server to 2012 and 10.4.1, respectively. In hindsight, I should have upgraded to 10.5.1 but this isn't the point here.

These are the steps I took after reading through this thread. Not sure what was the one that fixed the publishing issue. I am inclined to say it is the newly established Database Connection string after upgraded to 10.4.1.

In ArcCatalog (AC), deleted my database connection and recreate a new one with the same credential. Open the mxd that I had issue publishing, and resource the data layer with the new connection by going through each layer in the TOC.
Log into ArcGIS Server Manager (ASM) >> site >> DataStore >> validate all Data store (Note: tried this before but did not help. Doing this again, simply as a precaution)
In AC, restart the Publishing Tool GP under System. (Note: tried restarting just this service before but did not work. Doing this again, simply as a precaution)
From the Mxd, shared and overwrote the MFS on the server....worked...phew~~

Re: Upgraded to 10.5, can no longer publish services...

baohuachu3 — Wed, 06 Mar 2019 07:27:31 GMT

My version is 10.5. After create a new geodatabase this issue appeared.

Tried some methods , create service by site admin works. See the link.

The method is :

Overall steps:

Create an msd
Use ArcGIS Server Admin site to create a map service using the msd

Details:

To create an msd:

you can use arcpy.mapping.ConvertToMSD() function, OR
in ArcMap, open 'Customize' window from 'Customize | Customize Mode... menu item'
switch to 'Commands' tab
select 'Map Service Publishing' from 'Categories' list box.
from 'Commands' list box on the right, drag and drop 'Save Map Service Definition...' on to an existing toolbar
Close
use the newly added 'Save Map Service Definition' tool to create a msd and save it some place where ArcGIS Server Account has access to.

Publish a map service from ArcGIS Server Admin site:

Browse to http://yourServerMachine:6080/arcgis/admin/services/createService
Read the API Reference help on 'createService' operation. There should be a json that you can use as a boilerplate.
Make necessary changes in the boilerplate json.
Most important ones are: name of the service, path to the msd etc.
paste the json in the only textbox available on the 'createService' operation page
click on 'Create'
once that is done successfully, and if the service is not started yet, you can use Admin Site or Manager to start the newly created service.

The example json file is as below, if the service to be created under xxx folder ,the create service url should be :

http://yourserver:6080/arcgis/admin/services/xxx/createService

{

"serviceName": "<mapservice_name>",

"type": "MapServer",

"description": "",

"capabilities": "Map,Query,Data",

"provider": "ArcObjects",

"clusterName": "default",

"minInstancesPerNode": 1,

"maxInstancesPerNode": 1,

"instancesPerContainer": 1,

"maxWaitTime": 60,

"maxStartupTime": 300,

"maxIdleTime": 180,

"maxUsageTime": 600,

"loadBalancing": "ROUND_ROBIN",

"isolationLevel": "HIGH",

"configuredState": "STARTED",

"recycleInterval": 24,

"recycleStartTime": "00:00",

"keepAliveInterval": -1,

"private": false,

"isDefault": false,

"maxUploadFileSize": 0,

"allowedUploadFileTypes": "",

"properties": {

"useLocalCacheDir": "true",

"outputDir": "C:\\arcgisserver\\directories\\arcgisoutput",

"cacheDir": "C:\\arcgisserver\\directories\\arcgiscache",

"filePath": "C:\\temp\\mymap.msd",

"maxRecordCount": "1000",

"supportedImageReturnTypes": "MIME+URL",

"clientCachingAllowed": "true",

"isCached": "false",

"virtualOutputDir": "/rest/directories/arcgisoutput",

"maxExportTilesCount": "100000",

"ignoreCache": "false",

"exportTilesAllowed": "false",

"cacheOnDemand": "false"

"extensions": [],

"frameworkProperties": {},

"datasets": []

}