topic Unable to publish map service with data in enterprise database using Server 10.4 in ArcGIS Enterprise Questions

Unable to publish map service with data in enterprise database using Server 10.4

ThomasPuthusserry — Tue, 24 May 2016 10:57:12 GMT

I have upgraded ArcGIS Server 10.3.1 to 10.4 and facing issues with publishing map services with data stored in enterprise databases.

The server is hosted in Amazon AWS with following infrastructure and works fine:

Windows 2012 R2

Server 10.3.1

PostgreSQL 9.3 (in the same server - localhost) with SDE enabled

PostgreSQL as AWS RDS with SDE enabled

However, when the server upgraded to 10.4, the service with data in enterprise databases (both localhost and AWS RDS) which used to publish are no longer working. The error is

The ArcServer log file shows the following details

Error executing tool. PublishServiceDefinition Job ID: j5a9a52478ffc49d19328e5ceefbb609f : ERROR 001487: Failed to update the published service with the server-side data location. Please see the server's log for more details. ERROR 001369: Failed to create the service. Failed to execute (Publish Service Definition). System/PublishingTools.GPServer

Failed to create the service.: Updating the server connection string for layer sdedb1.web.%gwstatmaster_staging Events failed. Attempted connection string was ENCRYPTED_PASSWORD=00022e68334e624d44786b57627653553542393435702b3845413d3d2a00;SERVER=xxxxxxx.c11tt3rfoa7s.eu-west-1.rds.amazonaws.com;INSTANCE="DSID=a8960749-e49c-41db-a095-a8a257a693b4";DBCLIENT=postgresql;DB_CONNECTION_PROPERTIES=xxxxxx.c11tt3rfoa7s.eu-west-1.rds.amazonaws.com;DATABASE=sdedb1;USER=web;VERSION=sde.DEFAULT;AUTHENTICATION_MODE=DBMS. Table name is sdedb1.web.%gwstatmaster_staging. Please verify the data exists on the server. System/PublishingTools.GPServer

If I uninstall 10.4 and reinstall 10.3.1 on the same server, everything back to normal and working fine.

Has anyone else experienced the same issue?

Thanks and any suggestions much appreciated

Thomas

Re: Unable to publish map service with data in enterprise database using Server 10.4

AstridGladys1 — Thu, 02 Jun 2016 14:07:27 GMT

Did you try to save your mxd as a new one in order to get a mxd in 10.4 ?

Best,

Astrid

Re: Unable to publish map service with data in enterprise database using Server 10.4

JonathanQuinn — Thu, 02 Jun 2016 21:00:46 GMT

Is that query layer? I'm curious as to why there's a % sign in the table name:

sdedb1.web.%gwstatmaster_staging

Re: Unable to publish map service with data in enterprise database using Server 10.4

MarkLittell — Fri, 10 Jun 2016 19:25:11 GMT

I am experiencing the same issue - has anyone found a solution?

Jonathan Quinn - Yes it is a query layer.

I do not want to re publish 90+ services by going back to 10.3.1.

I am trying to use 10.4.1

Please advise

- Mark

Re: Unable to publish map service with data in enterprise database using Server 10.4

ChristianWells — Fri, 10 Jun 2016 19:33:03 GMT

Hi Mark,

There are some defects regarding publishing in 10.4 that we have identified for some layer types. Are you able to open a Esri Support case so we can attach you to the defects as appropriate?

BUG-000096292: When the database view is joined to a definition que..

Thanks,

Christian

Re: Unable to publish map service with data in enterprise database using Server 10.4

MarkLittell — Fri, 10 Jun 2016 20:20:23 GMT

ESRI's Alternate Solution does not work either.

I uninstalled ArcMap 10.4.1 and installed 10.3.1, tried to publish the layer, and get the same error.

Current ArcMap is 10.3.1.4959

Current ArcGIS Server is 10.41

I do not want to revert back to server 10.3.1 - I have over 90 services that will need redeploying.

Should I start a new thread?

Re: Unable to publish map service with data in enterprise database using Server 10.4

ThomasPuthusserry — Fri, 10 Jun 2016 21:57:24 GMT

A while ago ESRI UK through ESRI Inc said this is a known bug:

BUG-000096129 When publishing a map service containing an XY event layer that is created from a database table, the layer fails to publish and results in the following error, "Error 001487: Failed to update the published service with the server-side data location."

They have attached this case to the bug, however it has been marked as closed as it has been fixed in upcoming releases of Server.

However the 10.4.1 release doesn't mention about the above bug:

http://support.esri.com/en/downloads/patches-servicepacks/view/productid/66/metaid/2301

So what is the alternate solution till then?

Thomas

Re: Unable to publish map service with data in enterprise database using Server 10.4

ChristianWells — Fri, 10 Jun 2016 22:00:01 GMT

Instead of starting a new thread, I would recommend contacting Esri Support so we can identify if this is a new defect or an existing one.

Re: Unable to publish map service with data in enterprise database using Server 10.4

ChristianWells — Fri, 10 Jun 2016 22:03:17 GMT

Hi Thomas,

You are correct the issue does still occur at 10.4.1. These publishing issues are being considered for a future patch in addition to future releases.

Re: Unable to publish map service with data in enterprise database using Server 10.4

ThomasPuthusserry — Fri, 10 Jun 2016 22:03:40 GMT

Yes, this is a query / view from PostgreSQL in AWS RDS

Re: Unable to publish map service with data in enterprise database using Server 10.4

TanuHoque — Fri, 10 Jun 2016 22:33:52 GMT

Thomas Puthusserry

there are two options that i can think of:

Option #1: Try what is mentioned as the alternate solution in the bug's description. Christian Wells put the link to the bug above. Basically try to publish from a previous version of ArcMap (10.3 or 10.3.1)... It is not always guaranteed to work though.

Option #2: You can also try a manual process in case you feel adventurous

Disclaimer: you need to have admin privileges on ArcGIS Server.

Overall steps:

Create an msd
Use ArcGIS Server Admin site to create a map service using the msd

Details:

To create an msd:

you can use arcpy.mapping.ConvertToMSD() function, OR
in ArcMap, open 'Customize' window from 'Customize | Customize Mode... menu item'
switch to 'Commands' tab
select 'Map Service Publishing' from 'Categories' list box.
from 'Commands' list box on the right, drag and drop 'Save Map Service Definition...' on to an existing toolbar
Close
use the newly added 'Save Map Service Definition' tool to create a msd and save it some place where ArcGIS Server Account has access to.

Publish a map service from ArcGIS Server Admin site:

Browse to http://yourServerMachine:6080/arcgis/admin/services/createService
Read the API Reference help on 'createService' operation. There should be a json that you can use as a boilerplate.
Make necessary changes in the boilerplate json.
Most important ones are: name of the service, path to the msd etc.
paste the json in the only textbox available on the 'createService' operation page
click on 'Create'
once that is done successfully, and if the service is not started yet, you can use Admin Site or Manager to start the newly created service.

Re: Unable to publish map service with data in enterprise database using Server 10.4

ThomasPuthusserry — Sat, 11 Jun 2016 14:07:47 GMT

Thanks Tanu Hoque

Tried option #1: No success

Option #2: Couldn't go past the 'CreateService' as the JSON format keeps failing. I think have to wait until a proper solution comes from ESRI.

Update

Correction on Option #2: A bit fiddly, but managed to make it work. Thanks Tanu!

Thomas

Re: Unable to publish map service with data in enterprise database using Server 10.4

TanuHoque — Mon, 13 Jun 2016 16:11:32 GMT

Thanks Thomas... i'm glad that in the end it worked for you though as you say it is not straight forward.

My bad about option#1... i realized later that that wouldn't help in this case.

for future reference, here is a boilerplate json to create a map service from the Admin site.

update values for 'serviceName' and 'filePath' and you should be fine.

{

"serviceName": "<mapservice_name>",

"type": "MapServer",

"description": "",

"capabilities": "Map,Query,Data",

"provider": "ArcObjects",

"clusterName": "default",

"minInstancesPerNode": 1,

"maxInstancesPerNode": 1,

"instancesPerContainer": 1,

"maxWaitTime": 60,

"maxStartupTime": 300,

"maxIdleTime": 180,

"maxUsageTime": 600,

"loadBalancing": "ROUND_ROBIN",

"isolationLevel": "HIGH",

"configuredState": "STARTED",

"recycleInterval": 24,

"recycleStartTime": "00:00",

"keepAliveInterval": -1,

"private": false,

"isDefault": false,

"maxUploadFileSize": 0,

"allowedUploadFileTypes": "",

"properties": {

"useLocalCacheDir": "true",

"outputDir": "C:\\arcgisserver\\directories\\arcgisoutput",

"cacheDir": "C:\\arcgisserver\\directories\\arcgiscache",

"filePath": "C:\\temp\\mymap.msd",

"maxRecordCount": "1000",

"supportedImageReturnTypes": "MIME+URL",

"clientCachingAllowed": "true",

"isCached": "false",

"virtualOutputDir": "/rest/directories/arcgisoutput",

"maxExportTilesCount": "100000",

"ignoreCache": "false",

"exportTilesAllowed": "false",

"cacheOnDemand": "false"

"extensions": [],

"frameworkProperties": {},

"datasets": []

}

Re: Unable to publish map service with data in enterprise database using Server 10.4

JasonHarris2 — Tue, 14 Jun 2016 20:18:44 GMT

I have been banging my head against a wall for 2 days straight on this issue. In my case, I had no crazy layers/views/joins. I had even tried a single layer service, and it still wouldn't publish. Your MSD & JSON method worked. Obviously, this is a major bug that needs to get addressed, but I sure am happy you had this solution for the near term. Thanks!

Re: Unable to publish map service with data in enterprise database using Server 10.4

TanuHoque — Tue, 14 Jun 2016 20:50:25 GMT

Jason,

did you open an incident with Esri Tech Support for your issue? we need to know why your single layer service (with no joins, not views...) not working for you?

thanks

Re: Unable to publish map service with data in enterprise database using Server 10.4

ChristianWells — Tue, 14 Jun 2016 20:52:42 GMT

To Tanu's point, having a support case for this is extremely helpful. Please DM me if you have any issues creating a ticket.

Re: Unable to publish map service with data in enterprise database using Server 10.4

TerryGiles — Wed, 15 Jun 2016 22:27:55 GMT

Thank You for posting the work around. Just hit this today even though I'd just republished the same service with query layers last week with no issue & to a different 10.4 server yesterday...

A note for anyone else who uses the MSD and createService workflow method - if you have a multiple machine set up the .msd file must be on each server in the location specified in the filePath in the JSON & the service account must have access to this location (or a network share that account can reach should work too).

Re: Unable to publish map service with data in enterprise database using Server 10.4

SarahNoakes1 — Fri, 17 Jun 2016 13:47:15 GMT

Hi Christian,

You say there are

some defects regarding publishing in 10.4 that we have identified for some layer types.

- could you list these and their respective bug reports?

We have been unable to republish live map services since upgrading from 10.3.1 to 10.4 - getting the packaging succeeded but publishing failed error message. We currently have a conversation ongoing with ESRI UK about this, but we have been told that we shouldn't expect to be able to republish a live map service and that we should schedule scripts to do this at times of low usage. While I can see this may be best practice, is it essential to do this?

Thanks,

Sarah Noakes

Cornwall Council

Re: Unable to publish map service with data in enterprise database using Server 10.4

Anonymous User — Mon, 11 Jul 2016 11:20:04 GMT

Hello,

How to create map service in different folder from site.

please share me json syntax .

Re: Unable to publish map service with data in enterprise database using Server 10.4

Anonymous User — Mon, 11 Jul 2016 11:25:30 GMT

Hello Team,

In our production environment for one server its possible to publish same mxd in map service but for one server throw 1487 error and another throw 1487 & 1369 error code while trying to publish map service.

Please suggest! All server are

Software version:

10.4.0 (build 5524)

same ArcGIS server version and same windows server hardware resources.