topic Re: Custom Print Service fails to Print "Failed to create layer from service at "<Service_URL>" for Hosted Server in ArcGIS Enterprise Questions

Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ArchitSrivastava — Sun, 13 Aug 2023 06:17:00 GMT

Hello,

We are working with a custom Print service created from ArcGIS Pro to allow printing of Secured service from different Servers. However, we encounter the issue when trying to print the secured services from the ArcGIS Server which on which the service is published.

We have configured the Print Service by following this "HOW TO" article and it works well with other server services.

As soon as I remove the service from that server everything work smoothly with any issues. We have tried several things, it still fails. Furthermore, if the service is created from ArcMap and then published everything works as expected.

We have also installed Print service patches for this version.

Environment details:

ArcGIS Enterprise 10.8.1
All components are installed on one machine except Web Adaptor

It would be great if I can some thoughts on this.

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

TanuHoque — Sun, 13 Aug 2023 19:32:35 GMT

@ArchitSrivastava

for most of the case, you'd not need to embed credentials with a print service to allow print secured services. Please read this help topic.
https://enterprise.arcgis.com/en/server/latest/publish-services/linux/printing-maps-that-contain-secured-services.htm

Pls let us know if you are in one of those situation where you must follow this approach. We had a bug in 10.8.1 that prevent print service from accessing secured services.

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ArchitSrivastava — Mon, 14 Aug 2023 05:15:21 GMT

Hello @TanuHoque,

Hope you are keeping safe and well. Thanks for responding to this. I have embedded credentials because we utilize services in our Web Maps/Apps from several different servers and that too from different organization which are secured

Hence, to allow our users to be able to print those services utilizing our custom templates. We utilized this method:

Print maps that contain non-token-based secured services from ArcGIS Server

We have made sure of the following as well:

ArcGIS Server can access these files from a registered path
All connections are "ArcGIS Server User Connections"
The tool works fine on ArcGIS Pro

Furthermore, We ran a check on BUGs and have installed the following patches (After that the service created from ArcMap Started working):

The cause behind working on this is that we would like to move away from "ArcMap and components created from it" and prepare for an upgrade to latest version of ArcGIS Enterprise.

Note: This service can print secured service from all other server embedded in the script except the services from it's own "Hosting Server".

Hopefully I addressed the answers you were looking for. Any thoughts would be highly appreciated.

Thanks a lot!

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ChadKopplin — Mon, 14 Aug 2023 15:01:15 GMT

I ran into the same issue, this is a known bug with Pro 3.1 and Server 10.8.1 (we were using 10.7.1), I needed to upgrade to Server 11.1.1 and the bug is fixed, because when creating the widget there is an application ID that is apart of the ArcGIS Pro, but it is not apart of the earlier versions of server, so it error's out when you try to publish. Once you upgrade make sure to clear you browser cache as well. Thank you.

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

David_McRitchie — Mon, 14 Aug 2023 16:04:45 GMT

Hey just further to what ChadKopplin said the following documentation is pretty useful for judging what version of ArcGIS Pro to pair with ArcGIS Server or Enterprise.

Enterprise 11 and ArcGIS Pro 3 were both major updates so mixing either of these with Enterprise 10.x or ArcGIS Pro 2.x can have some compatibility issues if tool parameters are different.

Hope that helps,

David

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ArchitSrivastava — Tue, 15 Aug 2023 04:58:45 GMT

Hello @David_McRitchie , @ChadKopplin ,

Thanks for your valuable comments. I understand the compatibility point. Hence, We have tried several versions of ArcGIS Pro by for following the information mentioned in the document below:

ArcGIS Pro and ArcGIS Enterprise compatibility

We tried ArcGIS Pro 2.6 with our environment and it gives the same errors (allows us to publish but fails to print the layers). Probably, I can try other versions of ArcGIS Pro which are compatible with ArcGIS Enterprise 10.8.1 and check the behavior.

I am considering upgrading as a possible option but it is a risk at the moment i.e., if I upgrade and things don't work out, It would cause an impact on user workflow.

Thanks a lot for suggestions. I will keep you guys posted as I make progress.

-Archit

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ChadKopplin — Tue, 15 Aug 2023 14:40:52 GMT

Good morning Archit, I had the same concerns. I will say that the upgrade went very smoothly, our only issue was that I needed to republish our image server services. The portal, portal web adaptor, server, server web adaptor, and data store upgrades upgraded with no issues. Our GIS server is upgraded nightly so we would have been able to restore the server quickly if an issue would have happened. Thank you.

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ArchitSrivastava — Mon, 21 Aug 2023 10:47:41 GMT

Thanks @ChadKopplin.

These comments are really helpful. As per both our experiences the upgrades should go smoothly without any issues.

However, upgrading to ArcGIS Enterprise 11.1 would discontinue the usage of ArcMap service. Hence, I am thinking of going to 10.9.1 first and see if everything works out and I will also have a fallback service from ArcMap (in case something goes out of expectation).

I will keep you posted if I successfully solve this by upgrading the system.

Thanks for all the valuable comments @ChadKopplin @TanuHoque @David_McRitchie. Much appreciated.

-Archit

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

TanuHoque — Wed, 23 Aug 2023 06:48:13 GMT

@ArchitSrivastava

We have just released the patch. Please apply this to you 10.8.1 server and that should resolve your issues.

https://support.esri.com/en-us/patches-updates/2023/arcgis-server-map-and-feature-service-security-2023-update-1-patch

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ArchitSrivastava — Mon, 28 Aug 2023 07:41:46 GMT

Hello @TanuHoque,

Thanks for sharing this. I tried this on our ArcGIS Enterprise 10.8.1. However, sadly the problem still persists with printing services from Hosting Server. It perfectly works if the map contain other ArcGIS Servers.

In order to further troubleshoot the issue I created a separate environment of ArcGIS Enterprise 10.9.1 in a different domain with similar configuration i.e. One machine where all components are installed and other where only Web Adaptors are configured and the problem persists on this as well.

This drives me to think that the problem could be with architecture configuration of this type but not too sure as of now.

Additionally, I am attaching the script for your reference perhaps I have missed something here.

Note: I have tried with registered paths as well. A similar folder exists on ArcGIS Server machines as well (from where .ags files are being refereed.)

I am working on troubleshooting this further. I will keep you posted with progress.

-Archit

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

StefanStamenković — Thu, 14 Mar 2024 11:06:49 GMT

Hi,

I'm also struggling with this issue and I'm desperate right now...

I have published secured service from ArcGIS Pro 2.9.11 to ArcGIS Server 10.9.1 (as they should be compatible) where I have also installed ArcGIS Server Map and Feature Service Security 2023 Update 1 Patch (as there this bug should be fixed), included my credentials in script and everything, but still doesn't manage to print my secured service.

Tried it as local ArcGIS Pro tool and it works fine, but after publishing it as geoprocessing tool to my server I get common error: Failed to create layer from service at https://.../arcgis/rest/services/.../MapServer

Is there anything else I can do about it?

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

David_McRitchie — Thu, 14 Mar 2024 16:25:52 GMT

Hey Stefan,

I would recommend raising a Support Case with your Esri distributor for assistance, as print cases can be fairly tricky.

I would recommend checking other patches that are available, as there are some print specific patches for 10.9.1 such as the following which may assist.

For testing I would also ensure that your Web Map just contains a basemap and layers that are stored on the default datastore, as this can rule out a lot of permission errors that can arise when the ArcGIS Server account doesn't have internet access.

Hope that helps,

David

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

StefanStamenković — Fri, 15 Mar 2024 09:44:26 GMT

Hi David,

Thank you for your answer. Mentioned patch has also been already installed and it doesn't seem to help as problem still persists.

I'm testing print service with basemap and two services with data in Enterprise database, one secured and other one not. As I mentioned, services are printing fine while using tool in Toolbox. After publishing and running GP tool I'm getting Error although I'm using the same WebMapJson, but even if I unlock services and update WebMapJson to print unsecured services, I'm not getting the Error but services don't get printed.

If anyone has other advice, I'll be looking forward to try with it.

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ArchitSrivastava — Mon, 18 Mar 2024 06:06:37 GMT

Hello @StefanStamenković ,

Hope you are keeping safe and well. Could you please share more details mentioned below:

What is the Authentication Mode we are working with "Web-tier authentication" or "Portal-tier authentication"?
Can e change the logging level of Geoprocessing service to "Info" and then check what information is generated in those logs? For more details : Enabling info-level geoprocessing messages
I am assuming that this runs perfectly fine on ArcGIS Pro, no waring messages at all?

Additionally, could you share a snippet of the .py file you have generated and published.

Hope it helps!

-Archit

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

StefanStamenković — Tue, 26 Mar 2024 14:55:51 GMT

Hi @ArchitSrivastava,

Sorry for delayed answer.

As we are using stand-alone server, I suppose it is web-tier authentication.
I managed to enable info-level messages for geoprocessing tool but it doesn't give me clearer insight what happens except it crashes while converting webmap to a map document and executes exception.
Yes, in ArcGIS Pro it executes without any errors, after publishing it as geoprocessing tool and running it I receive error: Failed to create layer from service at https://.../MapServer and it is secured serviceasdf

Please find below content of my .py file.

import sys import os import arcpy import uuid # constants SERVER_PROD_NAME = 'Server' PRO_PROD_NAME = 'ArcGISPro' PAGX_FILE_EXT = "pagx" MAP_ONLY = 'map_only' # Specify credentials for secured services in the WebMap JSON secure_server_connections = [r'path\to\ags\file.ags'] # Import credentials importedConnections = arcpy.ImportCredentials(secure_server_connections) # default location and current product name # _defTmpltFolder = os.path.join(arcpy.GetInstallInfo()['InstallDir'], r"Resources\ArcToolBox\Templates\ExportWebMapTemplates") _prodName = arcpy.GetInstallInfo()['ProductName'] _isMapOnly = False # export only map without any layout elements def exportMap(result, outfile, outFormat): mapView = result.ArcGISProject.listMaps()[0].defaultView w = result.outputSizeWidth h = result.outputSizeHeight dpi = int(result.DPI) #a workaround for now for a bug try: if outFormat == "png8" or outFormat == "png32": if (outFormat == "png8"): colorMode = "8-BIT_ADAPTIVE_PALETTE" else: colorMode = "32-BIT_WITH_ALPHA" mapView.exportToPNG(outfile, w, h, dpi, None, colorMode) elif outFormat == "pdf": mapView.exportToPDF(outfile, w, h, dpi) elif outFormat == "jpg": mapView.exportToJPEG(outfile, w, h, dpi, None, '24-BIT_TRUE_COLOR', 100) elif outFormat == "gif": mapView.exportToGIF(outfile, w, h, dpi) elif outFormat == "eps": mapView.exportToEPS(outfile, w, h, dpi) elif outFormat == "svg": mapView.exportToSVG(outfile, w, h, dpi, False) elif outFormat == "svgz": mapView.exportToSVG(outfile, w, h, dpi, True) elif outFormat == "aix": mapView.exportToAIX(outfile, w, h, dpi) elif outFormat == "tiff": mapView.exportToTIFF(outfile, w, h, dpi, False, "32-BIT_WITH_ALPHA", "DEFLATE", True) #return geoTIFF_tags except Exception as err: arcpy.AddError("error raised..." + str(err)) raise # export layout def exportLayout(result, outfile, outFormat): layout = result.ArcGISProject.listLayouts()[0] dpi = result.DPI try: if outFormat == "png8" or outFormat == "png32": if (outFormat == "png8"): colorMode = "8-BIT_ADAPTIVE_PALETTE" else: colorMode = "32-BIT_WITH_ALPHA" layout.exportToPNG(outfile, dpi, colorMode) elif outFormat == "pdf": layout.exportToPDF(outfile, dpi) elif outFormat == "jpg": layout.exportToJPEG(outfile, dpi) elif outFormat == "gif": layout.exportToGIF(outfile, dpi) elif outFormat == "eps": layout.exportToEPS(outfile, dpi) elif outFormat == "svg": layout.exportToSVG(outfile, dpi, False) elif outFormat == "svgz": layout.exportToSVG(outfile, dpi, True) elif outFormat == "aix": layout.exportToAIX(outfile, dpi) elif outFormat == "tiff": layout.exportToTIFF(outfile, dpi, "32-BIT_WITH_ALPHA", "DEFLATE") except Exception as err: arcpy.AddError("error raised..." + str(err)) raise # generating a unique name for each output file def generateUniqueFileName(outFormat): guid = str(uuid.uuid1()) fileName = "" fileExt = outFormat #changing the file extension for few instances if outFormat == "png8" or outFormat == "png32": fileExt = "png" elif outFormat == "tiff": fileExt = "tif" fileName = '{}.{}'.format(guid, fileExt) fullFileName = os.path.join(arcpy.env.scratchFolder, fileName) return fullFileName # Main module def main(): # Get the value of the input parameter WebMap_as_JSON = arcpy.GetParameterAsText(0) outfilename = arcpy.GetParameterAsText(1) format = arcpy.GetParameterAsText(2).lower() layoutTemplatesFolder = arcpy.GetParameterAsText(3).strip() layoutTemplate = arcpy.GetParameterAsText(4).lower() if (layoutTemplate.lower() == MAP_ONLY): _isMapOnly = True layoutTemplate = None else: _isMapOnly = False # Special logic while being executed in ArcGIS Pro # - so that a Geoprocessing result can be acquired without needing any json to begin to feed in # - this is to make the publishing experience easier if (WebMap_as_JSON.replace(' ', '') == '#'): WebMap_as_JSON = '#' if (_prodName == PRO_PROD_NAME): return elif (_prodName == SERVER_PROD_NAME): arcpy.AddIDMessage('ERROR', 590, 'WebMap_as_JSON') else: arcpy.AddIDMessage('ERROR', 120004, _prodName) # generate a new output filename when the output_filename parameter is empty or the script is running on server if outfilename.isspace() or _prodName == SERVER_PROD_NAME: outfilename = generateUniqueFileName(format) # constructing the full path for the layout file (.pagx) if not _isMapOnly: # use the default location when Layout_Templates_Folder parameter is not set tmpltFolder = _defTmpltFolder if not layoutTemplatesFolder else layoutTemplatesFolder layoutTemplate = os.path.join(tmpltFolder, '{}.{}'.format(layoutTemplate, PAGX_FILE_EXT)) #Convert the webmap to a map document try: result = arcpy.mp.ConvertWebMapToArcGISProject(WebMap_as_JSON, layoutTemplate) #Export... if (_isMapOnly): if (result.outputSizeWidth == 0) or (result.outputSizeHeight == 0): arcpy.AddIDMessage('ERROR', 1305) exportMap(result, outfilename, format) else: exportLayout(result, outfilename, format) # Clear credentials arcpy.ClearCredentials(importedConnections) except Exception as err: arcpy.AddError(str(err)) # Set output parameter # arcpy.SetParameterAsText(1, outfilename) if __name__ == "__main__": main()

Thank you in advance!

Re: Custom Print Service fails to Print "Failed to create layer from service at "" for Hosted Server

ArchitSrivastava — Wed, 27 Mar 2024 07:16:45 GMT

Hello @StefanStamenković ,

Thanks for sharing the details. While I analyze the script you have shared as it seems a bit modified than usual. I would like to bring the following to attention and consideration:

Can you confirm that you are using Web-Tier to check that:
- Navigate to ArcGIS Server Manager > Security > What you see under configuration settings
Confirm the Version of ArcGIS Server you are working with
Make Sure that ArcGIS Server Connection is "User Connection"
Can we try the basic script and steps recommended by ESRI in the following article, this will help us make sure if the modifications are causing any problems:
- Publish a custom print service with embedded credentials from ArcGIS Pro to a standalone ArcGIS Server site

Here are some initial tests I ran:

Configured you script at my end with Sample Server 6 credentials ags file (as I do not have standalone server) (Made sure that the connection Type is USER)
Made some basic changes in script to help me understand things better and handle things better (mentioned below)
Used "Web Map as JSON" from ESRI article
- Publish a custom print service with embedded credentials from ArcGIS Pro to a standalone ArcGIS Server site
Published it as a Web Tool To Portal for ArcGIS (11.1)
Added a secured Hosted Service and a Secured service from Sample Server 6 and ran Print in Web App Builder Widget and it seems to work

Changes Made in the script (very-initial) (attached updated):

Wrapped some parts of code in 'try-except' to catch specific exceptions that might occur during execution.
Added exception handling for both map export and layout export functions

Additionally, I think "Web-Tier Authentication" could be the culprit here, Can you check this post about ArcGIS Server Windows Service account with IWA.

It would be great if you can try the attached script, publish it as geoprocessing service, Set the logging level for Geoprocessing service and try to run the tool and what happens.

Hope it helps!

-Archit