Select to view content in your preferred language

ArcGIS Enterprise on Red Hat Linux: Publishing issues when referencing data from enterprise geodatabase

1511
7
12-18-2023 07:43 AM
Boke
by
Emerging Contributor

Hello Enterprise community,

We are facing some publishing issues on one of our environments. In fact, this is our staging environment and we must get everything working before we deploy the production environment. We have a multi-machine base deployment architecture as shown below:

Boke_1-1702897522693.png

We have two machines in this environment and we installed all 4 components (portal, server, datastore, and web adaptors for portal and server) on each. We installed and created sites on the first machine, and we joined the portal and server components to existing sites from the first machine. The server and portal are federated and everything seems to work perfectly. We also updated our WebContext URL appropriately. However, we are having issues whenever we attempt to publish data from Enterprise Geodatabase. The database we are using is Oracle. We have also attempted to register a Microsoft SQL Server database, and still experienced the same issue.

We want to publish a Utility Network dataset, and we want to reference the enterprise geodatabase. We've tested several workflows to troubleshoot the publishing settings as follows:

#WorkflowResult
1Upload CSV, and Shapefile and published as hosted feature layerPASSED
2Share as web map/web layer from File Geodatabase (Copy all feature)PASSED
3Share as web map/web layer from Oracle Enterprise Geodatabase (Copy all feature)PASSED
4Share as web map/web layer from Oracle Enterprise Geodatabase (Reference registered data)FAILED
5Share single layer as web layer from Oracle Enterprise Geodatabase (Reference registered data)FAILED
6Save Service definition file from Oracle Enterprise Geodatabase to publish on Server Manager (Reference registered data)FAILED/INCONCLUSIVE

 

For the failed sharing from Enterprise Geodatabase, the publishing job gets stuck on "Uploading service definition" for longer than usual before failing as shown below:

Boke_2-1702898910441.png

The log below was also generated from each failed attempt:

 

 

Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:41	Status: InProgress	StatusMessage: Successfully wrote sharing info file	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:41	Status: InProgress	StatusMessage: Successfully wrote sharing connection file (Number of SDE Connections: 1)	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:41	Status: InProgress	StatusMessage: Loading manifest	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:41	Status: InProgress	StatusMessage: Creating thumbnail from map	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:41	Status: Pending	StatusMessage: Sharing process started	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:42	Status: InProgress	StatusMessage: Sharing process started	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:42	Status: InProgress	StatusMessage: Loading manifest	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:42	Status: InProgress	StatusMessage: Reading thumbnail from file	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:43	Status: InProgress	StatusMessage: Publishing process started	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:43	Status: InProgress	StatusMessage: Preparing data references and staging web layer	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:35:43	Status: InProgress	StatusMessage: Loaded SDE Workspaces	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:06	Status: InProgress	StatusMessage: Using ArcGIS Version 13.1 for staging (Source for version: GP Staging Parameters)	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:06	Status: InProgress	StatusMessage: Stage Tool initialized	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:06	Status: InProgress	StatusMessage: Preparing maps and layers for processing	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:09	Status: InProgress	StatusMessage: Retrieving and processing fonts	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:10	Status: InProgress	StatusMessage: Executing...	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:10	Status: InProgress	StatusMessage: Start Time: Tuesday, December 12, 2023 9:36:09 AM	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:10	Status: InProgress	StatusMessage: Succeeded at Tuesday, December 12, 2023 9:36:09 AM (Elapsed Time: 0.03 seconds)	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:13	Status: InProgress	StatusMessage: Consolidate data	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:13	Status: InProgress	StatusMessage: Staging map service	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:35	Status: InProgress	StatusMessage: Compressing package into SD file	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:37	Status: InProgress	StatusMessage: Staging successful	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:37	Status: InProgress	StatusMessage: Uploading service definition	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:38	Status: InProgress	StatusMessage: Publishing tool initialized	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 09:36:38	Status: InProgress	StatusMessage: Publishing web layer (AGS)	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 10:07:41	Status: InProgress	StatusMessage: Upload failed	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 10:07:43	Status: InProgress	StatusMessage: Publishing tool execution failed	
Map1		8	WebMapImageLayer	ArcGIS Enterprise	https://webserver.hostname.tld/server	portaladmin	2023-12-12 10:07:45	Status: Failed	ErrorMessage: Failed to publish web layer	

 

 

 

I used FAILED/INCONCLUSIVE for the 6th test, because the service definition upload on Server Manager keeps uploading for hours with no fail/success result.

Boke_3-1702899181109.png

At this point we're stuck as to what next we need to check. Calling on everyone here to give us suggestions on what we can apply to be able to publish our Utility Network Data referencing registered data from enterprise geodatabase. Thanks you in anticipation.

0 Kudos
7 Replies
MarceloMarques
Esri Regular Contributor

Oracle Enterprise Geodatabase

The machine running ArcGIS Server must have the Oracle Instant Client 64-bits properly installed.

Connect to Oracle from ArcGIS—ArcGIS Server | Documentation for ArcGIS Enterprise - Windows

Connect to Oracle from ArcGIS—ArcGIS Server | Documentation for ArcGIS Enterprise- Linux
read the part of the document under "Connect from ArcGIS Server".

Instant Client for Linux x86-64 (64-bit) (oracle.com)

Before you attempt to publish add the Enterprise Geodatabase Connection File in
ArcGIS Server > Sites > Data Store.

community.esri.com - White Paper - How to Install the Oracle Database Client for ArcGIS?

| Marcelo Marques | Esri Principal Product Engineer | Cloud & Database Administrator | OCP - Oracle Certified Professional | "In 1992, I embarked on my journey with Esri Technology, and since 1997, I have been working with ArcSDE Geodatabases, right from its initial release. Over the past 32 years, my passion for GIS has only grown stronger." | “ I do not fear computers. I fear the lack of them." Isaac Isimov |
0 Kudos
MarceloMarques
Esri Regular Contributor

SQL Server Enterprise Geodatabase

The machine running ArcGIS Server must have the Microsoft ODBC Client properly installed.

Connect to Microsoft SQL Server from ArcGIS—ArcGIS Server | Documentation for ArcGIS Enterprise - Windows

Connect to Microsoft SQL Server from ArcGIS—ArcGIS Server | Documentation for ArcGIS Enterprise - Linux

Download ODBC Driver for SQL Server - ODBC Driver for SQL Server | Microsoft Learn

Install the Microsoft ODBC driver for SQL Server (Linux) - ODBC Driver for SQL Server | Microsoft Le...

Before you attempt to publish add the Enterprise Geodatabase Connection File in
ArcGIS Server > Sites > Data Store.

community.esri.com - White Paper - How to Install the SQL Server Client for ArcGIS?

| Marcelo Marques | Esri Principal Product Engineer | Cloud & Database Administrator | OCP - Oracle Certified Professional | "In 1992, I embarked on my journey with Esri Technology, and since 1997, I have been working with ArcSDE Geodatabases, right from its initial release. Over the past 32 years, my passion for GIS has only grown stronger." | “ I do not fear computers. I fear the lack of them." Isaac Isimov |
0 Kudos
Boke
by
Emerging Contributor

Hi @MarceloMarques , thanks for your imput. We already configured the Oracle client, and we were able to register the Oracle database with the server and it validates successfully in both ArcGIS Pro and Server Manager. This is also one of the things ArcGIS Pro checks when you click Analyze and it will not even allow sharing until the data source is registered with the server.

So, like I said, we were able to click Share, and as seen in the logs, the publishing tool completed some steps while it failed to upload service definition and publish the layer. In the status pane, we can only see that it tool forever to upload service definition before eventually failing, and the logs is all we've got which is not providing enough information for diagnostics. 

Boke_0-1702925538517.png

0 Kudos
MarceloMarques
Esri Regular Contributor

Please, open a ticket with Esri Technical Support to investigate this further, the Esri Support Engineer will help to troubleshoot the issue.

| Marcelo Marques | Esri Principal Product Engineer | Cloud & Database Administrator | OCP - Oracle Certified Professional | "In 1992, I embarked on my journey with Esri Technology, and since 1997, I have been working with ArcSDE Geodatabases, right from its initial release. Over the past 32 years, my passion for GIS has only grown stronger." | “ I do not fear computers. I fear the lack of them." Isaac Isimov |
0 Kudos
MarceloMarques
Esri Regular Contributor

@Boke - you can set the ArcGIS Server Logs to "debug" mode then try to publish again, the ArcGIS Server Logs will then show more information about the error, then change the ArcGIS Server log mode back to "warning" level. You can also try to publish a map service with just one featureclass to see if works. Please, read the Database Connections Best Practices  from my community.esri.com blog article.

| Marcelo Marques | Esri Principal Product Engineer | Cloud & Database Administrator | OCP - Oracle Certified Professional | "In 1992, I embarked on my journey with Esri Technology, and since 1997, I have been working with ArcSDE Geodatabases, right from its initial release. Over the past 32 years, my passion for GIS has only grown stronger." | “ I do not fear computers. I fear the lack of them." Isaac Isimov |
0 Kudos
Boke
by
Emerging Contributor

Hi @MarceloMarques I set the ArcGIS Server Logs to "debug" and I tried publishing again. I tried publishing three times as suggested. 

  1. Reference registered data: Editable - FAILED
  2. Reference registered data: Exploratory - FAILED
  3. Publish a map service with a single feature service (reference registered data: Editable) - FAILED/taking forever

I've attached the server log for the first two attempts

0 Kudos
MarceloMarques
Esri Regular Contributor

@Boke - best here is for you to open a ticket with Esri Technical Support to investigate this further, the Esri Support Engineer will help to troubleshoot the issue.

| Marcelo Marques | Esri Principal Product Engineer | Cloud & Database Administrator | OCP - Oracle Certified Professional | "In 1992, I embarked on my journey with Esri Technology, and since 1997, I have been working with ArcSDE Geodatabases, right from its initial release. Over the past 32 years, my passion for GIS has only grown stronger." | “ I do not fear computers. I fear the lack of them." Isaac Isimov |
0 Kudos