Latest Contributions by NicolasGIS

Many thanks for all your valuable inputs @DavidColey and @JonEmch. So what is the best path to follow if we installed it ? Uninstall or wait for the “tooling” to be made available ? What is the risk of this patch? Any known issue we should be aware of ? thanks ... View more

From the Technical Support website: https://support.esri.com/en-us/patches-updates/2023/portal-for-arcgis-enterprise-sites-security-patch July 6, 2023: The 11.1 version of the Portal for ArcGIS Enterprise Sites Security Patch has been updated to address BUG-000159526 where the patch was installed but not listed as installed in the ArcGIS Enterprise Patch Notification tool. The new setup is named Portal for ArcGIS Enterprise Sites Security Patch B with the B suffix indicating a second build of this patch. The B suffix will appear in the name once the patch is installed. Please download and install the new setup. It is not necessary to uninstall the original patch, the new setup will install and replace the original patch. ... View more

Hi @khairulamri , Many thanks for your message ! Very helpful. Indeed, following the tutorial very closely, I ended up on this thread for the same reason and the step you mention seems to be missing.  ... View more

Thanks for sharing @DavidColey . I have "Portal for ArcGIS 11.1 Enterprise Sites Security Patch B" installed. Is this one also affected by the defect ? Thanks ... View more

Hi @malte, How did you find the issue ? Trying to restore from webgisdr or a tileCache restore ? What error do you get ? Is the workflow suggested by @ChristopherPawlyszyn working on your side ? Thanks, Nicolas ... View more

Hello @ChristopherPawlyszyn, Apologize for my late reply. I have been working hard on trying to make it work. Unfortunately, it does not. I wonder if there is not another BUG on top of the "DIRECT_FILE_BACKUP" one. If, as you suggested, I tried to unregister the datastore and restore it manually using "restoredatastore" command following this article: https://support.esri.com/en-us/knowledge-base/how-to-restore-arcgis-data-store-000021700 I have the following error:   Error encountered: Machine 'https://GISSTORE.COMPANY.COM:2443/arcgis/datastoreadmin' returned an error. 'Failed to restore 'tile cache' data store. Caused by: null'   Unfortunately, using this method, I don't have anything in the logs. Seems like the fact that ArcGIS Server in the DEBUG mode is not taken into account. I tried also several times to restore the full webgisdr backup using the following workflow: - Initializing new VMs from scratch - Installing and configuring ArcGIS Enterprise 11.1 components on each VM using ArcGIS powershell DSC as if it was prod - At the end, the standby ArcGIS Enterprise deployment is functionnal - Restore 11.1 webgisdr done from production with tileCache backup configured as "REPLICATION_BACKUP" (I doubled check the metatadata file and it is a "REPLICATION_BACKUP" tileCache) After that, relational datastore is successfully restored but the tileCache one fails after a while with all the time this error:   { "jobId": "329f74b3-45d2-40f2-a267-599f1941214e", "errorMessage": "Failed to register tile cache data store.\nCaused by: The specified GIS Server site already has a tile cache data store.", "description": "Deploy data store snapshot 20231125-020011-08-FULL from \\\\myser\\WebGISSite1701272254236\\dataStore\\a3729eb8-a53e-4ac5-88a4-d90a56801b3b", "lastModified": "2023-11-29 18:52", "status": "failed" }   In the arcgis datastore server logs:   <Msg time="2023-11-29T18:20:33,793" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Applying WebGIS DR snapshot for tile cache data store...</Msg> <Msg time="2023-11-29T18:20:37,821" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Stopping nonsql database </Msg> <Msg time="2023-11-29T18:20:37,821" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">NoSQL database was stopped </Msg> <Msg time="2023-11-29T18:33:01,1" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">prepare for tile cache data store configuration...</Msg> <Msg time="2023-11-29T18:33:01,1" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Configure vm.args...</Msg> <Msg time="2023-11-29T18:33:01,7" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Prepare default.ini...</Msg> <Msg time="2023-11-29T18:33:01,18" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Prepare SSL certificates...</Msg> <Msg time="2023-11-29T18:33:01,303" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Configure D:\arcgis\arcgisdatastore\nosqldata\etc\local.ini...</Msg> <Msg time="2023-11-29T18:33:02,335" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">configuring tile cache data store...</Msg> <Msg time="2023-11-29T18:33:04,850" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">create user usr_83dhi...</Msg> <Msg time="2023-11-29T18:33:05,884" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">create tile cache site store if needed ...</Msg> <Msg time="2023-11-29T18:33:08,350" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Register new title cache data store...</Msg> <Msg time="2023-11-29T18:33:17,834" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Performing restore on a existing tile cache data store...</Msg> <Msg time="2023-11-29T18:33:17,850" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Found backup set specified:DEFAULT_LOCAL</Msg> <Msg time="2023-11-29T18:33:17,850" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Validate storage store for the source backup store...</Msg> <Msg time="2023-11-29T18:33:17,850" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Validate source backup set...</Msg> <Msg time="2023-11-29T18:33:17,881" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">prepare for tile cache data store configuration...</Msg> <Msg time="2023-11-29T18:33:17,881" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Configure vm.args...</Msg> <Msg time="2023-11-29T18:33:17,881" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Prepare default.ini...</Msg> <Msg time="2023-11-29T18:33:17,881" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Prepare SSL certificates...</Msg> <Msg time="2023-11-29T18:33:17,991" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Configure D:\arcgis\arcgisdatastore\staging\tileCache\tcs_2jikygfh\etc\local.ini...</Msg> <Msg time="2023-11-29T18:52:43,162" type="WARNING" code="110379" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Failed to restore 'tile cache' data store. null</Msg> <Msg time="2023-11-29T18:52:43,162" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException at com.esri.arcgis.datastore.model.couchdb.CouchDBManager.restore(CouchDBManager.java:8270) at com.esri.arcgis.datastore.client.DataStoreAdminClient.b(DataStoreAdminClient.java:4857) at com.esri.arcgis.datastore.client.DataStoreAdminClient.restore(DataStoreAdminClient.java:3796) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12829) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11771) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10906) at java.base/java.lang.Thread.run(Unknown Source) </Msg> <Msg time="2023-11-29T18:52:43,162" type="SEVERE" code="111002" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Failed to import data to your replicated site. Failed to restore 'tile cache' data store. Caused by: null</Msg> <Msg time="2023-11-29T18:52:43,162" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException: Failed to restore 'tile cache' data store. Caused by: null at com.esri.arcgis.datastore.client.DataStoreAdminClient.restore(DataStoreAdminClient.java:3801) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12829) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11771) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10906) at java.base/java.lang.Thread.run(Unknown Source) </Msg> <Msg time="2023-11-29T18:52:43,162" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Stopping nonsql database </Msg> <Msg time="2023-11-29T18:52:43,162" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">NoSQL database was stopped </Msg> <Msg time="2023-11-29T18:52:48,85" type="WARNING" code="110804" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Failed to register tile cache data store. The specified GIS Server site already has a tile cache data store.</Msg> <Msg time="2023-11-29T18:52:48,85" type="DEBUG" code="9999" source="Data Store" process="9136" thread="36" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException: The specified GIS Server site already has a tile cache data store. at com.esri.arcgis.datastore.model.couchdb.CouchDBManager.registerDataStore(CouchDBManager.java:661) at com.esri.arcgis.datastore.client.DataStoreAdminClient.registerTileCacheDataStore(DataStoreAdminClient.java:13919) at com.esri.arcgis.datastore.client.DataStoreAdminClientForServer.registerDataStore(DataStoreAdminClientForServer.java:2843) at com.esri.arcgis.datastore.client.DataStoreAdminClientForServer.registerDataStore(DataStoreAdminClientForServer.java:2744) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:13026) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11771) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10906) at java.base/java.lang.Thread.run(Unknown Source) </Msg>   When this occurs, I unregister the datastores from ArcGIS Server manager and uninstall ArcGIS datastore from the VM, rename installed folder "ArcGIS", rename the "arcgisdatastore" content folder, reinstall 11.1 datastore, do not configure it, and try a manual restore using "restoredatastore" but it fails as mentionned before. Also, it seems to me that the error:   Failed to register tile cache data store. The specified GIS Server site already has a tile cache data store.   is misleading because it occurs after the following error and I don't think it is the root cause of the restore failing:   Failed to restore 'tile cache' data store. null   I also tried the following workflow: - Initializing new VMs from scratch - Installing and configuring ArcGIS Enterprise 11.0 components on each VM using ArcGIS powershell DSC as if it was prod - At the end, the standby ArcGIS Enterprise 11.0 deployment is functionnal - Restore the last 11.0 webgisdr backup done from production. At the time "REPLICATION_BACKUP" was the default - At the end, webgisdr restore work fine and my 11.0 deployment is perfectely. So I guess we can exclude an issue with my workflow as it works perfectely at 11.0 - Upgrade deployment to 11.1 - Restore 11.1 webgisdr done from production with tileCache backup configured as "REPLICATION_BACKUP" After that, relational datastore is successfully restored but the tileCache one fails with the same error as with "restoredatastore" command:   <Msg time="2023-12-01T12:21:24,172" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Applying WebGIS DR snapshot for tile cache data store...</Msg> <Msg time="2023-12-01T12:21:24,277" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Performing restore on a existing tile cache data store...</Msg> <Msg time="2023-12-01T12:21:24,326" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Found backup set specified:DEFAULT_LOCAL</Msg> <Msg time="2023-12-01T12:21:24,326" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Validate storage store for the source backup store...</Msg> <Msg time="2023-12-01T12:21:24,326" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Validate source backup set...</Msg> <Msg time="2023-12-01T12:21:24,421" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Failed to cleanup the staging directory for tilecache data store...</Msg> <Msg time="2023-12-01T12:21:24,421" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">prepare for tile cache data store configuration...</Msg> <Msg time="2023-12-01T12:21:24,421" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Configure vm.args...</Msg> <Msg time="2023-12-01T12:21:24,433" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Prepare default.ini...</Msg> <Msg time="2023-12-01T12:21:24,433" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Prepare SSL certificates...</Msg> <Msg time="2023-12-01T12:21:24,792" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Configure D:\arcgis\arcgisdatastore\staging\tileCache\tcs_2jikygfh\etc\local.ini...</Msg> <Msg time="2023-12-01T12:26:02,844" type="WARNING" code="110379" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Failed to restore 'tile cache' data store. null</Msg> <Msg time="2023-12-01T12:26:02,844" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException at com.esri.arcgis.datastore.model.couchdb.CouchDBManager.restore(CouchDBManager.java:8270) at com.esri.arcgis.datastore.client.DataStoreAdminClient.b(DataStoreAdminClient.java:4857) at com.esri.arcgis.datastore.client.DataStoreAdminClient.restore(DataStoreAdminClient.java:3796) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12829) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11771) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10906) at java.base/java.lang.Thread.run(Unknown Source) </Msg> <Msg time="2023-12-01T12:26:02,844" type="SEVERE" code="111002" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">Failed to import data to your replicated site. Failed to restore 'tile cache' data store. Caused by: null</Msg> <Msg time="2023-12-01T12:26:02,844" type="DEBUG" code="9999" source="Data Store" process="1152" thread="32" methodName="" machine="GISSTORE.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException: Failed to restore 'tile cache' data store. Caused by: null at com.esri.arcgis.datastore.client.DataStoreAdminClient.restore(DataStoreAdminClient.java:3801) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12829) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11771) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10906) at java.base/java.lang.Thread.run(Unknown Source) </Msg>   Could you please help ? What do you think could be the issue ? Should I open another ticket ? Thanks, Nicolas ... View more

On my side, upgrade went smoothly but I noticed the following one (so far): https://community.esri.com/t5/arcgis-enterprise-questions/arcgis-enterprise-11-2-item-settings-for/m-p/1353176#M37757 ... View more

@ChristopherPawlyszyn Thanks for your reply. This is from a webgisdr restore. I just tried once again. Here is the full error stack from datastore server log in case that help:   <Msg time="2023-11-07T23:57:22,616" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Applying WebGIS DR snapshot for tile cache data store...</Msg> <Msg time="2023-11-07T23:57:24,878" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Stopping nonsql database </Msg> <Msg time="2023-11-07T23:57:24,880" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">NoSQL database was stopped </Msg> <Msg time="2023-11-07T23:57:31,995" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">prepare for tile cache data store configuration...</Msg> <Msg time="2023-11-07T23:57:31,995" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Configure vm.args...</Msg> <Msg time="2023-11-07T23:57:31,999" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Prepare default.ini...</Msg> <Msg time="2023-11-07T23:57:32,1" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Prepare SSL certificates...</Msg> <Msg time="2023-11-07T23:57:32,160" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Configure C:\arcgisdatastore\nosqldata\etc\local.ini...</Msg> <Msg time="2023-11-07T23:57:33,167" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">configuring tile cache data store...</Msg> <Msg time="2023-11-07T23:57:35,653" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">create user usr_t9v56...</Msg> <Msg time="2023-11-07T23:57:36,681" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">create tile cache site store if needed ...</Msg> <Msg time="2023-11-07T23:57:36,791" type="WARNING" code="110326" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Backup location '{0}' is not owned by the current data store. Backup location 'C:\arcgisdatastore\backup\tilecache' is already owned by another data store 'tcs_ksvff8l8'.</Msg> <Msg time="2023-11-07T23:57:36,791" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException: Backup location 'C:\arcgisdatastore\backup\tilecache' is already owned by another data store 'tcs_ksvff8l8'. at com.esri.arcgis.datastore.model.backup.BackupSignature.signBackupFolder(BackupSignature.java:85) at com.esri.arcgis.datastore.model.couchdb.CouchDBManager.configure(CouchDBManager.java:497) at com.esri.arcgis.datastore.client.DataStoreAdminClient.configCouchDB(DataStoreAdminClient.java:13915) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12721) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11789) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10924) at java.base/java.lang.Thread.run(Unknown Source) </Msg> <Msg time="2023-11-07T23:57:39,101" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Register new title cache data store...</Msg> <Msg time="2023-11-07T23:57:47,820" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Register a default backup location for tile cache data store...</Msg> <Msg time="2023-11-07T23:57:47,820" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">New Backup Location will be: E:/backup/tileCache/</Msg> <Msg time="2023-11-07T23:57:47,820" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">creating backup store for tile cache data store....</Msg> <Msg time="2023-11-07T23:57:47,833" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">prepare file based repository provider for tile cache data store...</Msg> <Msg time="2023-11-07T23:57:47,834" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">prepare file based repository provider for tile cache data store on local machine...</Msg> <Msg time="2023-11-07T23:57:47,868" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">configuring repository for the backup store...</Msg> <Msg time="2023-11-07T23:57:47,893" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Digital sign the backup store...</Msg> <Msg time="2023-11-07T23:57:48,253" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">prepare for tile cache data store configuration...</Msg> <Msg time="2023-11-07T23:57:48,254" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Configure vm.args...</Msg> <Msg time="2023-11-07T23:57:48,257" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Prepare default.ini...</Msg> <Msg time="2023-11-07T23:57:48,259" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Prepare SSL certificates...</Msg> <Msg time="2023-11-07T23:57:48,478" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Configure C:\arcgisdatastore\staging\tileCache\tcs_dyv65252\etc\local.ini...</Msg> <Msg time="2023-11-07T23:58:05,243" type="DEBUG" code="110616" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Webhooks database for site 'd3e74a59-4154-43a2-a5a9-cc0f5dcfdf4b' is not created and registered.</Msg> <Msg time="2023-11-07T23:58:50,951" type="SEVERE" code="111002" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Failed to import data to your replicated site. null</Msg> <Msg time="2023-11-07T23:58:50,951" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException at com.esri.arcgis.datastore.model.couchdb.CouchDBManager.restore(CouchDBManager.java:8270) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12934) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11789) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10924) at java.base/java.lang.Thread.run(Unknown Source) </Msg> <Msg time="2023-11-07T23:58:50,952" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Stopping nonsql database </Msg> <Msg time="2023-11-07T23:58:50,954" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">NoSQL database was stopped </Msg> <Msg time="2023-11-07T23:58:53,161" type="WARNING" code="110804" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Failed to register tile cache data store. The specified GIS Server site already has a tile cache data store.</Msg> <Msg time="2023-11-07T23:58:53,161" type="DEBUG" code="9999" source="Data Store" process="9940" thread="25" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException: The specified GIS Server site already has a tile cache data store. at com.esri.arcgis.datastore.model.couchdb.CouchDBManager.registerDataStore(CouchDBManager.java:661) at com.esri.arcgis.datastore.client.DataStoreAdminClient.registerTileCacheDataStore(DataStoreAdminClient.java:13937) at com.esri.arcgis.datastore.client.DataStoreAdminClientForServer.registerDataStore(DataStoreAdminClientForServer.java:2856) at com.esri.arcgis.datastore.client.DataStoreAdminClientForServer.registerDataStore(DataStoreAdminClientForServer.java:2757) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:13044) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11789) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10924) at java.base/java.lang.Thread.run(Unknown Source) </Msg>   In couch log, no error though.   ... View more

Thanks for your reply @ChristopherPawlyszyn. I modified the correct file (I was indeed using from the site-specific location), and tried 4 times: always the same error: { "jobId": "fcfdaa47-d8fd-4993-b292-69cdd3386abc", "errorMessage": "Failed to register tile cache data store.\nCaused by: The specified GIS Server site already has a tile cache data store.", "description": "Deploy data store snapshot 20231101-210033-97-BACKUP from \\\\pathto\\WebGISSite1698922766136\\dataStore\\be7a1844-1f26-4faa-97b9-5b69dd2dec6f", "lastModified": "2023-11-02 12:06", "status": "failed" } From a datastore server log:   <Msg time="2023-11-01T22:01:19,873" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Successfully restored and registered Primary relational machine...</Msg> <Msg time="2023-11-01T22:01:20,820" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Successfully applied WebGIS DR snapshot for relational data store...</Msg> <Msg time="2023-11-01T22:01:29,226" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Deploying files from WebGIS DR snapshot for tile cache data store...</Msg> <Msg time="2023-11-01T22:01:56,407" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Applying WebGIS DR snapshot for tile cache data store...</Msg> <Msg time="2023-11-01T22:01:56,463" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Performing restore on a existing tile cache data store...</Msg> <Msg time="2023-11-01T22:01:56,484" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Found backup set specified:DEFAULT_LOCAL</Msg> <Msg time="2023-11-01T22:01:56,484" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Validate storage store for the source backup store...</Msg> <Msg time="2023-11-01T22:01:56,484" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Validate source backup set...</Msg> <Msg time="2023-11-01T22:01:56,546" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">prepare for tile cache data store configuration...</Msg> <Msg time="2023-11-01T22:01:56,546" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Configure vm.args...</Msg> <Msg time="2023-11-01T22:01:56,550" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Prepare default.ini...</Msg> <Msg time="2023-11-01T22:01:56,552" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Prepare SSL certificates...</Msg> <Msg time="2023-11-01T22:01:56,736" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Configure C:\arcgisdatastore\staging\tileCache\tcs_dyv65252\etc\local.ini...</Msg> <Msg time="2023-11-01T22:02:32,159" type="WARNING" code="110379" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Failed to restore 'tile cache' data store. null</Msg> <Msg time="2023-11-01T22:02:32,159" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException at com.esri.arcgis.datastore.model.couchdb.CouchDBManager.restore(CouchDBManager.java:8270) at com.esri.arcgis.datastore.client.DataStoreAdminClient.b(DataStoreAdminClient.java:4875) at com.esri.arcgis.datastore.client.DataStoreAdminClient.restore(DataStoreAdminClient.java:3814) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12847) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11789) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10924) at java.base/java.lang.Thread.run(Unknown Source) </Msg> <Msg time="2023-11-01T22:02:32,159" type="SEVERE" code="111002" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">Failed to import data to your replicated site. Failed to restore 'tile cache' data store. Caused by: null</Msg> <Msg time="2023-11-01T22:02:32,160" type="DEBUG" code="9999" source="Data Store" process="24840" thread="19" methodName="" machine="MAPS11.COMPANY.COM" user="" elapsed="" requestID="">com.esri.arcgis.datastore.common.DataStoreException: Failed to restore 'tile cache' data store. Caused by: null at com.esri.arcgis.datastore.client.DataStoreAdminClient.restore(DataStoreAdminClient.java:3819) at com.esri.arcgis.datastore.client.DataStoreAdminClient.a(DataStoreAdminClient.java:12847) at com.esri.arcgis.datastore.client.DataStoreAdminClient.deployWebGISSnapshot(DataStoreAdminClient.java:11789) at com.esri.arcgis.datastore.client.DataStoreAdminClient$e.run(DataStoreAdminClient$e.java:10924) at java.base/java.lang.Thread.run(Unknown Source) </Msg>   Any idea ?   Thanks, Nicolas     ... View more

Many thanks @ChristopherPawlyszyn  for your reply. there is a defect in the new backup/restore logic implemented for the tile cache data store at 11.1 for scene services published at an earlier version In case that help, as mentionned in my first post, in my case, the problem also occurs for sceneLayers published directly at 11.1: Publishing a new scene layer on the production tile cache datastore and restoring it fails as well (it is not restriceted to all scene layers published from previous versions) I just tried your workaround on one of our ArcGIS Enterprise deployment, and the issue remains. I tried updating the datastore configuration on the standby environment as well , but it did not change the result. I tried inspecting files in the webgisdr backup, and tile cache datastores look pretty similar. How can I tell whether webgisdr was exported with "REPLICATION_BACKUP" or "DIRECT_FILE_BACKUP" ? Thanks ... View more

Hello @ChristopherPawlyszyn, I continue my investigations and wanted to report the following facts:  - After authenticating on couchDB, I can see that all our nosql "databases" are empty (size 0 bytes) and made of 0 documents: thus the 404 couchDB error. - I activated couchDB debug log when doing the webgisdr restore and it turns out I have plenty of errors 409 conflict like the following:   [debug] 2023-10-26T13:18:36.924000Z [email protected] <0.2262.0> 7e7d7f7d69 'PUT' /_dbs/ext_site_callout_0_d0d73bef0979452a9660097f2df37359 {1,1} from '[email protected]' Headers: [{'Accept-Encoding',"gzip,deflate"},{'Connection',"Keep-Alive"},{'Content-Length',"187"},{'Content-Type',"application/json"},{'Cookie',"AuthSession=ItsASecret"},{'Host',"MYHOST.COMPANY.COM:29080"},{'User-Agent',"Apache-HttpClient/4.5.13 (Java/11.0.18)"}] [debug] 2023-10-26T13:18:36.925000Z [email protected] <0.2262.0> 7e7d7f7d69 timeout 600 [debug] 2023-10-26T13:18:36.925000Z [email protected] <0.2262.0> 7e7d7f7d69 Successful cookie auth as: "admin_u92a8" [debug] 2023-10-26T13:18:36.926000Z [email protected] <0.2262.0> 7e7d7f7d69 Minor error in HTTP request: conflict [debug] 2023-10-26T13:18:36.926000Z [email protected] <0.2262.0> 7e7d7f7d69 Stacktrace: [{couch_db,update_doc,4,[{file,"src/couch_db.erl"},{line,839}]},{couch_httpd_db,update_doc,6,[{file,"src/couch_httpd_db.erl"},{line,780}]},{couch_httpd_db,do_db_req,2,[{file,"src/couch_httpd_db.erl"},{line,261}]},{couch_httpd,handle_request_int,5,[{file,"src/couch_httpd.erl"},{line,339}]},{erpc,execute_call,3,[{file,"erpc.erl"},{line,434}]},{erpc,call,5,[{file,"erpc.erl"},{line,117}]},{rpc,call,5,[{file,"rpc.erl"},{line,410}]},{chttpd_node,call_node,4,[{file,"src/chttpd_node.erl"},{line,218}]}]   Looking at couchDB documentation: https://docs.couchdb.org/en/stable/api/document/attachments.html#put--db-docid-attname   409 Conflict – Document’s revision wasn’t specified or it’s not the latest    Any progress on your side ?  Thanks, Nicolas   ... View more

Yes, there is "ArcGIS Data Store 10.9.1 Durability Enhancement Patch": https://support.esri.com/en-us/patches-updates/2022/arcgis-data-store-10-9-1-durability-enhancement-patch-8057 ... View more