topic Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time! in ArcGIS Enterprise Portal Questions

WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

David_Brooks — Mon, 04 Mar 2024 14:00:55 GMT

Just a warning to all portal admins looking to run the Portal for ArcGIS Validation and Repair tool. It takes a VERY long time. Ours has been running for 4 hours so far, and it's rolled back 4 of 7 patches so far. Will update once complete.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

DamianoMontrasio — Thu, 07 Mar 2024 06:34:12 GMT

After about 9 hours on production system...

Any suggestion?

Portal and rest services remains up & running...

Thanks in advance!

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

AmandaDeMedeiros — Thu, 07 Mar 2024 18:43:50 GMT

What the tool is doing is identifying your patches for the broken one, and then it deletes the old patches and reapplies. If this is a production environment, I would recommend doing this during off hours. You could also check if the anti-virus is targeting ArcGIS Enterprise folders.

Exclude the following from your Anti-virus (default locations):

1. C:\arcgisdatastore

2. C:\arcgisportal

3. C:\arcgisserver

4. C:\Program Files\ArcGIS\DataStore

5. C:\Program Files\ArcGIS\Portal

6. C:\Program Files\ArcGIS\Server

7. C:\Python27

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

DamianoMontrasio — Thu, 07 Mar 2024 20:01:06 GMT

Thanks Amanda,

It'secure now to kill the process? Now is 24 hour "running"...

This is a 24/7 service that require particular time windows for patching.

Thanks

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

David_Brooks — Fri, 08 Mar 2024 10:56:09 GMT

as @AmandaDeMedeiros says, we triangulated the issue to anti-virus (windows defender) on our Azure system. We now have a policy in place to pause anti-virus during a significant patching procedure such as this one.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

DamianoMontrasio — Fri, 08 Mar 2024 12:08:06 GMT

Mybe is useful for others...

Validation and Repair Tools write a Log in this path C:\Users\XXXXXXUSER-O\AppData\Local\Temp (or subfolder) named "PortalforArcGIS1091ValidationAndRepair.log"

With this I see that process is in standby at 3-6-2024 22:19:27.

================================================================================
Portal for ArcGIS 10.9.1 Validation and Repair Log
DATE=3-6-2024
TIME=22:19:02
Log File Location=C:\Users\XXXXXXUSER-O\AppData\Local\Temp\PortalforArcGIS1091ValidationAndRepair.log
================================================================================

----------------------------------------------------------------------------
3-6-2024 22:19:02 (IS) CheckCommandLine - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:02 (IS) Command Line(s): - NONE

----------------------------------------------------------------------------
3-6-2024 22:19:02 (IS) CheckCommandLine - End
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:03 (IS) VerifyPortalVersionInstalled - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:03 (IS) VerifyPortalVersionInstalled - Installed: Portal for ArcGIS 10.9.1

----------------------------------------------------------------------------
3-6-2024 22:19:03 (IS) VerifyPortalVersionInstalled - End
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 Enterprise Sites Security Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000006081 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000006002 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000006079 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005984 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2023 Update 1 Patch B is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2023 Update 1 Patch is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005869 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 Enterprise Sites Footer Display Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2022 Update 2 Patch B is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2022 Update 2 Patch is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005867 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 QuickCapture Security Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005774 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2022 Update 1 Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Log4j Patch B is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Log4j Patch is Not Installed

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) GetListOfInstalledPatchesAndHotfixes - End
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) RemoveInstalledPatchesAndHotfixes - Begin
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) CreateInProgressRegistry - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:27 (IS) CreateInProgressRegistry - Created RegKey: HKLM\SOFTWARE\ESRI\Portal for ArcGIS\Updates\_10.9.1.999
3-6-2024 22:19:27 (IS) CreateInProgressRegistry - Created Reg Key Name with value: InProgress=1

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) CreateInProgressRegistry - End
----------------------------------------------------------------------------

3-6-2024 22:19:27 (IS) RemoveInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 Enterprise Sites Security Patch will be uninstalled.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

EricKrause01 — Thu, 21 Mar 2024 00:23:25 GMT

Damiano,

Did you have any luck getting these patches uninstalled? I noticed it's not really doing anything on my server for a long time. I have uninstalled antivirus. Thanks.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

DamianoMontrasio — Thu, 21 Mar 2024 08:19:19 GMT

Hi Eric,

I suspended the activity for the moment because of 24/7 production system.

But if you search the log maybe you can evaluate if setups is running or not.

I've killed the task after a few days of inactivity.

Esri Support suggests me also to activate Portal Log at the debug level during patching. But I haven't tried yet.

Tell me about your result.

Bye

Damiano

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

EricKrause01 — Thu, 21 Mar 2024 12:29:42 GMT

Thanks for the response, Damiano. I cancelled the Validation and Repair Tool as well and submitted a case to Esri. I hope they have something useful to contribute. The largest maintenance window that we can get is probably a weekend, but I'm not convinced that the Tool was actually doing anything. Task Manager and Resource Monitor showed virtually no activity. It's wild that this seems to be their solution...

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

ManojK — Fri, 22 Mar 2024 20:01:28 GMT

Please reply to this thread if you hear anything from ESRI. I actually started the repair tool wizard which showed 23 patches to uninstall and terminated it after 1 hr after realizing that its taking too long for just one patch to uninstall. Ofcourse, ESRI mentioned about 10.8.1 taking too long but wonder if its actually doing anything as there was no progress seen.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

sahook1 — Thu, 28 Mar 2024 14:05:41 GMT

Hi Manoj, I am here to see the feedback for 10.8.1, Did you repaired your portal? If yes, any issues during the process or anything we need to consider during the validation and repair?

Your input would be very helpful for me, thanks in advance.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

EricKrause01 — Thu, 28 Mar 2024 16:00:02 GMT

Just FYI, I will be attempting to run 10.8.1 and 10.9.1. Validation and Repair tools starting tonight at EOB. I plan to let them run through Easter Sunday. If they have not succeeded at that point, I will be rolling them back using a VM Snapshot. I'm less than impressed with Esri's response at this point. Support doesn't seem to know how long these tools should take to run.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

sahook1 — Fri, 29 Mar 2024 09:10:08 GMT

Thanks Eric for the Update, Please let us know your observations during the entire process, It will be very helpful for us.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

StephenM01 — Fri, 29 Mar 2024 16:58:10 GMT

I ran this tool yesterday and for a while it didn't look like it was doing anything. I found this thread when researching to see if it was expected behavior or if anyone reported similar experiences.

I let the tool run and the first progress was shown after a little over 2 hours when the first patch was uninstalled. The tool completed successfully after about 12 hours. For context, this was a single-machine deployment of 10.9.1 and the tool uninstalled 8 patches.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

AngelaYan1720 — Sat, 30 Mar 2024 04:30:32 GMT

Just FYI, I ran the tool on a single machine deployment of 10.9.1 for 24 hours. It was stuck at uninstalling 2nd of the 7 patches. I restarted the machine and tried again, and now it says there are 5 more patches to uninstall. I may have to roll back using a VM Snapshot if still no progress overnight.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

EricKrause01 — Mon, 01 Apr 2024 12:17:39 GMT

My experience for 10.8.1 and 10.9.1 were quite different.

For my 10.9.1 single machine installation, it had to remove 7 patches and took approximately 4 hours.

For my 10.8.1 single machine installation, it had to remove 15 patches.

It took 2.5 hours to uninstall "Portal for ArcGIS Security 2023 Update 1 Patch B" At that point, the machine rebooted itself. I restarted the process.

It then took an additional 2.5 hours to uninstall "Portal for ArcGIS Security 2023 Update 1 Patch A" and rebooted the server yet again. I restarted the process.

It took about 1.5 hours to uninstall "Portal for ArcGIS Security 2022 Update 2 Patch" and rebooted the server again. I restarted the process.

Finally, it took about 7 hours to uninstall the remaining patches (no further automatic reboots).

The overall time for 10.8.1 was 13.5 hours.

Then, the revised patches had to be installed. It took about 1.25 hours to install the patches on 10.9.1. It took 4.25 hours to install the patches on 10.8.1. No complaints from users on this Monday morning yet...

Hope this helps someone with understanding how long of a patching window to plan for.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

DamianoMontrasio — Fri, 05 Apr 2024 06:49:36 GMT

Hi.

Last night we have planned a new patching after the first one on March 6

For 10.9.1 I've notice a new file for Validation tool:

And yesterday patch to remove was 6 compared to 7 on the first patching.

Nov, after about 10 hours there's no activity apparently.

@esri can I be assured that one patch has actually been removed? Do I terminate the application and re-run the validation tool to see if the patches to be removed are down to 5?

I'm still waiting, but if anyone has suggestions.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

LaurensKusse_hhdelfland — Sat, 06 Apr 2024 14:45:02 GMT

Here is my journey with the Repair and Validation tool on 10.8.1.

In the attached file you'll see the time it took to remove the patches and how long it took before it failed to remove some patches.

Although it's not logged (probably because of the reboots), but the first five runs did end with the successful removal of the last patch mentioned.
At every run, except the first, it failed to remove some patches.

After run 6 the tool exited with the message that all defective patches were removed and I could update the system again. But after starting the tool again, the tool said the defective patch "ArcGIS Enterprise Sites Security Patch A" is installed, although it isn't. The tool still shows the three patches that could not be removed:
Portal for ArcGIS Security 2022 Update 2 Patch
Portal for ArcGIS QuickCapture Security Patch
Portal for ArcGIS 10.8.1 ArcGIS Workforce General Patch B

During run 7 the ArcGIS QuickCapture patch was removed (it failed to be removed every other time I ran the tool). The other two patches failed to be removed.
During run 8 there were just two patches left, but they kept failing to be removed.

In a different logfile than the one indicated by Esri, I saw this message:
Error 1706. No valid source could be found for product Portal for ArcGIS 10.8.1. The Windows Installer cannot continue.

So I think I'll wait for more info on this from Esri Support.
I want to upgrade to 10.9.1, but I'm not sure if that is a possibility now that I have two patches that apparently can't be removed.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

ManojK5 — Thu, 11 Apr 2024 17:14:14 GMT

Hello @sahook1 , I will attempt to run the validation repair tool tomorrow and then provide my inputs. After seeing this thread, my guess is that it might take a while to uninstall all those patches and I have like 22 of them. I would have to uninstall these . so, I can plan to upgrade my application to 10.9.1 without much issues.

Re: WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

LaurensKusse_hhdelfland — Mon, 15 Apr 2024 08:33:07 GMT

My issues with patches not being removed, were resolved by putting the original installation files in the directory where they were, when I installed Portal for ArcGIS. That is the directory where the files are extracted to when you run the executable. The default is C:\Users\{username}\Documents\ArcGIS 10.8.1

Apparently some file are needed when removing some of the patches.