nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

WARNING: Portal for ArcGIS Validation and Repair Process takes a long time!

David_Brooks

Just a warning to all portal admins looking to run the Portal for ArcGIS Validation and Repair tool. It takes a VERY long time. Ours has been running for 4 hours so far, and it's rolled back 4 of 7 patches so far. Will update once complete.

Encontre mais publicações marcadas com

Administration

Accepted answers

All comments

DamianoMontrasio

After about 9 hours on production system...

Any suggestion?

Portal and rest services remains up & running...

Thanks in advance!

AmandaDeMedeiros

What the tool is doing is identifying your patches for the broken one, and then it deletes the old patches and reapplies. If this is a production environment, I would recommend doing this during off hours. You could also check if the anti-virus is targeting ArcGIS Enterprise folders.

Exclude the following from your Anti-virus (default locations):

1. C:\arcgisdatastore

2. C:\arcgisportal

3. C:\arcgisserver

4. C:\Program Files\ArcGIS\DataStore

5. C:\Program Files\ArcGIS\Portal

6. C:\Program Files\ArcGIS\Server

7. C:\Python27

DamianoMontrasio

Thanks Amanda,

It'secure now to kill the process? Now is 24 hour "running"...

This is a 24/7 service that require particular time windows for patching.

Thanks

David_Brooks

as @AmandaDeMedeiros says, we triangulated the issue to anti-virus (windows defender) on our Azure system. We now have a policy in place to pause anti-virus during a significant patching procedure such as this one.

DamianoMontrasio

Mybe is useful for others...

Validation and Repair Tools write a Log in this path C:\Users\XXXXXXUSER-O\AppData\Local\Temp (or subfolder) named "PortalforArcGIS1091ValidationAndRepair.log"

With this I see that process is in standby at 3-6-2024 22:19:27.

================================================================================
Portal for ArcGIS 10.9.1 Validation and Repair Log
DATE=3-6-2024
TIME=22:19:02
Log File Location=C:\Users\XXXXXXUSER-O\AppData\Local\Temp\PortalforArcGIS1091ValidationAndRepair.log
================================================================================

----------------------------------------------------------------------------
3-6-2024 22:19:02 (IS) CheckCommandLine - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:02 (IS) Command Line(s): - NONE

----------------------------------------------------------------------------
3-6-2024 22:19:02 (IS) CheckCommandLine - End
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:03 (IS) VerifyPortalVersionInstalled - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:03 (IS) VerifyPortalVersionInstalled - Installed: Portal for ArcGIS 10.9.1

----------------------------------------------------------------------------
3-6-2024 22:19:03 (IS) VerifyPortalVersionInstalled - End
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 Enterprise Sites Security Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000006081 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000006002 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000006079 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005984 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2023 Update 1 Patch B is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2023 Update 1 Patch is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005869 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 Enterprise Sites Footer Display Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2022 Update 2 Patch B is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2022 Update 2 Patch is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005867 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 QuickCapture Security Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - PFA-1091-HF-000005774 is Not Installed

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Security 2022 Update 1 Patch is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Log4j Patch B is ****INSTALLED****

3-6-2024 22:19:14 (IS) GetListOfInstalledPatchesAndHotfixes - Portal for ArcGIS Log4j Patch is Not Installed

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) GetListOfInstalledPatchesAndHotfixes - End
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) RemoveInstalledPatchesAndHotfixes - Begin
----------------------------------------------------------------------------

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) CreateInProgressRegistry - Begin
----------------------------------------------------------------------------

3-6-2024 22:19:27 (IS) CreateInProgressRegistry - Created RegKey: HKLM\SOFTWARE\ESRI\Portal for ArcGIS\Updates\_10.9.1.999
3-6-2024 22:19:27 (IS) CreateInProgressRegistry - Created Reg Key Name with value: InProgress=1

----------------------------------------------------------------------------
3-6-2024 22:19:27 (IS) CreateInProgressRegistry - End
----------------------------------------------------------------------------

3-6-2024 22:19:27 (IS) RemoveInstalledPatchesAndHotfixes - Portal for ArcGIS 10.9.1 Enterprise Sites Security Patch will be uninstalled.

EricKrause01

Damiano,

Did you have any luck getting these patches uninstalled? I noticed it's not really doing anything on my server for a long time. I have uninstalled antivirus. Thanks.

DamianoMontrasio

Hi Eric,

I suspended the activity for the moment because of 24/7 production system.

But if you search the log maybe you can evaluate if setups is running or not.

I've killed the task after a few days of inactivity.

Esri Support suggests me also to activate Portal Log at the debug level during patching. But I haven't tried yet.

Tell me about your result.

Bye

Damiano

EricKrause01

Thanks for the response, Damiano. I cancelled the Validation and Repair Tool as well and submitted a case to Esri. I hope they have something useful to contribute. The largest maintenance window that we can get is probably a weekend, but I'm not convinced that the Tool was actually doing anything. Task Manager and Resource Monitor showed virtually no activity. It's wild that this seems to be their solution...

EricKrause01

Just FYI, I will be attempting to run 10.8.1 and 10.9.1. Validation and Repair tools starting tonight at EOB. I plan to let them run through Easter Sunday. If they have not succeeded at that point, I will be rolling them back using a VM Snapshot. I'm less than impressed with Esri's response at this point. Support doesn't seem to know how long these tools should take to run.

sahook1

Thanks Eric for the Update, Please let us know your observations during the entire process, It will be very helpful for us.

StephenM01

I ran this tool yesterday and for a while it didn't look like it was doing anything. I found this thread when researching to see if it was expected behavior or if anyone reported similar experiences.

I let the tool run and the first progress was shown after a little over 2 hours when the first patch was uninstalled. The tool completed successfully after about 12 hours. For context, this was a single-machine deployment of 10.9.1 and the tool uninstalled 8 patches.

AngelaYan1720

Just FYI, I ran the tool on a single machine deployment of 10.9.1 for 24 hours. It was stuck at uninstalling 2nd of the 7 patches. I restarted the machine and tried again, and now it says there are 5 more patches to uninstall. I may have to roll back using a VM Snapshot if still no progress overnight.

EricKrause01

My experience for 10.8.1 and 10.9.1 were quite different.

For my 10.9.1 single machine installation, it had to remove 7 patches and took approximately 4 hours.

For my 10.8.1 single machine installation, it had to remove 15 patches.

It took 2.5 hours to uninstall "Portal for ArcGIS Security 2023 Update 1 Patch B" At that point, the machine rebooted itself. I restarted the process.

It then took an additional 2.5 hours to uninstall "Portal for ArcGIS Security 2023 Update 1 Patch A" and rebooted the server yet again. I restarted the process.

It took about 1.5 hours to uninstall "Portal for ArcGIS Security 2022 Update 2 Patch" and rebooted the server again. I restarted the process.

Finally, it took about 7 hours to uninstall the remaining patches (no further automatic reboots).

The overall time for 10.8.1 was 13.5 hours.

Then, the revised patches had to be installed. It took about 1.25 hours to install the patches on 10.9.1. It took 4.25 hours to install the patches on 10.8.1. No complaints from users on this Monday morning yet...

Hope this helps someone with understanding how long of a patching window to plan for.

DamianoMontrasio

Hi.

Last night we have planned a new patching after the first one on March 6

For 10.9.1 I've notice a new file for Validation tool:

And yesterday patch to remove was 6 compared to 7 on the first patching.

Nov, after about 10 hours there's no activity apparently.

@esri can I be assured that one patch has actually been removed? Do I terminate the application and re-run the validation tool to see if the patches to be removed are down to 5?

I'm still waiting, but if anyone has suggestions.

LaurensKusse_hhdelfland

Here is my journey with the Repair and Validation tool on 10.8.1.

In the attached file you'll see the time it took to remove the patches and how long it took before it failed to remove some patches.

Although it's not logged (probably because of the reboots), but the first five runs did end with the successful removal of the last patch mentioned.
At every run, except the first, it failed to remove some patches.

After run 6 the tool exited with the message that all defective patches were removed and I could update the system again. But after starting the tool again, the tool said the defective patch "ArcGIS Enterprise Sites Security Patch A" is installed, although it isn't. The tool still shows the three patches that could not be removed:
Portal for ArcGIS Security 2022 Update 2 Patch
Portal for ArcGIS QuickCapture Security Patch
Portal for ArcGIS 10.8.1 ArcGIS Workforce General Patch B

During run 7 the ArcGIS QuickCapture patch was removed (it failed to be removed every other time I ran the tool). The other two patches failed to be removed.
During run 8 there were just two patches left, but they kept failing to be removed.

In a different logfile than the one indicated by Esri, I saw this message:
Error 1706. No valid source could be found for product Portal for ArcGIS 10.8.1. The Windows Installer cannot continue.

So I think I'll wait for more info on this from Esri Support.
I want to upgrade to 10.9.1, but I'm not sure if that is a possibility now that I have two patches that apparently can't be removed.

PortalRepairTool1081LogSummary.txt

LaurensKusse_hhdelfland

My issues with patches not being removed, were resolved by putting the original installation files in the directory where they were, when I installed Portal for ArcGIS. That is the directory where the files are extracted to when you run the executable. The default is C:\Users\{username}\Documents\ArcGIS 10.8.1

Apparently some file are needed when removing some of the patches.

DevinBartley2

Thanks for these tips. We are running ArcGIS Enterprise 10.8.1 on Azure and we excluded these folders from the anti-virus while the patch remover tool and updates were running and then re-enabled after.

Took about 4-5 hours after hours to run the patch remover.

Glad I read about all of this first.

Jared_Yost

Did you happen to get a response from ESRI? We just had a similar experience with the same files remaining stuck.

KaseyCox

Hi @EricKrause01, do you recall if you re-installed patches released prior to 12/2023? After running Validate and Repair, the Patch Notification tool shows 7 Available Updates, 5 of which were released prior to 12/2023 (earilest released 7/2021).

MTQDDES

We are experimenting the sames issues as you rigth now. Adding exclusion doesnt seem to help... @AmandaDeMedeiros what kind of politics did you implemente on azure ? @David_Brooks I'm only able to desactivate it 20 minutes ... and we can't control when it is applied by microsoft...

Participe da Conversa

Membros conectados podem postar, seguir atualizações e mais. Novo aqui? Registre uma conta gratuita.

Links Rápidos

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.