Portal for ArcGIS walarchive

2398
8
Jump to solution
10-05-2018 02:04 AM
Highlighted
New Contributor III

Hi there,

So, asking for a friend, in the install directory for Portal there's a folder under <install dir>\backup\walarchive\ which seems to contain a backup file for every hour since it was installed.  They've run out of disk space (each file is 16Mb, there's thousands of them), and it's now breaking their portal.  So questions are (a) what is this backing up as there's a separate walarchive for the data store (i.e. it's not this one) and (b) how do you manage that backup?  I've seen some stuff on managing the backup of the data store, but that doesn't seem to affect this backup?

I'm guessing it's ok to delete the older ones, but they would prefer no to have to keep going back to them over and over again...

Many thanks in advance

Dan

Tags (3)
Reply
0 Kudos
1 Solution

Accepted Solutions
Highlighted
Esri Frequent Contributor

Those files exist to support incremental backups with the DR tool. Prior to running the DR tool to create a full backup, the directory is capped at 5 GB. Once you run the DR tool, that limit is removed. If you run the DR tool to create a new full backup, the directory will be cleaned out. We incorrectly assumed customers would run the DR tool at scheduled times, which would manage the size of the directory. Once the space is cleared up and Portal is back to working order, you can either run the DR tool on a scheduled task to create backups (recommended), or, if you're not going to run incremental backups, delete the backups manually.

View solution in original post

8 Replies
Highlighted
Esri Frequent Contributor

Those files exist to support incremental backups with the DR tool. Prior to running the DR tool to create a full backup, the directory is capped at 5 GB. Once you run the DR tool, that limit is removed. If you run the DR tool to create a new full backup, the directory will be cleaned out. We incorrectly assumed customers would run the DR tool at scheduled times, which would manage the size of the directory. Once the space is cleared up and Portal is back to working order, you can either run the DR tool on a scheduled task to create backups (recommended), or, if you're not going to run incremental backups, delete the backups manually.

View solution in original post

Highlighted
by MVP
MVP

Hi Jonathan Quinn‌,

We have a situation where we are running weekly full backups (using webgisdr) and daily incrementals, but the C:\<portal_dir>\backup\walarchive folder is not being cleaned up after a webgisdr full backup.  This is chewing up the available C:\ space and we have been manually purging some of these files that are over 60 days.  

Per the Common problems and solutions—Portal for ArcGIS (10.8) | Documentation for ArcGIS Enterprise The portal content directory has grown to several gigabytes in size

Once you run a backup using the webgisdr tool, this limit is removed, but the transaction logs are cleared each time the tool is run.

We have a few ArcGIS Enterprise deployments, and this is the only one causing problems.  It is also the only environment we (unsuccessfully) attempted a portal content C:\ to D:\ migration... so I suspect the situation is that the webgisdr utility is trying to purge the D:\<portal_dir>\backup\walarchive instead of the C:\ location... thus leaving these behind for us to have to clean up manually.  GeoNet reference to that thread - https://community.esri.com/message/904321-re-moving-arcgis-portal-directories#comment-929961 

 

Thoughts on this issue?  I suspect the suggestion will be to open a new support case (referencing the support case and bug logged on the referenced thread).  

Thanks!

Leeah Risher

Reply
0 Kudos
Highlighted
Esri Frequent Contributor

Foppe, Patrick‌ thanks for the feedback, looks like there are a few compounding issues here. Was Support also able to reproduce the behavior you saw in regards to the transaction logs not getting cleared?

Reply
0 Kudos
Highlighted
by MVP
MVP

Hi Jonathan Quinn‌, 

We have not opened an esri support incident on this yet, we actually discussed doing this today.  Esri support was able to reproduce the issues of the C:\ to D:\ content migration (referenced above) and I suspect this is related to that.  

When we start to run out of C:\ space, we manually purge some of these walarchive files to keep the system operational.  Thanks

Reply
0 Kudos
Highlighted
New Contributor III

Hi Jonathan,

I did notice our STAGING is not clearing up walarchives but PROD is clearing it well and keeping only for current date.

We have webgisdr in place and we are doing full + incremental backups as suggested by esri for both environments, we are also using 10.8 version of esri. What could be the reason? 

BR

Highlighted
Esri Contributor

Jonathan Quinn

Is there a way to reset the original 5GB limit on the size of the walarchive directory for the cases where webgisdr export was run once but not subsequently?

Reply
0 Kudos
Highlighted
Esri Frequent Contributor

No, you'll need to run the DR tool or delete the files manually (except for the latest one). We are working on a better story behind those transaction logs.

Highlighted
New Contributor III

Hi Jonathan

Many thanks, I have passed this information on to the person who was asking, I'm not sure what their DR policy is, hopefully this can solve it for them!

Regards

Dan

Reply
0 Kudos