topic How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly? in Data Management Questions

How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

amarcz_cc — Thu, 10 Aug 2023 14:53:01 GMT

Hello All,

My Organization updated to a Small Gov License Agreement and wants to move towards enabling web editing. Before this, there was only one GIS person (me) and no one else had access to edit the data. Now we are attempting to move towards opening access to certain data layers and have staff from each department edit them.

My first question is, we already have a Traditional Versioned Environment, as laid out below:

DEFAULT - Protected (parent)
1. EDIT Version - Public (child)

But I want to incorporate a QA/QC version between the two. My main questions, is how do I achieve nightly FULL compression when I may not be able to approve edits the before the script runs? And therefor, the versions wont be removed upon reconciliation.

Is there a separate way I should approach this?

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

MarceloMarques — Thu, 10 Aug 2023 15:53:36 GMT

For example, the data gets reconciled and posted to the QA/QC version automatically by the python script every day, the sde compress script can run every day at night off business hours. Then on Fridays someone reviews and approves the edits in the QA/QC version and manually reconciles and posts the edits to the SDE.DEFAULT version, then you can wait for the automated sde compress to trigger to move the data from the delta tables (A & D tables) to the Base tables, after this is recommended to rebuild indexes and gather new statistics.

Using Python scripting to batch reconcile and post traditional versions—ArcGIS Pro | Documentation
Reconcile and post edits to a traditional version—ArcGIS Pro | Documentation

I recommend you attend these training class, they are very helpful.

Deploying and Maintaining a Multiuser Geodatabase | Esri Training Instructor-Led Course – 2 days (16 hours)

Implementing Versioned Workflows in a Multiuser Geodatabase | Esri Training Instructor-Led Course – 3 days (24 hours)

I hope this helps.

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

amarcz_cc — Thu, 10 Aug 2023 15:52:13 GMT

Thank you @MarceloMarques Marcelo, that is the thought process I was envisioning, having the nightly go to QA and not achieve full compression, and then on Fridays, run the QA to DEFAULT.

On another question, do you have any resources that will demonstrate how to set up an Alert to notify the QA/QC if there are pending transactions?

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

MarceloMarques — Thu, 10 Aug 2023 16:02:06 GMT

@amarcz_cc- You can look into the arcpy API.
IsBeingEdited—ArcGIS Pro | Documentation
Also, my recommendation is for you to automate and orchestrate the editing workflow steps with the Esri ArcGIS Workflow Manager Extension. It can be quite useful.

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

BillFox — Thu, 10 Aug 2023 17:40:04 GMT

are you asking about compression all the way to "state zero"?

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

amarcz_cc — Thu, 10 Aug 2023 19:09:25 GMT

@BillFox I am achieving a State 0 on my current 2 tiered versioned GDB.

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

BillFox — Thu, 10 Aug 2023 20:17:16 GMT

short answer is you won't get there unless all the versions are deleted

option A) change to doing a weekly state zero during an agreed upon maintenance window where every editor knows to reconcile and post it or loose their work before the deadline (hold them responsible for their edits - not you)

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

MarceloMarques — Thu, 10 Aug 2023 20:33:21 GMT

Indeed. If your goal is to achieve "state zero" then you will need to reconcile all children versions of the QA/QC version, resolve conflicts and post, then delete the children versions of the QA/QC version, run a SDE Compress, then reconcile the QA/QC version to the SDE.DEFAULT version, resolve conflicts and post, then at this point delete the QA/QC version and run the SDE Compress at least 2 or 3 times, then the records in the Delta Tables (A & D tables) will move to the Base Tables, after the SDE Compress you need to rebuild indexes ( spatial indexes and attribute indexes ) and gather new statistics because the cardinality changed in the Base Tables and Delta Tables, the number of rows changed on those tables.

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

BillFox — Thu, 10 Aug 2023 23:56:24 GMT

I heard at the UC that branch versioning does not support a middle version between default and editor's version

Re: How to get Nightly Full Compression on a 3 tier SDE Version when QA/QC may not get resolved nightly?

MarceloMarques — Fri, 11 Aug 2023 00:13:06 GMT

That is correct. Branch Versioning supports only one level down from sde.default version, you cannot create a child of a child version like in Traditional Versioning. This is covered in detail in the documentation.
Versioning types—ArcGIS Pro | Documentation