topic Re: ArcGIS Data store's folder pg_xlog size increase 16MB every 5min in ArcGIS Enterprise Questions

ArcGIS Data store's folder pg_xlog size increase 16MB every 5min

ImtiyazPasha — Wed, 24 Jan 2018 06:09:35 GMT

ArcGIS Data store's folder pg_xlog size increase 16MB every 5min

After further investigation we found E:\arcgis\arcgisdatastore\pgdata\pg_xlog folder size keeps on increasing and at this moment consuming 322 GB.

For every 5 minutes, it creates one file of size 16MB. Is this any log file? but the portal log is at E:\arcgis\arcgisportal\logs folder.

Is there any relation between E:\arcgis\arcgisdatastore\pgdata\pg_xlog and E:\arcgis\arcgisportal\logs\database\pg_log?

Please view the attached files.

Below are Operating system details.

Operating System: Windows server R2 standard (64 bit)

RAM: 16 GB

Processor: Intel(R) Xion® CPU E5-2683 v3 @ 2.00Ghz 2.00Ghz

ArcGIS Tool: ArcGIS Enterprise Builder(10.5.1) including patches.

Thanks in advance.

Re: ArcGIS Data store's folder pg_xlog size increase 16MB every 5min

RandallWilliams — Wed, 24 Jan 2018 14:58:29 GMT

This sounds like a permissions issue on the PG_DATA directory. Those logs should be truncating. Under the 'tools' directory, run configureserviceaccount.bat. Here's the syntax:

configureserviceaccount [--username username] [--password password] [--readconfig user-configure-file] [--writeconfig user-configure-file\

http://enterprise.arcgis.com/en/portal/latest/administer/windows/data-store-utility-reference.htm

You also might want to look into your backup creation and retention schedule.

Re: ArcGIS Data store's folder pg_xlog size increase 16MB every 5min

ImtiyazPasha — Thu, 25 Jan 2018 08:42:36 GMT

Hi Randall,

No folder named E:\Datastore\logs or E:\Datastore\nosqldata but we have

E:\arcgis\arcgisdatastore\logs and E:\arcgis\arcgisdatastore\nosqldata.

Best regards,

Imtiyaz

Re: ArcGIS Data store's folder pg_xlog size increase 16MB every 5min

ImtiyazPasha — Sun, 28 Jan 2018 12:43:28 GMT

We got it.

Culprit is ArcGIS DataStore:

ArcGIS Data Store’s E:\arcgis\arcgisdatastore\pgdata\postgresql.config file contains “archive_command”.

archive_command = 'C:/Program^ Files/ArcGIS/DataStore/framework/etc/scripts/dbcli put-transaction-log "E:/arcgis/arcgisdatastore/pgdata/%p" "%f" "C:/Program^ Files/ArcGIS/DataStore/"'

We didn’t install the ArcGIS Data Store at 'C:/Program^ Files/ArcGIS/DataStore and

we installed at 'E:/DataStore.

Why ArcGIS Data Store is considering 'C:/Program^ Files/ArcGIS/DataStore’ as our ArcGIS Data Store installation folder?

We changed the “archive_command” as below and restarted the ArcGIS Datsore service.

archive_command = 'E:/DataStore/framework/etc/scripts/dbcli put-transaction-log "E:/arcgis/arcgisdatastore/pgdata/%p" "%f" "E:/DataStore/"'

ArcGIS Datastore started deleting or truncating old log files E:\arcgis\arcgisdatastore\pgdata\pg_xlog files.

At last, problem solved.