AnsweredAssumed Answered

Append (Data Management) failing with ultra large datasets

Question asked by mboeringa2010 on Aug 10, 2017
Latest reply on Aug 11, 2017 by Dan_Patterson

Hi all,

 

I am currently attempting to Append a couple of point datasets with a total of 370M points in three feature classes. All datasets reside in File Geodatatabases (three separate ones), and I am appending to one of the existing feature classes.

 

The data resides on a 2TB SSD with plenty of free space (>1TB). The machine runs ArcMap 10.5.1 and has 16GB RAM and Windows 10 as OS.

 

Now I have successfully done this with datasets with up to well over 100M records as final result dataset on Windows 7 machine, but I am now getting consistent failures with these. The error number is the not very useful generic 999998: Unexpected error type error and happens somewhere half way, so probably in the range of 100-200M records having been appended.

 

Clearly, with so many records, I might potentially run out of some resource, but it certainly isn't disk space.

 

Has anyone else been successful in appending feature classes with over 100M records each and well over 300M total, and especially also on Windows 10?

Outcomes