Select to view content in your preferred language

Features disappearing after Append

410
6
2 weeks ago
Labels (2)
Calcalcali
Emerging Contributor

Hello!
I am running ArcGIS Pro 3.3.1 and I am having trouble with features disappearing from a layer after I Append them. I have two layers in this situation: Invasive Plant Collection layer which is updated daily with new data and a Treatment data layer. In order to move attributes from the Invasive Plant Collection, I export all the data for a backup set of data, buffer out the points and lines, then use Append to add points, lines, and polygons to the Treatment layer. I am working with a rather large dataset (>14,000) and more is added every week with each Append containing minimum 500 datapoints.

When the tool is finished running, everything seems to be fine with the features showing up on the map viewer and the correct number attributes in the attribute table. I save the edits under the Edit tab and exit the project (I don't save the project because I download it from AGOL every time I need to use it). Sometimes this works, and the features are all good. But 8/10 times, I come back to the map a couple of days later and only 32 features (for example) are still in the attribute table. The rest seem to have been deleted(??) and aren't showing up in the map viewer.

Am I just working with such a large dataset that I'm doomed to redo my work every time I use Append? Or is there something ya'll know that I don't?  I am going to meet with someone at some point this week to consult on the geodatabase and see if there is something wrong with it, but I'd like to know if there are other causes to this in case it is not the geodatabase messing up. Side question: is 18,000 attributes considered a large enough dataset to cause problems? Or is it small compared to what it could be? 

Thanks in advance!

Tags (1)
0 Kudos
6 Replies
DanPatterson
MVP Esteemed Contributor

lots of append bugs on support but this is specific to 3.3

BUG-000169082 for ArcGIS Pro


... sort of retired...
0 Kudos
Calcalcali
Emerging Contributor

Gosh I hope not. Its looking like we might just start from scratch and make a new project, but if it is a bug, that might not solve the problem. 

0 Kudos
MichaelVolz
Esteemed Contributor

What type of data source are you appending to (e.g. enterprise geodatabase)?

Are you appending data through a service or directly to the data source?

0 Kudos
Calcalcali
Emerging Contributor

I do log in through an enterprise, but I believe I'm appending the data directly to the data source since its saved locally on my computer but correct me if that thinking is wrong. 

0 Kudos
costello5
New Contributor

I’ve had a very similar issue when working with large datasets in ArcGIS Pro, especially when using Append. At first everything looks fine—the features show up in the map and the attribute table is correct—but after reopening the project App later, a big chunk of the data just seems to vanish. In my case, it turned out to be related to how the edits were being saved and synced with AGOL rather than the dataset size itself. 18k features shouldn’t really be a problem for ArcGIS, so I’d guess it’s more of a geodatabase or workflow issue. Definitely worth checking the database setup and making sure everything is being committed properly after the Append.

0 Kudos
Calcalcali
Emerging Contributor

Okay thank you! We are actually about to have a big geodatabase revamp soon so hopefully that will solve the problem. But for now, I've been splitting the data in half so I'm not moving so many points at once. It seems to have helped so far, but I don't know if it will continue to.

0 Kudos