topic Missing some features after merge/append in Geoprocessing Questions

Missing some features after merge/append

YuzhenLi — Mon, 19 Aug 2019 16:15:16 GMT

I was trying to combine many feature classes from one geodatabase into one feature class. All input feature classes have the same schema and all features are line and have the same attributes. The total number of line features is big (~ half million). I noticed quite a bit of features are missing after merging/appending. I tried both scripting (arcpy merge_management and append_management function) and using merge and append tool in ArcToolBox, I even tried to repair geometry first before merge, define extent before merge..,none of these seem to fix the issue. When I changed the computer, the missing issue still existed, just the number of missing features are different. Any suggestion or did anyone here experience this before? Did I miss anything when using merge/append? Thanks.

Re: Missing some features after merge/append

DuncanHornby — Tue, 20 Aug 2019 11:50:10 GMT

Without seeing the data we can only guess, if after a merge you have less lines, may be they are very small and falling below the tolerance of the dataset and are collapsing to NULL geometry and are dropped?

Re: Missing some features after merge/append

YuzhenLi — Tue, 20 Aug 2019 18:00:19 GMT

Thanks for your reply Duncan Hornby It looks the missed lines are not small and they were chopped out by some kind of extent. I am happy to share the data if I know how to upload geodatabase here. It seems I can't find how to upload data on this discussion page (relatively new here:-).

Re: Missing some features after merge/append

BenCapellGGT — Mon, 23 Jan 2023 17:47:02 GMT

I am also encountering this issue after running the arcpy.Append_management() tool. The result is 477 features in a previously empty feature class after running the append tool with a 479 count feature class.

Troubleshooting steps so far:

arcpy.env.extent = "MAXOF"
https://pro.arcgis.com/en/pro-app/latest/tool-reference/environment-settings/output-extent.htm
arcpy.AddSpatialIndex_management(), Using the 479 ct feature class
https://pro.arcgis.com/en/pro-app/latest/tool-reference/environment-settings/maintain-spatial-index.htm

Re: Missing some features after merge/append

ThomasUhrePedersen — Tue, 24 Sep 2024 13:27:43 GMT

Hi..

I was doing a similar task with append, and I am also missing features in my output. To troubleshoot I did write the output of the append tool to a variable. And then I am able to get further information about the problem by typing Results.getMessages()

Thus

Result=arcpy.Append_management(inFc, outFc, "TEST")

Result.getMessages()
Out[27]: 'Start Time: 24. september 2024 11:41:44\nWARNING 000594: Input feature 3: falls outside of output geometry domains.\nWARNING 000595: C:\\Users\\MyUser\\AppData\\Local\\Temp\\7\\outFc13.fid contains the full list of records not able to be processed.\nSucceeded at 24. september 2024 11:41:45 (Elapsed Time: 0,33 seconds)'

Reading the file outFc13.fid in notepad++ gives a list of features not being appended.

I ended up deleting the featureclass I tried to append the data to, and afterwards I made a new copy of the feature class. Afterwards all features was truncated+appended again.

The problem and associated solution is also described here:

https://pro.arcgis.com/en/pro-app/latest/tool-reference/tool-errors-and-warnings/001001-010000/tool-errors-and-warnings-00576-00600-000594.htm