Identical Overlapping Lines not being deleted after upgrading ArcMap Fabric to Pro Fabric
Hey @RobertChaney
So I did some investigating of the data and here is what I found. It doesn't look like the Distance rounding is the primary culprit. It looks like it's the Direction field.
Let me start with what I think might be path forward for your data then I'll get into the nitty gritty of what is happening behind the scenes.
I would suggest not running the Delete Identical option during the Upgrade. Instead, run it manually after upgrade is complete. The Upgrade ArcMap tool simply runs the GP Delete Identical so running it after will be basically the same except you can control the fields it uses to compare more specifically. If you do not care about the Direction and Distance field values, you can just run the Delete Identical tool and use SHAPE as the field it checks against.
However, if you are concerned about the Distance fields you can run the delete identical against: SHAPE, DISTANCE, ARCLENGTH, and even CREATEDBYRECORD. However you might need to round your distance fields to a lower decimal place, and if you don't want to modify the surveyed data you can create a new field and compute the Distance values over there and round the values in that field. Then use that newly created field in the Delete Identical.
Let me know if that will be a good workflow for you!
Ok... now for some nerdy numbers...
When looking at the Direction field I noticed the decimal values went over 10 places. And during the Upgrade ArcMap tool what happens if you choose to Delete Identical is that I will create two new fields; one that stores the Direction field minus 180 if it's a angle that is greater than 180 and two a distance field that is rounded to 4 decimal places. I then use those two fields, plus the CREATEDBYRECORD, RETIREDBYRECORD and SHAPE field in the parameter for Delete Identical.
With that being said looking at the Direction Field, rounding to 6 decimal places the values still differed between the two lines. Use these lines as an example
You can see on the left the UpgradeDirectionMinus180 fields differ between the two lines. And the Direction values that are stored have huge precision. Seeing this makes me think that these full raw values aren't necessarily important to you so running Delete Identical simply against the shape of the line features might be a viable option for you.
Hopefully all this makes some sense. Let me know if you have any other questions.
Thanks for your explanation and suggestion Jason. I've went ahead and tried the upgrade without checking the box for deleting identical lines. Instead after the upgrade, I went ahead and ran the delete identical on the lines choosing the shape field your mentioned. This seems to be a method to use for the final run. However, I'm noticing on some curves with duplicates the lines aren't being deleted when using the shape field. I can choose these duplicates manually and run the delete identical tool using the Arc_Length tool, but I hesitate to do this on all curves at once for fear of removing lines that shouldn't be deleted. If I choose the Shape and Arc_Length fields none of them get deleted. Any suggestions on handle these duplicate curves? I'm going to test out your suggestion of creating a second distance field as well.
Ah interesting. I ran the delete identical on your data you provided me right now with SHAPE only. I looked for a curve and luckily there was one and it has one curve that is still overlapping after.
I used the tool Highlight Gaps and Overlaps tool available on the Quality Tab in Pro
I notice there are alot of gaps and overlaps along these curves
Zooming to that curve that has the duplicate lines you'll notice there is a gap between the parcels so the lines technically aren't overlapping.
Examining that ArcMap Fabric these gaps and overlaps are all present there too.
I took a look at one of the areas where there are yellow gaps at the top and I noticed the parcel polygon geometry wasn't true curves along the line, they were still densified arcs. I toggled on the Parcels Vertices layer and can see there are alot of extra verticies on the polygon.
So what I did to fix this selected all the parcels in the cul-de-sac and clicked Shrink To Seed
Once they were shrunk to seed I manually selected one of those 'duplicate lines' and deleted it
I then ran Reconstruct From Seeds which rebuilt all those parcels I shrunk to seed (note: nothing happened to any of the attributes of that parcel)
I ran the Highlight Gaps and Overlaps tool again and everything was all fixed. No more gaps or densified arcs on the polygons.
It wasn't something I did on the sample data I sent you, but after the upgrade I'm running a merge collinear boundaries and the SLACA tool to clean up some of these issues.
At the north end of the data I sent there's the issue
Well, some good news regarding that type of curve...
At ArcGIS Pro 3.3 we have enhanced the Merge Collinear Lines tool to work with curves. I selected those lines and ran the GP tool on them and it created a curve
Only problem is you'll have to wait just a bit until 3.3 comes out in order to use the tool with the new functionality.
