nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Delete orphaned dataset in open data site?

TomCasady

I have a data set in my open data site, for which the underlying data has been deleted. I can't get the data set listing off the open data site, though. I've tried everything. Any advice?

Find more posts tagged with

Accepted answers

CourtneyClaessens

Thanks Tom. We've removed your dataset.

All comments

CourtneyClaessens

Hi Tom -

Can you please provide the URL of the orphaned dataset?

Thanks

Courtney

TomCasady

https://lincolnne.maps.arcgis.com/home/item.html?id=e166951c5ef3423f809794d525e19192

AdamMesser1

Courtney,

I think we have the same problem on our site. We (bdaigle) are evaluating the discrepancy between the number of items in our agol open data group (n=130), the OD Site Manager summary (126) and data tab (136 datasets 132 items). It appears that this is a continuation of Kevin Dunlop‌ issue of Phantom items in Open Data Beta‌ . Is the current solution to still send you the list of these items for deletion? I assuming the bug is still being worked on by your engineering team?

TomCasady

I suspect that this resulted when I deleted the underlying data from My Content, without "unsharing" it with the open data group first.

CourtneyClaessens

Thanks Tom. We've removed your dataset.

CourtneyClaessens

Hi Adam,

Yes, please send me the list of datasets. We are continuing to fix the bugs as we discover new ways this occurs. Can you please share the workflow you took before you saw this occur?

Courtney

AdamMesser1

Courtney,
Our process is scripted so I can describe that it, but likely cannot point you to a specific point when this occurred. We (Bill Daigle LydiaBailey Bill Daigle) maintain feature classes in SDE. When edits occur the data manager will designate the layer be updated in all dependent locations, including AGOL as a hosted feature service. Very large items are loaded as document links that point back to our web server for download. The feature service upload process takes one of two paths, with all tasks being automated via api calls which mostly use github ArcREST api package functionality. The only exception is the full item upload via arcpy.UploadServiceDefinition. If the layer is new or has a schema change, the existing AGOL feature service is deleted and replaced. If the layer only has record level edits, the features on the existing AGOL hosted feature service are deleted and then new records inserted into that item. If errors occur in the second process, we revert back to the first full item replacement option. Items are shared with everyone and our OpenData group which contains all items to be displayed on our OpenData site.

We are aware of issues with item replacement due to the object id being changed. However, this is lower priority since the feature service url does not change, and thus we haven't noted major negative impacts on map and apps pointing to those replaced feature service items.

Following is a summary of our existing data issues related to inconsistencies between our OpenDataGroup and OpenDataSite. Count of items in each location; Items in our ODGroup that should be showing up in the ODSite; Items that are orphaned, not in our ODGroup nor on our AGOL site anymore, and should be removed from the ODSite.

Our evaluations also picked up erroneous duplicate records over the last several days, but those appear to have been cleaned up or fixed as of this morning. In that case, a search for a specific record would show one result on screen, but list 2 results and show duplicates with the same item id when the returned json was evaluated.

Thanks for your help, Adam

________________________
Open Data Site Items:133
Open Data Group Items:132
________________________
In Open Data group, but not on Open Data site
____________
    id: 991f5239cf814ec6b86628b9e490fddd
name: AIS Watercraft Inspection Stations
type: Feature Service
   url: https://services3.arcgis.com/Cdxz8r11hT0MGzg1/arcgis/rest/services/FISH_AIS_INSPECTION_STATIONS/FeatureServer
____________
    id: b938ee0d87a1480aa988109cb963e13b
name: Montana Lakes
type: Document Link
   url: http://gis.fwp.mt.gov/arcgis101/rest/directories/arcgisoutput/webResources/metadata/refrnc/lakes.htm
________________________
On Open Data site, but not in Open Data group
____________
    ITEM ID NOT IN MTFWP ITEMS LIST
      id: 2b095b1f50074ad3803c7535804f50f9
    name: Snowmobile Trails Program PDF Map Index
    type: ItemLayer
     url: https://services3.arcgis.com/Cdxz8r11hT0MGzg1/arcgis/rest/services/FWPLND_WINTER_PDF_MAP_INDEX/FeatureServer/0
____________
    ITEM ID NOT IN MTFWP ITEMS LIST
      id: 3a7ccdc9db804845b126d5bcaaed32fe
    name: Winter Trails
    type: ItemLayer
     url: https://services3.arcgis.com/Cdxz8r11hT0MGzg1/arcgis/rest/services/FWPLND_TRAILS_WINTER/FeatureServer/0
____________
    ITEM ID NOT IN MTFWP ITEMS LIST
      id: bbec615bc12446539758cee15a6868fe
    name: Montana Fish, Wildlife & Parks Warden Districts
    type: ItemLayer
     url: https://services3.arcgis.com/Cdxz8r11hT0MGzg1/arcgis/rest/services/ADMBND_RESPAREA_WARDEN/FeatureServer/0
________________________

AdamMesser1

All of our Open Data orphans have been resolved by ESRI support. All of our data visible on our OD site is through a single Open Data group on our AGOL site. Apparently the following steps removed the orphan layers: From the OD administration pages the OD Group was removed from the site. From AGOL the OD group was changed from Public to Private. These steps were then reversed. From AGOL the OD group was changed from Private to Public, and the group was added back to the OD site. Then on the OD site indexes were updated and the download cache reset.

GyaneshGounder

Hi I am having the same issue with orphan datasets

CClaessens-esristaff‌ please advise

CourtneyClaessens

Hi Gyanesh,

Can you please send me the URLs of the datasets that are orphaned?

Courtney

AdamMesser1

Courtney, It was nice to meet you at the UC. As we discussed following up on any future issues I'm sending another orphan/duplicate record from OD. The Montana Lakes record is a document link so no specific url for the item on our OD site. It can be located via search on our current our legacy site: Search | Montana Fish, Wildlife & Parks Item id: 41ed181dc6124fa9a2955bcb127b4a9b; You will note the 'Lakes' search returns 7 records in the summary and the page json response, but there are only 6 listed. Testing on our new test OD site, shows this duplicate record in the list. There is only one item on our agol content list. If I unshare this item from our OpenData group, it will remove the valid record from our OD site after a short time but leave the orphan. Let me know if you need any additional information. Thanks again, Adam

GyaneshGounder

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_1

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_2

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_3

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_4

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_5

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_7

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_8

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_9

http://data-watercare.opendata.arcgis.com/datasets/eefc9d8e461d425b9a44f671ce5bb04a_10

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_1

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_2

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_3

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_4

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_5

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_6

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_7

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_8

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_9

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_11

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_12

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_13

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_14

http://data-watercare.opendata.arcgis.com/datasets/a47b0e20539a41e6b9eff8d47e878a2b_15

Thanks

TaupoDistrict_Council

Hi Courtney, we are experiencing the same issue with orphaned datasets in our data portal. Are you able to remove them for us if I send the URLs? Thanks

Anonymous User

sorry to hear about that - go ahead and send them to us so we can take a look!

ThomasHervey1

Hi @TaupoDistrict_Council we can delete these orphaned datasets now. We are investigating why you would see this. When did you first notice duplicates? did you republish the layers?

TaupoDistrict_Council

Hi @ThomasHervey1, thanks for following up.

Originally, we had ArcGIS Online Hosted Feature Layers shared with our open data group. When we stood up ArcGIS Enterprise, we decided to replace the layers with Hosted Feature Layers shared from our Portal via collaboration, this swap was completed March 2019 and I noticed the orphaned datasets following that. I am assuming the swap caused the orphaned datasets. Let me know if you need more information.

ThomasHervey1

Thanks, this is useful information. Since the swap was completed in March 2019 we don't have records to check the update status for items. However, if you experience the same issue again, especially if you used a collaboration, please let me know and we'll take a look.
The duplicates have been deleted.

TaupoDistrict_Council

Thank you @ThomasHervey1 ! So great to have that sorted. We will let you know if we run into the issue again.

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.