nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Duplicate OpenData Data from one ArcGIS Online Item

deleted-user-Bkz8cHvtt5bs

I've been finding that some of my ArcGIS online items that have been shared with the OpenData group have been listed multiple times as datasets in my OpenData site, making it somewhat confusing. To make it even more confusing, even though they are supposed to be the same data, have the same abstract and metadata information, and are referencing the same ArcGIS Online item, they are pointing at different layers within the same rest endpoint. I've tried to reset the open data site's index and refresh those datasets' specific item in the OpenData Data Manager interface, but to no avail. What should I do to remedy the situation?

Datasets:

CORRECT "Unified Florida Reef Tract Map" record:

http://geodata.myfwc.com/datasets/6090f952e3ee4945b53979f18d5ac3a5_9_

INCORRECT "Unified Florida Reef Tract Map" record:

http://geodata.myfwc.com/datasets/6090f952e3ee4945b53979f18d5ac3a5_3_

Find more posts tagged with

Accepted answers

CourtneyClaessens

Hi Chris,

Did you by chance change the service URL on the ArcGIS Online items? There is a known bug right now that will create a duplicate dataset in open data.

If not that, are there any other actions you have taken that you can think of?

If you provide a list of the incorrect datasets on your site we can delete them on our end.

Thanks,

Courtney

All comments

MelissaBrooks

I was just having this issue today

The simple - unshare the AGOL item for a minute, then reshare again removed the ghost item from Hub (for us)

We have an Open Data group, I did not need to remove the item from the group. I just brought sharing back to the individual level for a short time.

Thanks

ThomasHervey1

Hi,

Can you please try unsharing the content from the group and change its visibility to just the owner wait a bit and then reshare it. The link provided is for a private site so I cannot see the item. If this does not work please reach out to me at thervey@esri.com

HannaSjostrom1

Hello,

I'm having the same issue with the ghost item, I removed a layer from my map service which reshuffled my rest service url.

Can you please delete:

Urban Zoning (By-law 016-2014)

Thanks,

Hanna

ThomasHervey1

The other item will be deleted. There currently isn't a way for users to manually delete these items, but we're working on making sure our system does this on it's own. We are working on expanding the edit route for items (e.g., /datasets/:id/edit) and will consider adding an option to manually delete the item from the Hub index. Thank you for this feedback.

-Thomas

JoeyBisig1

Hi Thomas,

Thank you for deleting that item and getting back to us quickly. We are still having the ghost item issue as it looks like only one of them has been deleted. Could we get this item at the link below deleted as well?

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-other-land-use-1

We need both deleted so we can republish this dataset. When we login to AGO as an administrator “Development Engineering Other Land Use” cannot be found under "My Content”. We are concerned that if we republish now it would result in a duplicate copy again on our Open Data Portal website.

Is there a way that we can remove data that appears on our Open Data Portal public facing page, but is not found by an AGO administrator? If for some reason a hosted feature service needed to be remove quickly we'd like to be able to handle these ourselves when necessary.

Thanks,

Joey

ThomasHervey1

Hi Joey,

Thanks for bringing this to our attention and I apologize that you're seeing items that shouldn't exist. We sometimes keep deleted items in Hub after they're deleted in ArcGIS Online. We'll manually deleted these ghost items and are investigating how to better handle deleted items. Please reach out if you have a similar issue again.

Thanks,

-Thomas

JoeyBisig1

We are currently seeing duplicated items on our Open Data Portal/ArcGIS Hub Website with our Development Engineering Other Land Use data.

When we search our site, this is what our users see (Search URL: https://gisdata-piercecowa.opendata.arcgis.com/search?q=Development%20Engineering%20Other%20Land%20Use)

The ghost pages were created after our most recent update despite only having a singular feature service and service definition for this dataset in the AGO Content tab. In an attempt to start over and republish, we removed the dataset entirely from the Content.

Additionally, in ArcMap, the data can no longer be found on ArcGIS Online (Development Engineering Other Land Use).

Can you delete both of the items below?

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-other-land-use

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-other-land-use-1

We see that this has been a problem since 2015. Does the Open Data/ArcGIS Hub team have a fix for this problem coming? If not, is there a way that we can fix this or prevent this from happening?

Thanks,

Joey

BrianRollison

gisadmin CPG‌ - magic worked, your ghost is gone 🙂

gisadminCPG

Hi Brian

Thanks for helping me clean up the ghosts. I did find another issue and was wondering if you could work your magic again today?

I have another one if you're able to assist again?

Multi Family Housing Incentive

Thanks,

Craig

BrianRollison

Hi gisadmin CPG‌ - the duplicate datasets listed have been dropped from your site.

gisadminCPG

I'm having the same issue. Here's what happened to create the duplicates

The MXD to publish this layer contains about 10 layers related to Roads and Traffic Infrastructure. Here is the REST Service,( https://services2.arcgis.com/CnkB6jCzAsyli34z/ArcGIS/rest/services/OpenData_RoadTraffic/FeatureServer ) Someone changed the layers within the MXD, I can't figure out what they did but its been modified. A couple of the LayerID's in the mxd have now changed since this service was originally published. Upon finding the issue my first step was to simply modify the Service URL to reflect the new LayerID. What I did was within AGOL in my organiztion I went to the Settings tab of the Layer and modified the Data Source URL at the bottom of the page to reflect the new REST Service layerID. I modified it from this; https://services2.arcgis.com/CnkB6jCzAsyli34z/ArcGIS/rest/services/OpenData_RoadTraffic/FeatureServer/4

To this: https://services2.arcgis.com/CnkB6jCzAsyli34z/ArcGIS/rest/services/OpenData_RoadTraffic/FeatureServer/262

because this is what its now referenced in the REST Service because someone did some changes within the MXD and the "Allow assignment of unique numeric IDs for map service publishing" is checked. Maybe someone put in some layers and then took some out. But the numbering has changed sine the initial publishing of the MXD.

BTW, I use the term "someone" because I'm not willing to take the blame, even though 99% sure it was me.

AS soon as I modified the Data Source URL in the Settings tab the duplicate items showed up in our Open Data Site/AGOL listing. Using the Update Index, Update Item Index doesn't appear to have any impact on the duplicates in the item list.

Can you please delete the duplicate items I've listed below:

Bridges

Civic Address Points

NataliyaLys

Hello,

I am having the same issue. One of my layer is duplicated. I tried to remove the layer (names Parks) from my AGO content, but it still shows up in the open data site. I then re-added that layer and named it differently (Parks & Rec), and now both layers show up, and point to the same source. The original layer 'Parks' is not registered with AGO, and it's also seems to be missing some data, which is odd since it points to the same exact service?

Omaha/Douglas County - Open Data Portal

Original layer - named 'Parks'

New layer - named 'Parks & Rec'

Layer

Layer: Parks (ID: 0)

Thanks,

Nataliya

Anonymous User

Hi Chula Vista,

Sorry this is happening again. I've gone ahead and removed the duplicates from the index, but we are also investigating what regressed in the indexing logic since we updated to the new system earlier in the year. If this happens again let us know.

Best,

Patrick

Chula_VistaGIS

Patrick,

So is this still the case, we have to send you the list of each url for all the layers that are duplicated? I updated the urls in AGOL so I now I will have maybe 40 odd datasets that are duplicated.

HelenaMcMullen

Patrick,

Thanks for deleting these items:

County Background

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/county-background

Conservation 2020 Preserves

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/conservation-20-20-preserves

Emergency Public Shelters

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/emergency-public-shelters-1

Future Sewer Service Area

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/future-sewer-service-area

Historic Flow Ways

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/historic-flowways

Hospitals

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/hospitals-1

Planning Communities

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/planning-communities

Southeast Lee County DRGR

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/southeast-lee-county-drgr

Well Abandonment Program

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/well-abandonment-program

Yard Waste Collection

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/yard-waste-collection

Anonymous User

Hi Helena,

Sorry to hear you're having issues with duplicate items. Go ahead and paste the URLs and I can take it from there.

Best,

Patrick

HelenaMcMullen

Hello, I realize the last post on this thread is from 2017 but we recently noticed duplicate datasets on our Open Data site as well, just as Bob at Chula Vista GIS described.

Courtney, Can I also send you a list of the URLs that need to be deleted?

Thank you.

Chula_VistaGIS

Hi, saw your response to Chris Boland concerning duplicate opendata datasets and we too are a victim of this bug. In the process of updating our data, the rest endpoint reshuffled the layers ending up with different numbers. In my attempts to fix our OpenData site, I created a new data group, removed the old one, and added the new one in its place. The end result of course is we now have duplicates for a number of our layers, one layer points to the wrong endpoint while the other one points to the correct one. I'm guessing this bug has not been fixed, so I'm hoping you can perform the same task like with Chris where you deleted the erroneous data on your end. Let me know if this is possible, thanks.

deleted-user-Bkz8cHvtt5bs

Hi Courtney,

I can't think of any actions that I've done for this item recently. The site has been pretty stable, but this was reported to me yesterday. So far the one listed above as INCORRECT is the only one so far that should be deleted. I'll peruse the site and see if i can find any more.

thanks,

Chris

CourtneyClaessens

Hi Chris,

Did you by chance change the service URL on the ArcGIS Online items? There is a known bug right now that will create a duplicate dataset in open data.

If not that, are there any other actions you have taken that you can think of?

If you provide a list of the incorrect datasets on your site we can delete them on our end.

Thanks,

Courtney

deleted-user-Bkz8cHvtt5bs

Thanks for the suggestion, but our items are all individual layers within the services. We are not adding the complete rest service as AGO items. I have no idea where the

INCORRECT "Unified Florida Reef Tract Map" record:

http://geodata.myfwc.com/datasets/6090f952e3ee4945b53979f18d5ac3a5_3_

even came from. We don't have an AGO item that references the layer number 3 in that REST service, but there's a record on OpenData for it...

C_EHoward

are your sublayers entered as separate content items on AGOL? When I needed to have different metadata and details for each layer of a service, I had to create separate items in AGOL with the layer ID as part of the REST URL-- that was the only way to get different details. otherwise, each layer would show up with the map service name and description. Not sure if this situation applies to you or if you accounted for this already, but thought I would mention it.

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.