topic Re: Duplicate OpenData Data from one ArcGIS Online Item in ArcGIS Hub Questions

Duplicate OpenData Data from one ArcGIS Online Item

deleted-user-Bkz8cHvtt5bs — Thu, 29 Oct 2015 14:49:46 GMT

I've been finding that some of my ArcGIS online items that have been shared with the OpenData group have been listed multiple times as datasets in my OpenData site, making it somewhat confusing. To make it even more confusing, even though they are supposed to be the same data, have the same abstract and metadata information, and are referencing the same ArcGIS Online item, they are pointing at different layers within the same rest endpoint. I've tried to reset the open data site's index and refresh those datasets' specific item in the OpenData Data Manager interface, but to no avail. What should I do to remedy the situation?

Datasets:

CORRECT "Unified Florida Reef Tract Map" record:

http://geodata.myfwc.com/datasets/6090f952e3ee4945b53979f18d5ac3a5_9_

INCORRECT "Unified Florida Reef Tract Map" record:

http://geodata.myfwc.com/datasets/6090f952e3ee4945b53979f18d5ac3a5_3_

Re: Duplicate OpenData Data from one ArcGIS Online Item

C_EHoward — Thu, 29 Oct 2015 15:43:27 GMT

are your sublayers entered as separate content items on AGOL? When I needed to have different metadata and details for each layer of a service, I had to create separate items in AGOL with the layer ID as part of the REST URL-- that was the only way to get different details. otherwise, each layer would show up with the map service name and description. Not sure if this situation applies to you or if you accounted for this already, but thought I would mention it.

Re: Duplicate OpenData Data from one ArcGIS Online Item

deleted-user-Bkz8cHvtt5bs — Thu, 29 Oct 2015 16:24:41 GMT

Thanks for the suggestion, but our items are all individual layers within the services. We are not adding the complete rest service as AGO items. I have no idea where the

INCORRECT "Unified Florida Reef Tract Map" record:

http://geodata.myfwc.com/datasets/6090f952e3ee4945b53979f18d5ac3a5_3_

even came from. We don't have an AGO item that references the layer number 3 in that REST service, but there's a record on OpenData for it...

Re: Duplicate OpenData Data from one ArcGIS Online Item

CourtneyClaessens — Thu, 29 Oct 2015 17:24:58 GMT

Hi Chris,

Did you by chance change the service URL on the ArcGIS Online items? There is a known bug right now that will create a duplicate dataset in open data.

If not that, are there any other actions you have taken that you can think of?

If you provide a list of the incorrect datasets on your site we can delete them on our end.

Thanks,

Courtney

Re: Duplicate OpenData Data from one ArcGIS Online Item

deleted-user-Bkz8cHvtt5bs — Thu, 29 Oct 2015 17:41:54 GMT

Hi Courtney,

I can't think of any actions that I've done for this item recently. The site has been pretty stable, but this was reported to me yesterday. So far the one listed above as INCORRECT is the only one so far that should be deleted. I'll peruse the site and see if i can find any more.

thanks,

Chris

Re: Duplicate OpenData Data from one ArcGIS Online Item

CourtneyClaessens — Fri, 30 Oct 2015 19:34:29 GMT

Hi Chris,

The dataset is gone! Poof! Let us know if there are any others.

Courtney

Re: Duplicate OpenData Data from one ArcGIS Online Item

Chula_VistaGIS — Fri, 15 Apr 2016 17:29:16 GMT

Hi, saw your response to Chris Boland concerning duplicate opendata datasets and we too are a victim of this bug. In the process of updating our data, the rest endpoint reshuffled the layers ending up with different numbers. In my attempts to fix our OpenData site, I created a new data group, removed the old one, and added the new one in its place. The end result of course is we now have duplicates for a number of our layers, one layer points to the wrong endpoint while the other one points to the correct one. I'm guessing this bug has not been fixed, so I'm hoping you can perform the same task like with Chris where you deleted the erroneous data on your end. Let me know if this is possible, thanks.

Re: Duplicate OpenData Data from one ArcGIS Online Item

CourtneyClaessens — Mon, 18 Apr 2016 13:06:45 GMT

Hi Bob,

Apologies for the issue you are experiencing. Would you please provide the URLs for the datasets that need to be deleted? We'll remove them.

Thank you,

Courtney

Re: Duplicate OpenData Data from one ArcGIS Online Item

Chula_VistaGIS — Mon, 18 Apr 2016 18:25:53 GMT

Thanks, I will go ahead and compile my list and forward you that information as soon as I can. Thanks.

Re: Duplicate OpenData Data from one ArcGIS Online Item

Chula_VistaGIS — Tue, 03 May 2016 20:11:45 GMT

Thanks for your help on this. Below are the URLs for the datasets to be deleted. Thanks.

Airport Influence Area

http://chulavista.cvgis.opendata.arcgis.com/datasets/9c3a20c016534d07b5bdbbeac60d5dde_1

Bayfront Coastal Zone

http://chulavista.cvgis.opendata.arcgis.com/datasets/8a06873fdb7d4bc4a09b6f9f5f600f84_2

Downtown Improvement District

http://chulavista.cvgis.opendata.arcgis.com/datasets/cb2b08b0f1494365b568aa838e5f4e0b_3

Enterprise Zone

http://chulavista.cvgis.opendata.arcgis.com/datasets/8b7df65f08f24258b6b9c93e6e192425_4

Street Sweeping Areas

http://chulavista.cvgis.opendata.arcgis.com/datasets/e3c736a63c67420e91e0f4d25b1552a4_13

Waste Collection Areas

http://chulavista.cvgis.opendata.arcgis.com/datasets/0134dd3cf6884e32a5c4632a7ec5dd05_15

Traffic Signals

http://chulavista.cvgis.opendata.arcgis.com/datasets/ee6a70890cef4bf581fffed6c3ec5220_11

Re: Duplicate OpenData Data from one ArcGIS Online Item

CourtneyClaessens — Fri, 06 May 2016 15:39:10 GMT

Hi Bob,

We've deleted the datasets. Please let us know if you experience any other issues.

Courtney

Re: Duplicate OpenData Data from one ArcGIS Online Item

MiguelParedes — Wed, 15 Mar 2017 14:49:38 GMT

Greetings Courtney, we have a customer who is suffering from the same issue. Do you know if this has been fixed in the latest version of Open Data?

In order to delete the duplicates, is this something that still needs to be done by Esri Inc?

Many thanks in advance.

Re: Duplicate OpenData Data from one ArcGIS Online Item

CourtneyClaessens — Wed, 15 Mar 2017 14:56:01 GMT

Hi Miguel,

Yes, please post or email me the URLs of the datasets to be deleted. Any information on the steps they took before the ghost datasets persisted would be very helpful as well.

Courtney

Re: Duplicate OpenData Data from one ArcGIS Online Item

HelenaMcMullen — Mon, 07 Oct 2019 19:44:30 GMT

Hello, I realize the last post on this thread is from 2017 but we recently noticed duplicate datasets on our Open Data site as well, just as Bob at Chula Vista GIS described.

Courtney, Can I also send you a list of the URLs that need to be deleted?

Thank you.

Re: Duplicate OpenData Data from one ArcGIS Online Item

Anonymous User — Mon, 07 Oct 2019 20:43:58 GMT

Hi Helena,

Sorry to hear you're having issues with duplicate items. Go ahead and paste the URLs and I can take it from there.

Best,

Patrick

Re: Duplicate OpenData Data from one ArcGIS Online Item

HelenaMcMullen — Tue, 08 Oct 2019 11:05:35 GMT

Patrick,

Thanks for deleting these items:

County Background

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/county-background

Conservation 2020 Preserves

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/conservation-20-20-preserves

Emergency Public Shelters

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/emergency-public-shelters-1

Future Sewer Service Area

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/future-sewer-service-area

Historic Flow Ways

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/historic-flowways

Hospitals

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/hospitals-1

Planning Communities

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/planning-communities

Southeast Lee County DRGR

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/southeast-lee-county-drgr

Well Abandonment Program

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/well-abandonment-program

Yard Waste Collection

http://leegisopendata2-leegis.opendata.arcgis.com/datasets/yard-waste-collection

Re: Duplicate OpenData Data from one ArcGIS Online Item

Chula_VistaGIS — Mon, 28 Oct 2019 22:31:18 GMT

Patrick,

So is this still the case, we have to send you the list of each url for all the layers that are duplicated? I updated the urls in AGOL so I now I will have maybe 40 odd datasets that are duplicated.

Re: Duplicate OpenData Data from one ArcGIS Online Item

Anonymous User — Wed, 30 Oct 2019 14:06:46 GMT

Hi Chula Vista,

Sorry this is happening again. I've gone ahead and removed the duplicates from the index, but we are also investigating what regressed in the indexing logic since we updated to the new system earlier in the year. If this happens again let us know.

Best,

Patrick

Re: Duplicate OpenData Data from one ArcGIS Online Item

HelenJohnson — Thu, 21 Nov 2019 20:41:36 GMT

Hi,

I am having this problem too. Can you delete this item:

http://data-oxnard.opendata.arcgis.com/datasets/321154666cc04583a7f9daf4a2ca6a3e_1

Thank you

Re: Duplicate OpenData Data from one ArcGIS Online Item

Anonymous User — Mon, 25 Nov 2019 17:31:30 GMT

Hi Helen,

The duplicate item should now be dropped from your site.

Thanks,
Patrick