topic Re: ArcGIS Open Data - Shapefile Currently Unavailable in ArcGIS Hub Questions

ArcGIS Open Data - Shapefile Currently Unavailable

ANRGIS — Tue, 27 Oct 2015 14:07:14 GMT

We are having intermittent issues with ArcGIS Open Data Portal.

We get errors that state "The shapefile you requested is currently unavailable. "

We can access our rest endpoint, ArcGIS Open Data can access the requested json, it just won't download the shapefile. Fiddle doesn't return any errors, but waits for a long time for each request. Perhaps a timeout issue... We have a very large Open Data REST endpoint which may be causing performance issues, but our recollection in the documentation is that Open Data caches our datasets in the cloud and presents them for download on request...

We worked with tech support weeks ago and they didn't have a great answer for us. The interface is completely uninformative and cumbersome. Typically the troubleshooting workflow involves us needing to reset the index/download for EVERY dataset that we have hosted. When you have 70+ layers available for download, this isn't an easy task and doesn't fix this issue immediately. Sometimes there are lags between suggested fixes and all of the sudden, "BAM!" it's working again, no worries, it's fixed, thanks, leave us feedback to let us know how your experience was!

What is the deal? We are currently using this for our data distribution method and if these intermittent issues continue, we are going to have to find another solution and recommend another solution to our partners as well.

We are curious if others are having the same issues and if so, what your troubleshooting patterns have been to fix it.

Thanks.

Re: ArcGIS Open Data - Shapefile Currently Unavailable

DanielFenton1 — Wed, 11 Nov 2015 18:19:31 GMT

Would you please share the link to your open data site with us? I can take a look and see if there are any systemic issues with Open Data or your Map Services.

Thanks,

Daniel Fenton

Re: ArcGIS Open Data - Shapefile Currently Unavailable

ANRGIS — Fri, 13 Nov 2015 17:53:49 GMT

Home | Vermont Agency of Natural Resources - Open Data

Re: ArcGIS Open Data - Shapefile Currently Unavailable

DanielFenton1 — Fri, 13 Nov 2015 18:55:10 GMT

I'm running a battery of tests against your services. I will let you know what I find.

Re: ArcGIS Open Data - Shapefile Currently Unavailable

DanielFenton1 — Fri, 13 Nov 2015 21:10:19 GMT

Something I'm seeing a lot is your services returning a 500 error when trying to get the layer info. Did you change any of your services or URLs after you added them to your Open Data site?

Here are some examples:

http://gis.vtanr.opendata.arcgis.com/datasets/9bcec45e51cf42fe9ec7ea063137b4ea_40

http://gis.vtanr.opendata.arcgis.com/datasets/4781cd35d3f943eea5866db864a55ce0_39

http://gis.vtanr.opendata.arcgis.com/datasets/f384e89099684eb99c0db7a08deecec7_41

http://gis.vtanr.opendata.arcgis.com/datasets/3a2ed94827b74763ae1209b1c28f1b9a_82

Click the Service URL to see the error from your server

It's as though the layer does not exist. I would recommend reindexing your items using the refresh button at the top of your data manager if you have not already.

One dataset failed to download because there are no features. That is a known bug but I'll admit not very high priority since there's nothing to download anyways: http://gis.vtanr.opendata.arcgis.com/datasets/7e2083dd710f405c80b3e6f50a6d5a4d_75

That's all I've found so far. Let's start with what I recommended then move from there.

Re: ArcGIS Open Data - Shapefile Currently Unavailable

JoanDelos_Santos — Tue, 25 Oct 2016 20:21:43 GMT

Wondering whether this was ever resolved? We are having similar issues with our Open Data site (geodata.hawaii.gov) - we are in the process of making this our primary distribution method - 300 layers - however, there are a multitude of problems, primarily related to when data is cached. The latest issue is that a download of our contours (100 foot contours, Hawaii Island) does not complete (shapefile not available) - eventually, there is a message offering to use "unfiltered version created on 1/6/16" - however, we updated all of our data in June and again on October 6. So it is offering old data. We rebuilt the index last week and the item description says that the data was last updated 8 days ago...

Re: ArcGIS Open Data - Shapefile Currently Unavailable

CourtneyClaessens — Tue, 25 Oct 2016 20:52:33 GMT

Hi Joan,

I reset the cache on the Hawaii Elevation Contours dataset and it is now downloading successfully.

We had an issue with the way we were handling http requests that is now resolved. I recommend resetting the problem datasets and trying the download again.

Let me know if you are still experiencing issues after that and I will troubleshoot some more.

Thanks,

Courtney

Re: ArcGIS Open Data - Shapefile Currently Unavailable

JoanDelos_Santos — Tue, 25 Oct 2016 20:59:21 GMT

Hello,

Thank you Courtney. By resetting the cache, do you mean updating the index for that service?

Also – I guess that we won’t know which datasets are problem datasets unless someone lets us know? It’s not reasonable for us to have to reset the index for each dataset…

Are you saying that the http issue is resolved in that I shouldn’t have this problem any longer?

Thank you,

Joan

Re: ArcGIS Open Data - Shapefile Currently Unavailable

CourtneyClaessens — Thu, 27 Oct 2016 18:05:55 GMT

Hi Joan,

Yes, that is what I mean. You can hit the circular button next to the dataset in your Data Manager. In the Data Manager you should see errors on any datasets that have failed their last download - these are the ones you want to reset.

You shouldn't see these kinds of errors anymore. If you do, please post here or email me directly with details.

Thanks,

Courtney

Re: ArcGIS Open Data - Shapefile Currently Unavailable

JoanDelos_Santos — Thu, 27 Oct 2016 19:01:22 GMT

Ok, got it, thank you very much!

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Joan Delos Santos

Hawaii Statewide GIS Program

State of Hawaii, Office of Planning

235 S. Beretania St., 6th Floor

Honolulu, HI 96813

Phone (808) 587-2895

Re: ArcGIS Open Data - Shapefile Currently Unavailable

ChrisBardash — Wed, 02 Nov 2016 17:23:30 GMT

I am having some similar problems with our site (www.txdot.gov/opendata). We have several large datasets on there, some of which download fine and others which do not. For the TxDOT Roadway Inventory service, the download button does not show the option for File Geodatabase, while all of the others do. Also, downloading the shapefile of this and other layers fails, saying that an error occurred, but give no further explanation. I have gone to the Data Manager and clicked the reset button for those that do not, but it did not help.

Furthermore, for some services like the TxDOT Roadway Inventory 2013, I get the error "You do not have permissions to access this resource or perform this operation," yet all of these services are shared with everyone (public).

All of our data is hosted on ArcGIS Online. Each service only contains a single layer. All of them were published directly via ArcPro. Everything should be the same.

Re: ArcGIS Open Data - Shapefile Currently Unavailable

PhilLarkin1 — Wed, 04 Oct 2017 17:11:37 GMT

I also receive the permissions error when attempting to download a large file geodatabase:

http://gisdatacatalog-spokanecounty.opendata.arcgis.com/datasets/elevation-contours