ArcGIS Open Data - Shapefile Currently Unavailable

[ANRGIS]

We are having intermittent issues with ArcGIS Open Data Portal.

We get errors that state "The shapefile you requested is currently unavailable. "

We can access our rest endpoint, ArcGIS Open Data can access the requested json, it just won't download the shapefile. Fiddle doesn't return any errors, but waits for a long time for each request. Perhaps a timeout issue... We have a very large Open Data REST endpoint which may be causing performance issues, but our recollection in the documentation is that Open Data caches our datasets in the cloud and presents them for download on request...

We worked with tech support weeks ago and they didn't have a great answer for us. The interface is completely uninformative and cumbersome. Typically the troubleshooting workflow involves us needing to reset the index/download for EVERY dataset that we have hosted. When you have 70+ layers available for download, this isn't an easy task and doesn't fix this issue immediately. Sometimes there are lags between suggested fixes and all of the sudden, "BAM!" it's working again, no worries, it's fixed, thanks, leave us feedback to let us know how your experience was!

What is the deal? We are currently using this for our data distribution method and if these intermittent issues continue, we are going to have to find another solution and recommend another solution to our partners as well.

We are curious if others are having the same issues and if so, what your troubleshooting patterns have been to fix it.

Thanks.

[DanielFenton1]

Would you please share the link to your open data site with us? I can take a look and see if there are any systemic issues with Open Data or your Map Services.

Thanks,

Daniel Fenton

[ANRGIS]

Home | Vermont Agency of Natural Resources - Open Data

[DanielFenton1]

I'm running a battery of tests against your services. I will let you know what I find.

[DanielFenton1]

Something I'm seeing a lot is your services returning a 500 error when trying to get the layer info. Did you change any of your services or URLs after you added them to your Open Data site?

Here are some examples:

http://gis.vtanr.opendata.arcgis.com/datasets/9bcec45e51cf42fe9ec7ea063137b4ea_40

http://gis.vtanr.opendata.arcgis.com/datasets/4781cd35d3f943eea5866db864a55ce0_39​

http://gis.vtanr.opendata.arcgis.com/datasets/f384e89099684eb99c0db7a08deecec7_41

http://gis.vtanr.opendata.arcgis.com/datasets/3a2ed94827b74763ae1209b1c28f1b9a_82

Click the Service URL to see the error from your server

It's as though the layer does not exist. I would recommend reindexing your items using the refresh button at the top of your data manager if you have not already.

One dataset failed to download because there are no features. That is a known bug but I'll admit not very high priority since there's nothing to download anyways: http://gis.vtanr.opendata.arcgis.com/datasets/7e2083dd710f405c80b3e6f50a6d5a4d_75

That's all I've found so far. Let's start with what I recommended then move from there.

[JoanDelos_Santos]

Wondering whether this was ever resolved?  We are having similar issues with our Open Data site (geodata.hawaii.gov) - we are in the process of making this our primary distribution method - 300 layers - however, there are a multitude of problems, primarily related to when data is cached.  The latest issue is that a download of our contours (100 foot contours, Hawaii Island) does not complete (shapefile not available) - eventually, there is a message offering to use "unfiltered version created on 1/6/16" - however, we updated all of our data in June and again on October 6.  So it is offering old data.  We rebuilt the index last week and the item description says that the data was last updated 8 days ago...

[CourtneyClaessens]

Hi Joan, 

I reset the cache on the Hawaii Elevation Contours dataset and it is now downloading successfully. 

We had an issue with the way we were handling http requests that is now resolved. I recommend resetting the problem datasets and trying the download again. 

Let me know if you are still experiencing issues after that and I will troubleshoot some more. 

Thanks, 

Courtney 

[JoanDelos_Santos]

Hello,

Thank you Courtney. By resetting the cache, do you mean updating the index for that service?

Also – I guess that we won’t know which datasets are problem datasets unless someone lets us know? It’s not reasonable for us to have to reset the index for each dataset…

Are you saying that the http issue is resolved in that I shouldn’t have this problem any longer?

Thank you,

Joan

[CourtneyClaessens]

Hi Joan, 

Yes, that is what I mean. You can hit the circular button next to the dataset in your Data Manager. In the Data Manager you should see errors on any datasets that have failed their last download - these are the ones you want to reset. 

You shouldn't see these kinds of errors anymore. If you do, please post here or email me directly with details. 

Thanks, 

Courtney 

[JoanDelos_Santos]

Ok, got it, thank you very much!

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Joan Delos Santos

Hawaii Statewide GIS Program

State of Hawaii, Office of Planning

235 S. Beretania St., 6th Floor

Honolulu, HI 96813

Phone (808) 587-2895