topic Re: Download Issues in Open Data / Hub in ArcGIS Hub Questions

Download Issues in Open Data / Hub

PatrickKielty — Wed, 02 Aug 2017 14:35:20 GMT

We have updated to version 2.0 of Open Data (now Hub). Our site mostly uses this Service to populate our Open Data data-sets: GISSUP/GISSUP (MapServer)

Some of the Services work and the user is able to download. For Example, this layer works fine: Layer: RMSSEG (ID: 10)

but then another Layer does not: Layer: RMSTRAFFIC (ID: 11)

The Map Preview on our Open Data page has a error message in the upper left: "An error occurred fetching map data" and when we attempt to download we get "Status: An error occurred. Download failed." Both data-sets are from the same database. I have tried resetting the service, Updating Index, and Reset Dataset and Downloads on ArcGIS Hub admin pages.

Re: Download Issues in Open Data / Hub

DanielFenton1 — Wed, 02 Aug 2017 16:59:01 GMT

Hi Patrick, I'm seeing an error with the SSL certificate that server is using. It looks good here: SSL Analyzer and SSL Certificate Checker | COMODO so I'm not yet sure what the issue is. We'll look into it.

Re: Download Issues in Open Data / Hub

ChristopherHardin — Thu, 03 Aug 2017 12:46:28 GMT

I am having the same issue trying to download layers from the Alabama GeoHub open data site. The same error message about 'download failed' comes up, but I am having no problems attempting to download other layers associated with a different account.

http://data-algeohub.opendata.arcgis.com/

Any help on this issue would be appreciated.

Re: Download Issues in Open Data / Hub

DanielFenton1 — Thu, 03 Aug 2017 15:08:47 GMT

Hi Christopher,

It’s unlikely that it’s the same underlying issue. Nevertheless, can you share a direct link to a dataset that is not downloading?

Thanks,

Daniel Fenton

Software Engineer | ArcGIS Hub

Re: Download Issues in Open Data / Hub

ChristopherHardin — Thu, 03 Aug 2017 15:31:37 GMT

Hi Daniel --

Thank you for looking into this. Here are the links to the specific datasets that I am having problems downloading:

http://data-algeohub.opendata.arcgis.com/datasets/VAGeoHub::butler-county-dot-centerlines

http://data-algeohub.opendata.arcgis.com/datasets/VAGeoHub::geneva-county-dot-centerlines

http://data-algeohub.opendata.arcgis.com/datasets/VAGeoHub::henry-county-dot-centerlines

Chris

Re: Download Issues in Open Data / Hub

ChristopherHardin — Tue, 15 Aug 2017 18:16:08 GMT

Hello Daniel --

Is there any update on this issue? I am still having the same problem downloading the above datasets. I tried downloading both spreadsheet and shapefile versions, from both Firefox and Edge.

Thank you-

Chris

Re: Download Issues in Open Data / Hub

PatrickKielty — Tue, 22 Aug 2017 18:25:54 GMT

We still have no solution for this issue. About 1/3 of our services will not work. Some I have been able to host on AGOL but our larger datasets are still have errors.

Re: Download Issues in Open Data / Hub

DanielFenton1 — Tue, 22 Aug 2017 19:34:01 GMT

We're still unable to determine why the certificate is rejected. We are working on another solution that involves upgrading some our infrastructure, but that is going to take some time.

I see that these services support http access. Are you able to register the services using their http url? That would be a good workaround from my perspective.

Re: Download Issues in Open Data / Hub

PatrickKielty — Mon, 28 Aug 2017 14:26:25 GMT

We have tried both HTTP and HTTPS with no success. Still get error messages and users are unable to download. Moved some data to AGOL as a temporary fix, but unfortunately, most of our data sets are too large or users need live data.

Re: Download Issues in Open Data / Hub

DanielFenton1 — Wed, 06 Sep 2017 19:45:26 GMT

Hey Patrick,

Have you opened a support ticket on this yet? I think we're going to need their help to diagnose all the potential causes.

Re: Download Issues in Open Data / Hub

bmanghi — Mon, 23 Oct 2017 13:34:05 GMT

Was this issue ever resolved? If so, you could some provide information on how it was resolved? We're experiencing download errors with our Open Data site (http://gis.yesvirginia.org/). Intermittently, a data set will download but more often than not, we're getting errors. We're using a custom domain and hosting our own map services (all of which respond correctly outside of Open Data).

Re: Download Issues in Open Data / Hub

PatrickKielty — Wed, 25 Oct 2017 15:18:03 GMT

Hi Beth,

Esri's thought was that there were too many vertices. They recommend 3 solutions. 1) Generalize the Lines to reduce the number of vertices. 2) Host directly on AGOL and 3) Split up the data into smaller areas. We have decided to upload data to AGOL as a temporary fix (even though it is a large dataset and will consume credits). We are currently working on splitting up the data and creating multiple feature services. In the future, i am hoping AGOL?Open Data will be able to handle large datasets since our organization has several layers we share that have over 500K records.

Re: Download Issues in Open Data / Hub

Anonymous User — Tue, 05 Mar 2019 18:11:54 GMT

Daniel,

I see some of the suggested items are to . 1) Generalize the Lines to reduce the number of vertices. 2) Host directly on AGOL and 3) Split up the data into smaller areas. We have a dataset that is updated every night, so these options are problematic - has there been any other solutions identified? thanks

Re: Download Issues in Open Data / Hub

PatrickKielty — Thu, 07 Mar 2019 16:23:29 GMT

Hi Linda, I am not sure if Esri has any updates but we still have several datasets that have download issues. Our best solution so far has been to host the data as a static File GeoDatabase and then provide a link for users to download the entire data set. We create a model to run the process automatically and it has worked pretty well so far. Still, I wish this issue would be addressed. It would be nice to just put our data on our server and let Open Data take care of the rest with out any problems.

Re: Download Issues in Open Data / Hub

CatherineWendland — Thu, 21 Mar 2019 22:18:14 GMT

I've also been having issues with some of my larger datasets. Most of the time when you click download>shapefile, they are "gathering data" for most of the day and eventually switch over to "download failed". I have services in the same MXD that work, so I'm not sure what the issue is.

Can someone please help?

https://data-seattlecitygis.opendata.arcgis.com/datasets/side-sewers-and-laterals

https://data-seattlecitygis.opendata.arcgis.com/datasets/legal-subdivisions-lines

https://data-seattlecitygis.opendata.arcgis.com/datasets/steep-slope-eca

https://data-seattlecitygis.opendata.arcgis.com/datasets/contours-2-ft

https://data-seattlecitygis.opendata.arcgis.com/datasets/contours-10-ft

https://data-seattlecitygis.opendata.arcgis.com/datasets/contours-50-ft

https://data-seattlecitygis.opendata.arcgis.com/datasets/cadastral-control-lines

Re: Download Issues in Open Data / Hub

Anonymous User — Fri, 22 Mar 2019 13:11:05 GMT

Hi Catherine,

Sorry to hear you've been having download issues with larger datasets. We have had similar reports from other users regarding larger datasets and are currently working on enhancements that will alleviate some of these problems.

That said, as these services are hosted on your own servers, I would recommend also opening up a support case to help triage. There may also be something amiss with the server settings that is causing the downloads to fail.

Best,

Patrick