nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Open Data FGDB not downloading after being updated.

CortDaniel1

#We have been experiencing this problem intermittently for several months. Our data is being hosted. After running an update, the file geodatabase does not download. The setting is checked to allow FGDB downloads. Updates are made using ArcMap 10.6. When the download FGDB option is clicked, the download button animates, but the file never downloads.

The only way to fix the problem is to delete the hosted feature service, and re-publish it. The description and custom license then need to be recreated in the administrator. Is anyone else experiencing this issue?

Here is an example of a data set with this problem.

https://gisdata-piercecowa.opendata.arcgis.com/datasets/drainage-network-structure-polygons

Find more posts tagged with

Accepted answers

All comments

CortDaniel1

Melanie,

Can you share the script you use to update the data or point me to where you found it?

Thanks!

Cort

ThomasHervey1

Hi Melanie,

I'm sorry that you're having this issue. When you unshare and then reshare an item publicly, Hub indexes the item and creates download files, so this is a fallback solution. We've recently introduced an option to manually recreate download files. Take a look under an item's edit route and under the more '...' menu you'll find an option to 'recreate download files'. It's a new feature so feedback is welcome.

MelanieWawryk

We also have this issue and update most of our layers daily through ArcPro and a python script. Manually unsharing and then sharing them seems to resolve the issue. I will try to add and unshare followed by a share into the script.

Subu_Swaminathan_GISP

Hello Rich,

This morning we were contacted by a user who was not able to download the roads data.

https://gisdata-piercecowa.opendata.arcgis.com/datasets/roads

The issue seems widespread in that all of the Pierce County data is affected.

I also had trouble downloading the Development Engineering data.

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-other-land-use

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-short-plats

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-mobile-homes

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-large-lots

https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-engineering-formal-plats

It seems that other data is also not downloading Roads, Tax Parcels, Address Points.

I was successful in downloading the Wetland Inventory from Tacoma.

https://geohub.cityoftacoma.org/datasets/wetland-inventory-tacoma-pds

Subu

RichGwozdz

Ok, thanks for the additional information. I currently don’t find any problems downloading the datasets you listed, so it appears the fix we released earlier may have handled these cases. I’ve also checked the Cities dataset and found it to download as expected.

Rich Gwozdz | Software Engineer

Esri

rgwozdz@esri.com

CortDaniel1

Rich,

Thanks for promptly looking into this. We will to un-share and then re-share any data we update. There is a new twist on this problem though. We had assumed the download problem only occurred when data was updated. We discovered today that data that was downloading just fine had stopped downloading. Zoning data was updated on 8/2 and Development Process Areas was updated 7/25. Additionally, a site user reported that the Cities in Pierce County shapefile was not downloading. It was updated 8/19 and like the other two, had been downloading fine.

Cort

RichGwozdz

Hi Cort –

Thanks for flagging this. Please try the Pierce County datasets again. We’ve pushed a bug fix in the last hour. I successfully downloaded all fgdb and shp files for the three datasets you listed.

With respect to the City of Tacoma data, was the “Export Data” feature for these datasets just recently enabled?. Enabling “Export Data” is what triggers the option to download FGDBs. Unfortunately, we don’t receive direct notifications when the state of “Export Data” changes, thus making it difficult to update the download menu properly. As we work to remedy this short-coming, our advice has been to un-share and then reshare the dataset. This will trigger the system to check the status of “Export Data”.

Rich Gwozdz | Software Engineer

Esri

rgwozdz@esri.com

CortDaniel1

Rich,

The downloading problem is occurring again. We noticed that it is not only data sets were updated recently. The problem is affecting both shapefiles and FGDB. It is not affecting all data sets. The City of Tacoma's GeoHub site is experiencing the problem too. Here are the affected data sets we found.

Pierce County's

https://gisdata-piercecowa.opendata.arcgis.com/datasets/address-points (updated 9/29/2019 fgdb and shp)
https://gisdata-piercecowa.opendata.arcgis.com/datasets/zoning-and-land-use-designations (updated 8/2/2019 fgdb and shp)
https://gisdata-piercecowa.opendata.arcgis.com/datasets/development-process-areas (updated 7/25/2019 fgdb and shp)

City of Tacoma's

https://geohub.cityoftacoma.org/datasets/wetland-inventory-tacoma-pds (updated 9/24/2019 shp - no fgdb available)
https://geohub.cityoftacoma.org/datasets/biodiversity-corridors-tacoma-pds (updated 9/26/2019 shp - no fgdb available)
https://geohub.cityoftacoma.org/datasets/tacoma-street-network-service (updated 9/15/2019 shp - no fgdb available)

Cort

RichGwozdz

That last comment sent before I was finished.

If the service doesn't expose "Last Edit Date" we attempt to detect changes by analyzing the statistics of the service periodically. If statistics suggest a change, the data will get re-cached. Since the system only checks periodically, re-caching won't occur immediately following a change. Note that the effectiveness of change detection using service statistics depends on the nature of the change, so if you can configure your service to expose "Last Edit Date", your recaching will be more reliable.

RichGwozdz

Hi Kenny -

It depends on if your ArcGIS service exposes the "Last Edit Date" field - it's not the default on all instances. If the service does expose "Last Edit Date", it should happen automatically, but not immediately, We don't currently receive notifications of a changed "Last Edit Date" from services. Instead, we have to poll them periodically to detect whether Last Edit Date has changed, and if it has, we re-cache. So there can be some latency it updating the cache. Re-sharing is an alternative to waiting for the periodic refresh to occur as scheduled.

KennyKleewein

Hello,

Our Open data downloads were incorrect but un-sharing and re-sharing the data to the open data group reset the download cache for us.

Sounds like this is now suppose to happen in the future automatically? Open data is suppose to detect a change in the data and clear the cache?

Thanks for the posts.

Kenny

CortDaniel1

Rich.

Thanks for looking into this issue. When we applied the workaround to get the data downloads to refresh, the FGDB downloads worked.

The workaround is:

Update the data.
Un-share the data.
Wait until the data is no longer available on your Open Data Portal.
Re-share the data.

I assume forces another cache of the data, the same thing you did. We will continue to toggle sharing to allow our users to download file geodatabases. We will monitor the ArcGIS Hub change log for anything that may indicate the caching/download issues and errors have been fixed. If you can, it would be great to let us know on this post, so I get emailed.

Thanks,

Cort

RichGwozdz

Hi Cort –

We received an unspecified error from your server during recaching. When such errors happen, our system waits 24 hours before attempting another cache of the data. The dataset was in this holding period; I’ve forced a retry and the file downloads without issue.

We understand that the messaging of caching/download issues and errors needs improvement and are working to improve it.

Rich Gwozdz | Software Engineer

Esri

rgwozdz@esri.com

CortDaniel1

Rich,

Our Development Engineering Land Use Other data was updated last night at 5:36 PM PST. After 19 hours the file geodatabase will not download.

Development Engineering Other Land Use

Cort

CortDaniel1

Patrick,

We are experiencing this problem again. Our Address Points data was updated 11 hours ago. The FGDB download is not working. We have not toggled sharing off and on.

Let us know what you find out.

Thanks!

Cort

Anonymous User

Not being able to repro a bug when you have eyes on it is a frustrating feeling I know too well.

Regardless, 16 hours is way too long to wait for a download to cache. When you see it happening next reply here and we can get eyes on it quickly. As for the export option bug, the ArcGIS Online folks might be able to provide some assistance.

CortDaniel1

Patrick,

After 16 hours, the FGDB download that was not working is working. The hosted feature service was Tax Parcels (Tax Parcels)

When two others were updated, we were unable to check the allow Export Data to different Formats option. We eventual received this message.

These two feature classes were affected.

Guardrails

Parks polygons

Of course, now that I have your attention, the problems have disappeared. Heavy sigh.

Cort

Anonymous User

Hi Cort,

You mentioned in another post that you're still experiencing this issue, but the fgdb samples in this post all appear to be downloading as expected. Can you update with a dataset that fails to download as fgdb? Rich Gwozdz and I can take it from there.‌

Thanks,

Patrick

CortDaniel1

Rich, Rich Gwozdz

The problem is back: https://gisdata-piercecowa.opendata.arcgis.com/datasets/permits-pierce-county/data

We can leave this out there today July 30th until 2:30 PM PST.

Cort

CortDaniel1

Hi Rick -

Thanks for addressing the issue and pushing the fix. We will continue to monitor the FGDB downloads to be sure the fix works.

Is there a chance the fix also fixed an older problem that I reported in April 2019? Sometimes when data is updated our Open Data web site shows a new date and correct record numbers, but the data downloaded is old.

Here is the URL to the posting with more details.

https://community.esri.com/thread/231194-data-updated-on-open-dataarcgis-hub-but-the-downloads-are-old

We are not the only agency having this issue. The only reliable way we found to fix it the problem is to delete the data and republish it. We fix our data when we discover the issue Checking for this problem is now part of our quality control checks for when we update data.

The City of Tacoma and Washington State DNR are having this issue too. I just reported it to them yesterday, and they may have fixed the data. Here are the examples I found:

https://geohub.cityoftacoma.org/datasets/tacoma-street-network-service

http://geo.wa.gov/datasets/wadnr::dnr-proprietary-roads-statewide

Thanks,

Cort

RichGwozdz

Hi Cort -

Sorry for the long delay. We've just pushed a fix for the error you were experiencing on https://gisdata-piercecowa.opendata.arcgis.com/datasets/sewer-miscellaneous. I've tested and it looks like it remedies the issue you had downloading this dataset.

Rich

CortDaniel1

Hi Rich,

Here is another example: https://gisdata-piercecowa.opendata.arcgis.com/datasets/sewer-miscellaneous

Thanks!

Cort

RichGwozdz

Hello Cort -

I'm happy to take a look at this. The posted link 404s however. Do you have another example dataset I could examine?

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.