topic Re: Open Data FGDB not downloading after being updated. in ArcGIS Hub Questions

Open Data FGDB not downloading after being updated.

CortDaniel1 — Tue, 02 Jul 2019 17:44:11 GMT

#We have been experiencing this problem intermittently for several months. Our data is being hosted. After running an update, the file geodatabase does not download. The setting is checked to allow FGDB downloads. Updates are made using ArcMap 10.6. When the download FGDB option is clicked, the download button animates, but the file never downloads.

The only way to fix the problem is to delete the hosted feature service, and re-publish it. The description and custom license then need to be recreated in the administrator. Is anyone else experiencing this issue?

Here is an example of a data set with this problem.

https://gisdata-piercecowa.opendata.arcgis.com/datasets/drainage-network-structure-polygons

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Wed, 10 Jul 2019 18:06:17 GMT

Hello Cort -

I'm happy to take a look at this. The posted link 404s however. Do you have another example dataset I could examine?

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Thu, 11 Jul 2019 16:13:13 GMT

Hi Rich,

Here is another example: https://gisdata-piercecowa.opendata.arcgis.com/datasets/sewer-miscellaneous

Thanks!

Cort

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Fri, 26 Jul 2019 16:52:56 GMT

Hi Cort -

Sorry for the long delay. We've just pushed a fix for the error you were experiencing on https://gisdata-piercecowa.opendata.arcgis.com/datasets/sewer-miscellaneous. I've tested and it looks like it remedies the issue you had downloading this dataset.

Rich

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Fri, 26 Jul 2019 17:29:56 GMT

Hi Rick -

Thanks for addressing the issue and pushing the fix. We will continue to monitor the FGDB downloads to be sure the fix works.

Is there a chance the fix also fixed an older problem that I reported in April 2019? Sometimes when data is updated our Open Data web site shows a new date and correct record numbers, but the data downloaded is old.

Here is the URL to the posting with more details.

https://community.esri.com/thread/231194-data-updated-on-open-dataarcgis-hub-but-the-downloads-are-old

We are not the only agency having this issue. The only reliable way we found to fix it the problem is to delete the data and republish it. We fix our data when we discover the issue Checking for this problem is now part of our quality control checks for when we update data.

The City of Tacoma and Washington State DNR are having this issue too. I just reported it to them yesterday, and they may have fixed the data. Here are the examples I found:

https://geohub.cityoftacoma.org/datasets/tacoma-street-network-service

http://geo.wa.gov/datasets/wadnr::dnr-proprietary-roads-statewide

Thanks,

Cort

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Tue, 30 Jul 2019 17:32:38 GMT

Rich, @ Rich Gwozdz

The problem is back: https://gisdata-piercecowa.opendata.arcgis.com/datasets/permits-pierce-county/data

We can leave this out there today July 30th until 2:30 PM PST.

Cort

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Tue, 30 Jul 2019 19:27:56 GMT

Cort - Thank you for reporting this and keeping the dataset up long enough for me to inspect. We've identified the cause of the current error and are working to fix.

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Wed, 31 Jul 2019 19:02:12 GMT

Cort - We have just pushed a intended fix for the error observed on attempted download of FGDB file you noted on https://gisdata-piercecowa.opendata.arcgis.com/datasets/permits-pierce-county/data. I was not able to completely confirm the fix given the noted dataset was removed and the error we are trying to handle from the hosted service is intermittent and not observed on our test datasets. Thank you for bring this to our attention and keeping the dataset in place so we could observe.

Re: Open Data FGDB not downloading after being updated.

Anonymous User — Thu, 12 Sep 2019 21:00:34 GMT

Hi Cort,

You mentioned in another post that you're still experiencing this issue, but the fgdb samples in this post all appear to be downloading as expected. Can you update with a dataset that fails to download as fgdb? Rich Gwozdz and I can take it from there.‌

Thanks,

Patrick

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Thu, 12 Sep 2019 21:19:58 GMT

Patrick,

After 16 hours, the FGDB download that was not working is working. The hosted feature service was Tax Parcels (Tax Parcels)

When two others were updated, we were unable to check the allow Export Data to different Formats option. We eventual received this message.

These two feature classes were affected.

Guardrails

Parks polygons

Of course, now that I have your attention, the problems have disappeared. Heavy sigh.

Cort

Re: Open Data FGDB not downloading after being updated.

Anonymous User — Thu, 12 Sep 2019 21:53:11 GMT

Not being able to repro a bug when you have eyes on it is a frustrating feeling I know too well.

Regardless, 16 hours is way too long to wait for a download to cache. When you see it happening next reply here and we can get eyes on it quickly. As for the export option bug, the ArcGIS Online folks might be able to provide some assistance.

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Thu, 19 Sep 2019 14:10:04 GMT

Patrick,

We are experiencing this problem again. Our Address Points data was updated 11 hours ago. The FGDB download is not working. We have not toggled sharing off and on.

Let us know what you find out.

Thanks!

Cort

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Thu, 19 Sep 2019 21:56:59 GMT

Thanks, Cort. The last edit date on the service page (https://services2.arcgis.com/1UvBaQ5y1ubjUPmd/ArcGIS/rest/services/Address_Points/FeatureServer/0) is 9/19/2019 3:25:26 AM GMT ( or 9/18/2019 8:25:26 PM

Pacific time). Does that match the time you last edited your data?

The files being currently downloaded from the site have a timestamp of 9/19/2019 7:13:39 AM Pacific time. So they do have a later timestamp than last edit date noted on server.

In an effort to confirm that the data isn’t updated, can you provide an OBJECTID and the expected data for a feature in the dataset that should be updated, but is not being observed as expected in the downloaded file?

Rich Gwozdz | Software Engineer

Esri

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Fri, 20 Sep 2019 13:23:25 GMT

Cort – Just to clarify, I find that the FGDB download works, but would like to verify whether or not it contains the content your expect.

Rich Gwozdz | Software Engineer

Esri

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Mon, 23 Sep 2019 15:21:47 GMT

Rich,

The FGDB I downloaded from Open Data appears identical to the internal source data.

Internal FC - last updated 9/18/2019:

max ObjectID = 5044939

# of records/rows = 388623

Last_Edited date = 9/12/2019

Open Data FGDB-FC - downloaded 9/19/2019

max ObjectID = 5044939

# of records/rows = 388623

Last_Edited date = 9/12/2019

The Address points data is updated Wednesday nights at 8:15 pm PST. The following morning we do several QC checks on the downloaded data. The process of downloading may trigger a caching refresh on your side. Toggling the sharing setting appears to trigger a refresh too. Can you download the data on Thursday morning? If you can, I will instruct our staff not to download this data before I hear from you.

Thanks,

Cort

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Mon, 23 Sep 2019 15:26:15 GMT

Thanks, Cort. I will plan on downloading Thursday morning.

Rich Gwozdz | Software Engineer

Esri

rgwozdz@esri.com

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Mon, 23 Sep 2019 16:25:00 GMT

Thanks! Let us know when you are done.

Re: Open Data FGDB not downloading after being updated.

RichGwozdz — Thu, 26 Sep 2019 13:23:14 GMT

Hi Cort –

I looked at the service and the cached files this morning. The file timestamps make sense. The service page shows a last edit date of 9/26/2019 3:25:24 AM (GMT) while the download files are stamped with 9/26/2019 3:32:49 AM (GMT). I’ve downloaded the FGDB. Do you what changed in the last edit? I’d like to ensure the file has the content you are expecting.

Rich Gwozdz | Software Engineer

Esri

rgwozdz@esri.com

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Thu, 26 Sep 2019 15:39:32 GMT

Rich,

The data we downloaded matches the changes we expected. Changes were made to both the spatial and tabular data. There were 399 changes, and a random sampling showed the data changed as expected. The record count matches our internal address point data.

In case you continue to test downloading the data after it's been updated, we have moved the update time to occur close to another related update process. The Address Points data will now be updated at 6:45 PM PST on Sundays.

Thanks,

Cort

Re: Open Data FGDB not downloading after being updated.

CortDaniel1 — Fri, 27 Sep 2019 18:52:06 GMT

Rich,

Our Development Engineering Land Use Other data was updated last night at 5:36 PM PST. After 19 hours the file geodatabase will not download.

Development Engineering Other Land Use

Cort