Data updated on Open Data/ArcGIS Hub but the downloads are old

[CortDaniel1]

We are hosting data on our Open Data web site.  When data is updated, we see data updated on parts of the website.  On the website, record counts and features change.   But the downloaded data is old. 

For example, we updated our Cities data at 12:30 pm.  We see the feature that was changed when following the, "Create Webmap" link.  The map below was created with webmap, and the highlight area is new.  

It has been 2 - 3 hours and the data downloaded is still not current.  

The date on the shapefile is old too.  

We have refreshed the index for this data several times.  

Here is the URL to this data: https://gisdata-piercecowa.opendata.arcgis.com/datasets/cities-in-pierce-county 

Is there a way we can refresh all of the data in our Open Data web site at the same time?

Thanks, 

Cort

[SusanCarlson]

Good morning Patrick,

The download data is good now.

Do you anticipate that the manual cache refresh will be able to be automated via script? We are a fast growing county and our data changes frequently.

Thanks, again!

Sue

GIS Web Administrator

Office of Mapping & Geographic Information

703-771-5949

[Anonymous User]

Glad to hear the download refresh came through. We're planning to add explicit control over download refresh in the UI in the next few months so you can set when the download cache is refreshed. We could open this up to scripting, but we're hoping adding a spot for this in the app itself will fully address the pain point of not having control over when caches are made.

[NinaRihn]

Patrick, has the cache control mechanism been added yet, or are you close to getting that?  

[ThomasHervey1]

Hi Nina,

We're hoping to release a new download UI within the next few weeks. After that, we will evaluate what steps need to be taken to add a cache control mechanism.

The likely first step will be to add an option under the more menu '...' when on a dataset's edit route (datasets/:id/edit) to re-cache a download. You can expect to see that feature in the next few weeks. Recent changes in our API has made it easier to control downloads without going through the UI. So, after the re-caching option is in place in the Hub UI, we plan to provide a way for authenticated users to re-cache downloads using our API.

[ThomasKonzel]

Has this manual cache process been implemented?  We get emails asking for updated data when the data on our Open Data Portal Hub site is up to date.  It's just that the reported data isn't accurate.  It's very frustrating for years now, to have to explain to users that the data is up to date.  If you're not able to create a process to manually cache the data, then AT LEAST give us a check box to remove any reported data due to inaccuracies.