Nightly Update Option For Opendata Sites

[CraigSwadner]

We have had several issues with our data updating.  After talking to other municipalities it seems to be a huge flaw in the software for customers not to have the ability to choose an automatic nightly update.  ESRI appears to have fixed the issue where you download a dataset it will create a new cache of data, however it could go days, weeks, months, maybe years before someone downloads that dataset again.  There really needs to be a way customers can set their sites to initiate a nightly update of their dataset caches ....

[HelenaMcMullen]

Our Open Data site has not yet been made public due to concerns that the data downloaded does not reflect current data. In testing we have noticed that the preview and table are current/correct but the full dataset download is out of date. The Reset Dataset tool does not appear to be working at refreshing or removing the cache. We would prefer to have a customer wait a few minutes until a new cache is generated or as Craig suggested provide the  organizations the option to re-cache their data nightly or at a predetermined interval..  

[KyleWikstrom]

Our local government clients have thrown around the idea of firing up the old FTP sites again if this issue isn't resolved soon.

[KevinMacLeodCAI]

I think they basically just came out with the solution for this if you have Enterprise. The idea is perfect, and it seems to work great so far that I have seen. They now CDN cache your Items if you add data with Add URL in Content, and you share your REST service with your data to the AGOL Org. If it is secured, embed the credentials. Then, the data which is on your on-prem server syncs from your server automatically to AGOL CDN; works great in OpenData for downloading and searching, and leverages the powerful Esri CDN bandwidth. Hope this helps --  Here is where this gem is discussed:

What’s new in ArcGIS Online (June 2021) (esri.com)