Select to view content in your preferred language

Hub Downloads: A Stable and Reliable Future

1521
1
02-07-2022 07:06 AM
ThomasHervey1
Esri Contributor
4 1 1,521

In 2021, ArcGIS Hub released a new download experience aimed to inform users about download file options and the status when files are being generated. After a year of valuable feedback, we're taking reliability a step further so that downloads are faster and more predictable. Below you'll find a few important upcoming changes and roadmap milestones.
Stay tuned to the Hub changelog (hub.arcgis.com/pages/changelog) for the most up-to-date release information and the ArcGIS Blog (esri.com/arcgis-blog/overview) for in-depth articles about new Hub product capabilities.
 
February 2022: ArcGIS Hub will stop long-running download jobs
When data are updated, ArcGIS Hub will try to create updated files for each downloadable format. Starting in February 2022, Hub will stop file generation if it takes longer than 48 hours. To prevent any potential impact, all customers are encouraged to enable certain service-level settings including enabling extract capabilities for both hosted and non-hosted services.

For context, services that do not have extract and sync capabilities enabled, Hub still provides download functionality, but it is significantly slower. This is because Hub must manually page through all the records in the service. This can slow even more if there are millions of records or the service is running on an old machine. With extract capabilities enabled, Hub knows that it can use the service's createReplica function to create faster and more reliable downloads.

The team will continue to diligently test and fix bugs to the current download experience while we shift our focus to a new download architecture.
 
May March 2022: Enhanced Hosted Downloads in Beta
In March 2022, Content managers can try out a beta feature called "hosted downloads" that uses a different download architecture. This capability will be available for any content that is shared to ArcGIS Hub and served by a hosted feature service (Feature Layers or Tables). After content managers enable the capability for individual content,users will see more download formats, faster downloads, and fewer file-generation errors.
 
UC 2022: Announcement for Hosted Downloads
The ArcGIS Hub team is targeting early Summer 2022 to fully release the Hosted Downloads capability. During the Spring and Summer of 2022, the Hub team will collect usability feedback as we plan for enhancements in late 2022. During UC 2022, the Hub team will announce the support roadmap for Hub downloads through 2023. While the team expects to maintain support for downloads from ArcGIS Server versions >= 10.8 for at least another year, we plan to phase out support for older servers towards the end of 2022.

In order to avoid lost functionality and to take advantage of a more reliable download system, we encourage customers to switch their services to Esri hosted services. If this option does not work for you or your team, we encourage all customers to consider upgrading their services to use ArcGIS Server versions to at least 10.8.

Tags (3)
1 Comment
JoshKalovGIS
New Contributor III

Hi @ThomasHervey1 

It is great to hear that there are improvements planned for downloading.

There are some conflicting recommendations in this post and the Hub documentation pages, particularly Server configuration details—ArcGIS Hub | Documentation.

On that page it says:

Feature Access is not necessary

ArcGIS Hub queries features out of the Map Service the same way it queries features from a Feature Service. Unless you have another need to have Feature Access enabled, it is best to leave it off.

Your post however recommends having extract and sync capabilities enabled for both hosted and non-hosted services. I believe extract and sync capabilities are only available with "Feature Access" enabled (so, on a FeatureServer endpoint). So is the recommendation now to have Feature Access enabled and use FeatureServer endpoints in Hub?

 

February 2022: ArcGIS Hub will stop long-running download jobs
When data are updated, ArcGIS Hub will try to create updated files for each downloadable format. Starting in February 2022, Hub will stop file generation if it takes longer than 48 hours. To prevent any potential impact, all customers are encouraged toenable certain service-level settingsincluding enabling extract capabilities for both hosted and non-hosted services.

For context, services that do not have extract and sync capabilities enabled, Hub still provides download functionality, but it is significantly slower. This is because Hub must manually page through all the records in the service. This can slow even more if there are millions of records or the service is running on an old machine. With extract capabilities enabled, Hub knows that it can use the service's createReplica function to create faster and more reliable downloads.

An unrelated general request... In posts, change log, and documentation, please make it clear when you are referring to ArcGIS Online Hosted feature services vs Portal Hosted feature services vs either/both. For the March 2022 paragraph above, its not clear which kind of Hosted services its referring to.

Thank you
Josh

About the Author
Thomas Hervey is working on search, discovery, content management, and interoperability tools in support of community collaboration and engagement on the ArcGIS Hub and Enterprise Sites team.