topic Download Issues - Consistent File Generation in Progress and then it says file generation failed. in ArcGIS Hub Questions

Download Issues - Consistent File Generation in Progress and then it says file generation failed.

MattJinman — Thu, 26 Aug 2021 11:59:48 GMT

Hello,

If you go to our Open Geography portal here - https://geoportal.statistics.gov.uk/datasets/local-authority-districts-may-2021-uk-bfc/explore?location=54.650000%2C-3.250000%2C6.32

and click on the Download button and if you click on Download it says file generation in Progress and the it says file generation error on all 4 available downloads. This has been happening recently on most of the boundaries we have uploaded recently.

The KML and GeoJSON ones all keep failing but the CSV and Shapefiles seem to be downloading fine.

Check out the new International Territorial Level 2 Boundaries https://geoportal.statistics.gov.uk/datasets/international-territorial-level-2-may-2021-uk-bfc/explore?location=55.340000%2C-3.316939%2C6.52

and click on the Download button and if you click on Download it says file generation in Progress and the it says file generation error on 2 of the available downloads - KML and GeoJSON downloads.

Re: Download Issues - Consistent File Generation in Progress and then it says file generation failed.

BillSchlatter — Tue, 07 Sep 2021 23:27:13 GMT

We had similar issues with some of our larger polygon datasets in our organization, as well. After some lengthy troubleshooting with Esri support, we found some things that helped, though we're still encountering some unexpected behavior.

In the layer's item page, open settings, and set the following:

1. Check "Keep track of created and updated features." Even if you don't regularly modify the layer, this lets Hub/Open Data Portal know whether the cached copy of the download needs to be replaced, which can save your users a LOT of time.

2. Click the "Optimize layers" button, check the box next to the layer name in the popup, click "Update". This improves the performance of large datasets in general, but it does increase the online storage footprint significantly.

3. Check the box next to "Allow others to export to different formats." This allows users to download the layer in an file geodatabase, and is supposed to improve performance on downloading other file types.

4. Click the "Rebuild Indexes" button, check the box next to the layer name in the popup, click "Rebuild". I guess up-to-date indexes help the layer export code work better? It doesn't make much sense to me, but when one of our layers stopped working recently, running this again fixed it, even though the layer hadn't otherwise changed so much as a single byte.

The tech support rep recommended un-sharing the layer while making these changes, as some of them can take a few minutes.

Re: Download Issues - Consistent File Generation in Progress and then it says file generation failed.

MattJinman — Wed, 08 Sep 2021 12:31:08 GMT

Thanks Bill, this does seem to work after having to wait 80 minutes for the File Generation to occur for CSV, KML, Shapefile and GeoJSON.

Re: Download Issues - Consistent File Generation in Progress and then it says file generation failed.

Todd_Metzler — Wed, 15 Sep 2021 20:07:33 GMT

Please see same reporting.

Re: Download Issues - Consistent File Generation in Progress and then it says file generation failed.

JasonHoward — Tue, 05 Jul 2022 21:20:27 GMT

The solution presented does not seem to work. Republishing the layer is the only thing that seems to get results. And this is happening with data that are not overly complicated, nor anything that gets updated on a regular basis. Please explain to us what the problem is - because this is still going on, almost a year after the initial post. And the way we typically find these problems is someone in the public saying "I can't download your data."