Open Data Downloads not working (NPDC geohub)

[MelissaBrooks]

Introduction

Downloading from https://geohub.npdc.govt.nz/ Open Data is failing, not obvious error codes in F12.

Background

After adding a new item to our Open Data attempted to download  we encountered the attached error message.

Newly Added: https://geohub.npdc.govt.nz/datasets/6914a84f71e64604bed7192e825a9bc0_10/ 

I then checked other Open Data items on our Hub and had a similar issue. They may have had a previously cached file to download but new/updated file requests were not working.

Issue

The downloads are not working and may have not been for a while now. I'm looking at the geodatabase downloads especially, but not exclusively.

This also now leads me to a concern with understanding how and how often Hub/Open Data updates these precached download files. I remember some documentation, but is this how it works in practice, and further, is this working as intended in our case?

Summary

Can someone please help look into this. I'm happy to test, and also have our infrastructure team available if we've not set firewalls up correctly etc... but in the first instance it would be good to have the Hub/Open Data product looked at especially with the new updates recently.

Thanks in advance

Melissa Brooks

Senior GIS Analyst

New Plymouth District Council

@ThomasHervey1  @JustinPrather 

[ThomasHervey1]

Update: 2023-08-18

At this time, I am no longer able to reproduce the issue with the example item provided. Upon further investigation, we have determined that the the service directory does not need to be enabled in order to support downloads. This is contrary to the original response below.

---

Hi @MelissaBrooks 
We've investigated and it appears that there is likely a configuration on the underlying service that is preventing the create replica function to run. This function is needed for Hub downloads. It appears that the service folder has been disabled: https://atlas.npdc.govt.nz/server/rest/services/OpenData/Infrastructure_Water_Supply/FeatureServer/
I believe that you'll need to adjust the settings on the service to make sure that it can be publicly accessed.

Looking forward, we anticipate adding better error messaging within the application for issues like this.

[MelissaBrooks]

Hi @ThomasHervey1 

Thanks for the reply. We implemented the restriction to the service directory as per Disable the Services Directory—ArcGIS Server | Documentation for ArcGIS Enterprise . This is something we've had on since we implemented Enterprise.

Can you confirm this is the reason the create replica function would not be working and let us know of a scenario where we can both comply with ESRI best practice (re service dir) and have a fully functional Open Data (where create replica is allowed).

is it that the create replica function has to to be an html request (which is blocked by the above service directory setting)? could it be a changed to a json request instead?

Happy to talk more and hear your thoughts on this. I'm not able to lift the restriction to our service directory as our org is following the above guideline.

Cheers

Melissa

[MelissaBrooks]

Hi All, 

Just bumping the note above. I just wanted to keep this moving as our organisation heads towards adding more layers to our Open Data catalog in the near future. Let me know if I need to raise a more official ticket, and if so where/how I can do that.

Thanks again

Melissa Brooks

Senior GIS Analyst

New Plymouth District Council (NZ)

@ThomasHervey1 @JustinPrather 

[ThomasHervey1]

Update: 2023-08-18

At this time, I am no longer able to reproduce the issue with the example item provided. Upon further investigation, we have determined that the the service directory does not need to be enabled in order to support downloads. This is contrary to the original response below.

---

Hi @MelissaBrooks 
We looked into the issue and it is likely due to the fact that access to the directory is disabled. The other request types will not work because we cannot query properly. There may still be issues where the createReplica function fails, but I would recommend enabling the directory if at all possible. If you need to keep the directory access restricted, I think it would make sense to open an enhancement request so that we can start the investigation process and evaluate its priority in our backlog.

[MelissaBrooks · Accepted solution]

Hi @ThomasHervey1 

I've penned an idea in the Enterprise Exchange section, I had a discussion with our NZ vendor, they thought Enterprise might be the best place to start with the idea log. I will post here if anything come of this idea, thanks for your help looking into this. Please feel free to add what you can in the idea below as a comment. Any help appreciated.

Enterprise Idea - Disabled Service Directory : Special provision for Create Replica function to enab... 

Thanks

Melissa