Uploading Enterprise geodatabase items to Open Data Hub

[AJ_devaccount]

We're currently redesigning the architecture of our organization, and want to store all our data in Enterprise geodatabase. What would be the best way to upload Enterprise geodatabase items to our public Open Data Hub?  And would it be possible for the AGOL/Hub item to automatically update whenever the geodatabase data updates?

Thank you very much for your help!

[ABishop]

Hello AJ,

When you redesign your architecture, what will it look like?  For instance will you have an ArcGIS Server and plan to publish your services or host them in AGOL?  You could possible do both.  Just wanted to get a better idea of the plan before answering your question.

[AJ_devaccount]

Hi Amanda, 

Thanks for your response! We're looking at all options. I could find information on uploading from an enterprise geodatabase to Portal. But couldn't find anything for uploading to AGOL from an enterprise geodatabase . Would the steps be the same as if we were using a regular file geodatabase?

[NFlourish]

Do you have an entire ArcGIS Enterprise setup, or at least an Enterprise GeoDatabase AND and ArcGIS Server? If you can expose the data via a map or feature service from your ArcGIS Server (or Portal), you can then create an item in ArcGIS Online that basically links to that map/feature service on your ArcGIS Server. If you then add that ArcGIS Online item to a map or Hub or whatever, and view it, it is literally drawing the data directly from your Enterprise GeoDatabase. Thus, as the database is updated, the maps and dashboards built in AGOL would update automatically.

[AJ_devaccount]

Thank you for your response! We do have an Enterprise setup, just not the entire version. This might sound like a dumb question, but is publishing a map/feature service in Server vs Portal the same? 

Also since the Open Data Hub will be public, and the AGOL item links to a local server, is there any security concerns? Would the public have to log in to be able to download data from the Hub?

[MatejVrtich · Accepted solution]

Hi,

If you have an ArcGIS Enterprise base deployment (Server federated with a Portal) you can publish the data in bulk: https://enterprise.arcgis.com/en/portal/latest/use/bulk-publish-arcgis-server-feature-layers.htm.

This will create a service endpoint and a portal item for every single Feature Class/Table accessible thru the registered enterprise geodatabase connection.

If an enterprise geodatabase data contain the standard metadata (hopefully), this will be also published along with the portal item metadata.

Moreover, data and metadata updates are automatically accessible thru the published services/portal items.

Then, you can setup a collaboration between the ArcGIS Enterprise and ArcGIS Online: https://enterprise.arcgis.com/en/portal/latest/administer/windows/set-up-an-arcgis-enterprise-and-ar....

The collaboration will transfer selected portal items with its metadata to ArcGIS Online and also sync any updates which might happen on the Enterprise side.

Lastly, the service endpoints (REST API) of data published in the Enterprise has to be publicly accessible on the Internet, to be available to ArcGIS Hub as a downloadable data.

Matej

[AJ_devaccount]

Thanks for the detailed response @MatejVrtich! Referring to your last point that the Enterprise service has to publicly accessible for it to be downloadable in Hub, does that mean the ArcGIS GIS Server will have to be sitting outside of our firewall?

[MatejVrtich]

Yes, one option may be to place the GIS Server or better all ArcGIS Enterprise components outside your firewall.

Another very widely used technique is to expose ArcGIS Enterprise (Server / Portal) via a perimeter network reverse proxy server (DMZ). This is well documented here:

https://enterprise.arcgis.com/en/server/latest/deploy/windows/single-machine-deployment-with-reverse...
https://enterprise.arcgis.com/en/portal/latest/administer/windows/using-a-reverse-proxy-server-with-...
https://enterprise.arcgis.com/en/server/latest/deploy/windows/using-a-reverse-proxy-server-with-arcg...
You can also deploy ArcGIS Enterprise completely outside your network in the public cloud environment of your choice (AWS, Azure, ...).

In any case, if your only intention is to power the Hub data of your enterprise geodatabase, not to use other portal options, the REST API of GIS Server services is the only thing you need to reveal.

Matěj