topic Re: Stand alone server upgrade - Do I need a Data Store? in ArcGIS Enterprise Questions

Stand alone server upgrade - Do I need a Data Store?

ZachBodenner — Tue, 04 Jan 2022 17:57:34 GMT

Hello,

At some point in the not-too-distance future I plan to upgrade a stand alone ArcGIS Server from 10.6.1 to 10.9.1. The server is not part of our Enterprise base deployment and so is not federated with portal.

Examining what is currently installed on the server machine itself, I have an installation of Desktop 10.6.1, Server 10.6.1, and Data Store 10.8.1. When I open the Data Store configuration wizard, it says that it is currently configured as a relational data store and links to our Portal Site (which is 10.8.1). However, I can't find any other installs of Data Store that are configured with the stand alone server.

I've consulted ESRI's documentation but so much of it is focused on the Enterprise/Portal/Federated deployment model. The best I can find is this nested section on upgrading a single machine site (https://enterprise.arcgis.com/en/server/latest/deploy/windows/upgrade-arcgis-server.htm#GUID-3F92EFC3-A324-4E66-84DD-8A6B3A3CA296) that doesn't seem to reference a Data Store, and this documentation (https://enterprise.arcgis.com/en/server/latest/install/windows/single-machine-deployment.htm) that doesn't mentioned Data Store either.

So...do I actually need a Data Store installation for a stand alone server? The data referenced on the server will be coming almost exclusively from enterprise geodatabases - I don't believe it will need hosted feature layers, but does need to be able to have cached image map services. I'd like to avoid a situation where the server upgrade goes mostly smoothly but gets tripped up because I couldn't figure out ESRI's documentation.

Re: Stand alone server upgrade - Do I need a Data Store?

ReeseFacendini — Tue, 04 Jan 2022 18:11:46 GMT

A standalone ArcGIS Server installation does not need ArcGIS DataStore to be configured. ArcGIS DataStore is used only within a fully deployed ArcGIS Enterprise, and only Portal for ArcGIS can created hosted layers, so all data within a standalone ArcGIS Server needs to be referenced either from disk or an Enterprise geodatabase.

Re: Stand alone server upgrade - Do I need a Data Store?

ZachBodenner — Tue, 04 Jan 2022 18:14:46 GMT

See now why is that so hard to put in the documentation somewhere?

Re: Stand alone server upgrade - Do I need a Data Store?

JamalNUMAN — Sat, 01 Oct 2022 19:24:00 GMT

What is the function of ArcGIS Data Store? What are its benefits?

Re: Stand alone server upgrade - Do I need a Data Store?

Scott_Tansley — Mon, 03 Oct 2022 03:29:08 GMT

https://enterprise.arcgis.com/en/portal/latest/administer/windows/what-is-arcgis-data-store.htm

Re: Stand alone server upgrade - Do I need a Data Store?

JamalNUMAN — Mon, 03 Oct 2022 06:19:14 GMT

I got this video that explains the functionality of “data store”,

https://www.youtube.com/watch?v=_LFzszE6bKc

When publishing data with ArcGIS Online, there is no option to reference (register) the data to avoid copying it to the server, and thus it’s compulsory that the data will be copied to cloud! I think that the “data store” has the same functionality; it’s equivalent to copying the data to cloud

Re: Stand alone server upgrade - Do I need a Data Store?

Scott_Tansley — Mon, 03 Oct 2022 06:36:57 GMT

Basically, a base deployment of ArcGIS Enterprise is conceptually the same as the core offering of ArcGIS Online. A server, connected to a datastore and fedarated with a portal allows you to create hosted feature layers, and some other options, the same as AGOL. The difference being that it's your infrastructure and you manage it.

The reference concept is no different to the traditioanl model of using an ArcGIS Server, which I believe you have an use.

Many people still use an ArcGIS Server to support their ArcGIS Online operations. It's actually very sensible to have a separate ArcGIS Server to work alongside your base deployment, and then don't referenece data on your hosting server:

https://enterprise.arcgis.com/en/get-started/latest/windows/additional-server-deployment.htm#ESRI_SECTION1_DD3657E382A44370923E4E86C1F9B582:~:text=Many%20organizations%20separate%20these%20functions%20into%20two%20distinct%20ArcGIS%20Server%20sites%20to%20improve%20the%20performance%20of%20their%20deployment.

In this way you treat the base deployment 'server' just like you would AGOL, and the 'other' server like a traditioanl one. I'd recommend federating though to get the security.

Re: Stand alone server upgrade - Do I need a Data Store?

JamalNUMAN — Mon, 03 Oct 2022 07:02:06 GMT

But if the ArcGIS Server is federated in the Portal which allows referencing the data, then what is the benefit of ArcGIS Data Store?

Two cases:

Referencing the data allows publishing the data without the need to physically copy it to the server.

Copy all data: allows copying the data to the server

Then what’s the difference between the “ArcGIS Data Store” and “Copy All Data”? they are performing the same sort of functionalities

Re: Stand alone server upgrade - Do I need a Data Store?

Scott_Tansley — Mon, 03 Oct 2022 07:15:18 GMT

Referenced data is published as a Map Service or Map Image Layer, depdning on preferred terminology. It uses an older publishing technology that uses ArcSOC.exes on the server. Each uses memory and has a compute footprint. All of that means that architecturally you can only scale so far, i.e. deliver a finite number of map services. You can make those map services into feature services for editing, but you use even more memory etc. If you're using Dedicated Service Instances then ~100 is the arbitraty max number of services from a single ArcGIS Server Site. If you use Shared Instances then you can have hundreds of services.

Hosted Feature Layers can only be provided from a base deployment of ArcGIS Enterprise, it needs the Portal, Hosting Server and Data Store. Put them together and you have a lightwweight architectural paradigm that could allow you to stand up 10,000's of individual services. However, you're presenting data not maps, subtle but important difference.

Also some functions inside of a Portal (analytics/Insights) use Hosted Feature Layers as temporary storage.

Basically, if you want to use Enterprise, you need a Data Store. It's down to you how you publish.

In summary, Hosted Feature Layers from the Data Store scale better.

Re: Stand alone server upgrade - Do I need a Data Store?

JamalNUMAN — Mon, 03 Oct 2022 18:36:44 GMT

Till now, I couldn’t figure out the function of ArcGIS Data Store. How can I touch its benefit?

For example, in the screenshot below, what is the difference between publishing the “electricpole” service with or without having the “ArcGIS Data Store” configured?

Re: Stand alone server upgrade - Do I need a Data Store?

Brian_Wilson — Wed, 20 Mar 2024 05:08:39 GMT

You asked "what is the difference between publishing the “electricpole” service with or without having the “ArcGIS Data Store” configured?"

If you use "referenced registered data" you have to have an Enterprise Geodatabase to store your data and Server will use that. If you don't have any Enterprise Geodatabase then you have to use the "copy all data" option and that means "create a hosted service" and it stores the data in the ArcGIS DataStore.

It is pretty easy to set up your own geodatabase server using PostgreSQL. What's inside "ArcGIS DataStore" relational datastore?? It is PostgreSQL.