topic Re: Why would I install ArcSDE with 10.1? in Data Management Questions

Why would I install ArcSDE with 10.1?

AlanToms — Thu, 10 May 2012 18:01:36 GMT

Hello all,
Why would I install ArcSDE with 10.1? It seems I can us ArcCatalog to create an enterprise geodatabase without SDE then have all my users use direct connections. What am I missing?

Thank you
Alan

Re: Why would I install ArcSDE with 10.1?

JakeSkinner — Fri, 11 May 2012 12:04:19 GMT

Hi Alan,

With ArcGIS 10.1 you can connect to an enterprise database that does not have an SDE geodatabase repository and create feature classes with a native spatial type. For example, you could connect to a SQL Server database and import/create feature classes with the GEOMETRY or GEOGRAPHY spatial type. However, you can only view this feature class. You cannot perform any edits, or have the feature class participate in any geodatabase functionality (such as replication, topology, geometric networks, relationship classes, network datasets, etc). Essentially, you are getting a 'view' only feature class w/o SDE.

Re: Why would I install ArcSDE with 10.1?

RussellBrennan — Fri, 11 May 2012 15:38:24 GMT

Alan,

To further add on to what Jake said...

Prior to 10.1 (10.0, 9.x, 8.x) if you wanted to use a Geodatabase with all of the cool Geodatabase functionality (versioning, archiving, topology, relationship classes, terrains, geometric networks, etc) on a DBMS (Oracle, SQL Server, Postgresql, Informix, DB2) you had to perform a few steps.

First, you needed to install ArcSDE onto your machine, usually this was your DBMS server. This install included the files needed to run ArcSDE command line utilities, the application server, as well as the ArcSDE post installer.

After installing this onto your machine you would need to run the ArcSDE post installer. The main purpose of this post install was to install the Geodatabase into your enterprise database. This includes all the stored procedures, functions, privileges, and schema needed to provide the functionality I mentioned earlier. The post install could also be used to set up your application server.

The application server can be used to connect from a client machine to the DBMS/Geodatabase. It is used more or less to manage the connection requests coming in from clients and provide a way for the clients to 'talk' to the DBMS. For a while this was the only way to connect to a Geodatabase. At some point (I think 9.0) we added the ability to make direct connections (2-tier: client-DBMS) to the DBMS. This made the use of the application server (3-tier: client-app server-dbms) optional. For some people this meant they stopped setting up the application server and started using direct connections. Others continued using the application server.

The ArcSDE command line utilities are a method for the Geodatabase administrator to manage data, users, the application server service.

Fast forward to 10.1 - We have tried to allow you to manage your Geodatabase completely within ArcGIS applications (ArcCatalog, ArcMap, ArcGIS Server, etc). This is done through the use of dialogues in ArcMap/Catalog and the use of geoprocessing. The first thing we did was to break out the installation of the geodatabase schema tasks into geoprocessing tools. If you want to create an enterprise geodatabase there are now two options. Option 1, you can use the 'Create Enterprise Geodatabase' geoprocessing tool. This tool will create a new empty geodatabase in an existing instance. The second option is to use the 'Enable Enterprise Geodatabase' tool will allow you to install the Geodatabase schema in an already existing instance. The new functionality that Jake mentioned that allows you to now connect to a enterprise database (not a geodatabase) is what allow ArcGIS to then enable geodatabase behavior in your enterprise geodatabase. This second option would be used where you have already set up a database, have user permissions assigned and maybe have loaded some data (essentially converting your database to a geodatabase). The first option would be used if you are starting from nothing.

Esri recommends using direct connections for making connections to your geodatabase, it is not mandatory that you install the application server.

Much of the commonly used functionality found in the ArcSDE command line utilities is now available either through ArcGIS applications mentioned earlier or through geoprocessing (disconnecting users, identifying locks, loading data, investigating data, etc). For most users the install of these utilities should not be necessary.

If you determine that you really need the application server or the command line utilities they are available as a separate install.

So, this has been a pretty long winded answer to a pretty straightforward question. Answer is, it's not mandatory to install the application server or command line utilities. If you want to take advantage of Geodatabase behavior you do need to run one of the geoprocessing tools to install the Geodatabase.

Re: Why would I install ArcSDE with 10.1?

AlanToms — Fri, 11 May 2012 15:53:37 GMT

Thank you very much for the education.

Alan

Re: Why would I install ArcSDE with 10.1?

ShannonShields — Fri, 11 May 2012 16:04:04 GMT

Hi Alan,

at 10.1 there is no need to install the ArcSDE software unless you need to run an ArcSDE service. If all of your users are making Direct Connections to the geodatabase then the ArcSDE installation is not necessary. As well, most of the functionality offered by ArcSDE commands is now available in ArcGIS Desktop & through GP tools.

-Shannon

Re: Why would I install ArcSDE with 10.1?

LucaSimone — Thu, 11 Oct 2012 08:42:48 GMT

the answer from russellb is really clear, but I have another little question:

what about editing?

I have some services that I can edit on the web with ArcGIS Server 10.1, should I still use the SDE connection or it is ok to use a direct Connection?
Is the new ArcGIS Server able to 'replace' or acts as the SDE layer?

Re: Why would I install ArcSDE with 10.1?

VinceAngelo — Thu, 11 Oct 2012 10:32:16 GMT

Direct Connect *is* an ArcSDE connection. This thread is about application server install,
but the ArcSDE functionality still exists -- It's ArcSDE that provides the basis for versioned
geodatabases. With Direct Connect, it's just a multi-threaded solution in the ArcGIS client
instead of a multi-processing solution on the database server.

- V

Re: Why would I install ArcSDE with 10.1?

AlaaKutbi — Sun, 18 Nov 2012 10:31:42 GMT

You cannot perform any edits, or have the feature class participate in any geodatabase functionality (such as replication, topology, geometric networks, relationship classes, network datasets, etc). Essentially, you are getting a 'view' only feature class w/o SDE.

Is the qouted text true if I don't install ArcSDE 10.1?

Re: Why would I install ArcSDE with 10.1?

MarcoBoeringa — Sun, 18 Nov 2012 11:11:38 GMT

Is the qouted text true if I don't install ArcSDE 10.1?

No, it's true, like Russell Brennan wrote, if you don't Create or Enable Enterprise Geodatabase functionality on your database using the new geoprocessing tools in ArcGIS 10.1.

It has nothing to do with whether or not ArcSDE is installed on your database server. As Vince says, even if you don't use or install it on your database server, ArcSDE is still part of your client ArcGIS application, there are by default DLLs installed on your own computer with ArcGIS that handle the geodatabase SQL logic ---> That is essentially what ArcSDE is!

E.g., have a look at your "C:\Program Files (x86)\ArcGIS\Desktop10.X\Bin" folder on your local computer. You will see DLLs like "sde.dll" and "sdesqlsrvr100.dll" etc.

As soon as you attempt to connect to an ESRI Enterprise Geodatabase, these DLLs will be in use by your client ArcGIS application. There is no way around this when connecting to an ESRI geodatabase - at least for full functionality including editing - ArcSDE is just the component ESRI devised to handle the connection to the database and SQL stuff needed to allow advanced geodatabase functionality like versioning.

There is nothing special about ArcSDE or these DLLs in this respect, other vendors like Bentley or Autodesk have similar software components in their software to handle connections and SQL stuff related to geospatial databases, they just call it differently.

Re: Why would I install ArcSDE with 10.1?

AlaaKutbi — Sun, 18 Nov 2012 13:47:24 GMT

Just to make sure that I understood you correctly.
What you are saying is I do not need to install ArcSDE on the database server because the client contains the SDE functionality.

Re: Why would I install ArcSDE with 10.1?

AlaaKutbi — Sun, 18 Nov 2012 14:47:05 GMT

Another way of sying it:

- I could use direct connection without ArcSDE installed for two-tier topology.
- I could use ArcSDE to hide or conceal the database in a three-tier topology.

am I right?

Re: Why would I install ArcSDE with 10.1?

MarcoBoeringa — Sun, 18 Nov 2012 15:15:38 GMT

Just to make sure that I understood you correctly.
What you are saying is I do not need to install ArcSDE on the database server because the client contains the SDE functionality.

Yes, this is true, but in a 2-tier Direct Connect situation, be aware you may need to install other additional software like Oracle Client on the client ArcGIS computer, to get the connection to your database up and running. This is not necessary with a separate server side 3-tier installation of ArcSDE.

Another way of saying it:

- I could use direct connection without ArcSDE installed for two-tier topology.
- I could use ArcSDE to hide or conceal the database in a three-tier topology.

am I right?

Yes, that is about the story, although "hide" is probably a bit overstated, you will always have some database related stuff, like database login with username and password, that is there on the client side. And again be aware that for Oracle, you need to install Oracle Client in a two-tier topology, and that it needs to be a 32-bit version, as ArcGIS is still 32-bit.

Also, rephrasing the first sentence to:

- I could use direct connection without ArcSDE installed on a server for two-tier topology.

is probably a bit more accurate, as, as you now understand, ArcSDE is always installed on the client side as part of the ArcGIS installation.

ArcSDE is the engine of the "car" called "geodatabase"... Take away the engine entirely, and you will grind to a halt.

Re: Why would I install ArcSDE with 10.1?

FionaHatfield — Fri, 21 Dec 2012 19:29:58 GMT

Hi,
I'm trying to wrap my head around this, as I setup my test server for our upgrade.

I have set up my server with Windows Server 2008 R2 sp1 and SQL Server 2012 standard edition.
I have installed ArcGIS desktop 10.1 + sp1
I ran through the ArcGIS for Server 10.1 sp1 installer but did not create a ArcGIS Server site. (essentially I needed the authorization file for the create enterprise geodatabase tool )

I then ran the tool > 'Create Enterprise Geodatabase'
I loaded some data into the geodatabase, registered as versioned.
When exploring the schema all the SDE and GDB tables are present.

Am I missing something? Do I need to install ArcSDE 10.1 to get the multi user/versioning/history capabilties of ArcSDE, or as this discussion indicates this is now inherent in the desktop.

I still am not 100% clear why I would need to install the ArcSDE application server or command line tools.
If I am managing data via desktop (ArcMap & ArcCatalog) I do not need to install anything further
If I am managing data via web editing tools I do need to install the ArcSDE application server.

Thank you for any clarification you can provide.
Fiona

Re: Why would I install ArcSDE with 10.1?

AlanToms — Fri, 21 Dec 2012 19:58:55 GMT

Yeah it took me a bit to get it as well. The ArcSDE Command Line tools do not need to be installed unless you want to run stuff with a command line or need to do some major troubleshoot.

Hi,
I'm trying to wrap my head around this, as I setup my test server for our upgrade.

I have set up my server with Windows Server 2008 R2 sp1 and SQL Server 2012 standard edition.
I have installed ArcGIS desktop 10.1 + sp1
I ran through the ArcGIS for Server 10.1 sp1 installer but did not create a ArcGIS Server site. (essentially I needed the authorization file for the create enterprise geodatabase tool )

I then ran the tool > 'Create Enterprise Geodatabase'
I loaded some data into the geodatabase, registered as versioned.
When exploring the schema all the SDE and GDB tables are present.

Am I missing something? Do I need to install ArcSDE 10.1 to get the multi user/versioning/history capabilties of ArcSDE, or as this discussion indicates this is now inherent in the desktop.

I still am not 100% clear why I would need to install the ArcSDE application server or command line tools.
If I am managing data via desktop (ArcMap & ArcCatalog) I do not need to install anything further
If I am managing data via web editing tools I do need to install the ArcSDE application server.

Thank you for any clarification you can provide.
Fiona

Re: Why would I install ArcSDE with 10.1?

MarcoBoeringa — Fri, 21 Dec 2012 20:26:32 GMT

I then ran the tool > 'Create Enterprise Geodatabase'
I loaded some data into the geodatabase, registered as versioned.
When exploring the schema all the SDE and GDB tables are present.

Hi Fiona,

Good, this means you are most likely "up-and-running", and can start using ArcGIS to fill and use your ESRI geodatabase

Am I missing something? Do I need to install ArcSDE 10.1 to get the multi user/versioning/history capabilities of ArcSDE, or as this discussion indicates this is now inherent in the desktop.

I still am not 100% clear why I would need to install the ArcSDE application server or command line tools.

No, you do not need to install an ArcSDE 10.1 application server to get full geodatabase functionality, including multi user/versioning/history.

As I and others have attempted to explain in this thread, ArcSDE's software components in the form of DLLs (Dynamic Link Libraries) form an inherent - and VITAL - part of any "client" ArcGIS application, most prominently "ArcGIS for Desktop" and "ArcGIS for Server" (Server is after all a "client" of the DBMS too, e.g. Oracle, Microsoft SQL Server). They are installed by default as part of the respective software's installation.

You can't access or run an ESRI geodatabase without these DLLs that incorporate all the functionality and logic of ArcSDE to handle ESRI geodatabases (at least not by re-doing years long software development by ESRI and at great risk of corrupting the database in case you want to edit something).

Like I wrote in my last post:

*************************************
ArcSDE is the "engine" of the "car" called "geodatabase"... Take away the engine entirely, and you will grind to a halt.
*************************************

However, if this sentence still leaves you confused, think of the ArcSDE application server running on a remote server being "public transport", and the ArcSDE DLLs on your local computer as part of "ArcGIS for Desktop" as your "private car". Both share an "engine" (THIS IS ARCSDE!), but they are independent and both get you from A to B (allow you to access an ESRI geodatabase with all of it's functionality).

It is up to you to decide if you want to travel by "public transport" or use your "private car". One mode of transport may be faster than the other (or the other way around), depending on the conditions in your local "area"...

To also recap some of the very good comments by the ESRI staff in this thread (Russell Brennan in this case):

"Fast forward to 10.1 - We have tried to allow you to manage your Geodatabase completely within ArcGIS applications (ArcCatalog, ArcMap, ArcGIS Server, etc). This is done through the use of dialogues in ArcMap/Catalog and the use of geoprocessing."

"If you determine that you really need the application server or the command line utilities they are available as a separate install."

These comments mean that only in some exceptional cases, you might need one of the command line tools. Until you run into some serious trouble that really can't be dealt with using ArcGIS's new tools, you should be fine using Direct Connect and leaving your setup as it is now.

Re: Why would I install ArcSDE with 10.1?

BrianKaplan — Thu, 17 Jan 2013 19:00:56 GMT

HI All, Please help me understand this for the personal ArcSDE. For the previous item...

No, you do not need to install an ArcSDE 10.1 application server to get full geodatabase functionality, including multi user/versioning/history.

So can I still use a personal ArcSDE with Desktop without ArcGIS Server, say on a laptop? If so, do I need to through through the same procedure for creating or enabling a enterprise geodatabase? If, so how. The create geodatabase requires an authorization code for ArcGIS Server.

Thanks

Brian Kaplan

Re: Why would I install ArcSDE with 10.1?

MarcoBoeringa — Fri, 18 Jan 2013 12:57:58 GMT

HI All, Please help me understand this for the personal ArcSDE. For the previous item...

No, you do not need to install an ArcSDE 10.1 application server to get full geodatabase functionality, including multi user/versioning/history.

So can I still use a personal ArcSDE with Desktop without ArcGIS Server, say on a laptop? If so, do I need to through through the same procedure for creating or enabling a enterprise geodatabase? If, so how. The create geodatabase requires an authorization code for ArcGIS Server.

Thanks

Brian Kaplan

Brian, there is no "personal ArcSDE", there is just the ArcSDE DLL's that incorporate all the functionality to allow a Direct Connect connection on your local personal PC to a (remote) enterprise geodatabase, but that isn't a product called "personal ArcSDE".

Additionally, if you want to create an enterprise geodatabase (so no file geodatabase), you will need an ArcGIS for Server commercial licence, as ArcSDE / ArcGIS for Server is a sale / non-free product of ESRI, and using an enterprise geodatabase requires this licence, even if you only start using it for testing purposes. That is why you are being asked for an authorization code.

You may be able to get a temporary trial licence for free for testing purposes, IDK, but as soon as you start deploying it, you will surely need a true paid licence. For that, there are two possible licencing levels: "ArcGIS for Server Enterprise" and "ArcGIS for Server Workgroup", see this page:

http://www.esri.com/software/arcgis/arcgisserver/features/enterprise-workgroup

Re: Why would I install ArcSDE with 10.1?

BrianKaplan — Sat, 19 Jan 2013 02:05:39 GMT

Brian, there is no "personal ArcSDE", there is just the ArcSDE DLL's that incorporate all the functionality to allow a Direct Connect connection on your local personal PC to a (remote) enterprise geodatabase, but that isn't a product called "personal ArcSDE".

Additionally, if you want to create an enterprise geodatabase (so no file geodatabase), you will need an ArcGIS for Server commercial licence, as ArcSDE / ArcGIS for Server is a sale / non-free product of ESRI, and using an enterprise geodatabase requires this licence, even if you only start using it for testing purposes. That is why you are being asked for an authorization code.

You may be able to get a temporary trial licence for free for testing purposes, IDK, but as soon as you start deploying it, you will surely need a true paid licence. For that, there are two possible licencing levels: "ArcGIS for Server Enterprise" and "ArcGIS for Server Workgroup", see this page:

http://www.esri.com/software/arcgis/arcgisserver/features/enterprise-workgroup

Hi Marco,

Thank you for your reply. I must have used the wrong terminology. The install for ArcGIS Desktop includes an option to enable geodatabase storage on SQL Server Express. Isn't this not an enterprise geodatabase?

Re: Why would I install ArcSDE with 10.1?

VinceAngelo — Sat, 19 Jan 2013 12:32:46 GMT

Enterprise geodatabases, which run in many different flavors of RDBMS software, require an
ArcGIS for Server Enterprise license. Desktop (formerly known as "Personal") and Workgroup
multiuser geodatabases (which only run in SQL-Server Express, and are subject to restrictions
in user count, storage, RAM, and CPU cores) are available at different licensing levels.

The Multiuser Geodatabase page breaks down the options.

- V

Re: Why would I install ArcSDE with 10.1?

BrianKaplan — Sun, 20 Jan 2013 00:08:41 GMT

Enterprise geodatabases, which run in many different flavors of RDBMS software, require an
ArcGIS for Server Enterprise license. Desktop (formerly known as "Personal") and Workgroup
multiuser geodatabases (which only run in SQL-Server Express, and are subject to restrictions
in user count, storage, RAM, and CPU cores) are available at different licensing levels.

The Multiuser Geodatabase page breaks down the options.

- V

Thank you. I found that the ArcGIS desktop menu included the ArcSDE install and the ability to take an existing SQL Server Express database and convert it to a geodatabase. Brian.