topic Re: File Geodatabase and network problems in Data Management Questions

File Geodatabase and network problems

GavinMcGhie — Tue, 01 Mar 2011 22:34:55 GMT

Just curious if anyone else has run into anything similar...

A few weeks ago, I tried to compress an FGDB. The process hung for 20 minutes, so I killed it (small FGDB should have taken a few minutes at most). After that, my PC has problems accessing any FGDB on a network drive. Even when I copy data from SDE to a brand new FGDB on the network, it takes over an hour (usually takes sub 5 min). Anything to do with an FGDB is slow or not working right. If I put the FGDB on the C:drive, it works fine. If I use a PGDB on the network with the same tests, no problems. I upgraded to v10 (from 9.3) and the problem persisted.

As a real kicker, the compress problem occured on my old PC. Last week, I got a new PC, fresh OS, and a fresh GIS install (back to 9.3). According to IT, they only copied over my "c:\downloads folder, My Documents, Favorites, and Desktop items to the new computer". However, the problem followed to my new PC. Other users have the same problem on my new (and old) PC. I have no problem on other PCs. I can't imagine what would have followed to the new PC based on what was copied, especially that only affects the FGDB format.

I've logged this with support, but no answers yet. Just curious if anyone else has seen anything similar?
Thanks, Gavin

Re: File Geodatabase and network problems

toddcomer — Wed, 02 Mar 2011 19:18:08 GMT

Did you ever get an answer?

I have found through my own testing, and through discussions with ESRI that File & Personal Geodatabases have progressively LOST their ability to function correctly on networks. This issue is compounded in v10 to include shapefiles.

In v11, you will likely be restricted to storing your data on mylar.

Re: File Geodatabase and network problems

GavinMcGhie — Wed, 02 Mar 2011 19:29:40 GMT

No answer yet. Haven't heard back from support since yesterday morning when the response I got included "good luck", sometimes esri speak for you're on your own. Classic on the mylar comment! I'll follow the posting if I get an answer.

Re: File Geodatabase and network problems

toddcomer — Thu, 17 Mar 2011 16:00:32 GMT

The "official" response from ESRI support:

Full functionality of File/Personal Geodatabases, or Shapefiles, on networks could not be guaranteed, supported, and would not be addressed, because no two networks are the same.

The workaround suggested:

Store your File/Personal Geodatabases on the network drive. When you need to edit or otherwise manipulate the same, copy the F/PGDB or Shapefile to a local drive. When you are done, copy it back to the network drive.

Like I said, mylar is looking better and better... and so is Q-GIS!

Re: File Geodatabase and network problems

GavinMcGhie — Thu, 17 Mar 2011 17:01:33 GMT

Yep. In addition, I was finally starting to feel like ESRI support was getting good again. Unfortunately, they just completely dropped me on this issue. I emailed them multiple times and even logged a "what is going on with this issue" question through the services pages. It's been several weeks now and not even a peep from them. I'm disappointed that they did not even have the courtesy to respond with a note that they were dropping the issue. I ended up rebuilding my PC a 2nd time and the issue "seems" to have gone away. Now I just avoid using a FGDB. Nice eh?

Re: File Geodatabase and network problems

MatthewBampton — Thu, 31 Mar 2011 15:53:09 GMT

I'm running into what seems to be a similar problem: I have to keep a large dataset on a secure network drive. Although I can connect to the drives I'm working with through Windows, Arc won't see the drives when I try to connect to them. If I have an mxd in the root of my secure drive, I can open that, and then my home folder is set to the root of the drive. However everything runs slow, and navigation is clumsy and slow.

Re: File Geodatabase and network problems

MichaelMirro — Thu, 28 Apr 2011 16:36:00 GMT

Its good to know I am not the only one having geodatabase/network problems. I too have a FGDB, not too big, that is completely unresponsive. Using the identification tool can take over a minute to get a response. Other, much smaller databases will actually respond faster, however, they can take over a minute to initially open when adding data. I just upgraded it to 10 from 9.2 because of performance issues, which actually made the problem worse. I have worked with support and was told that I should put it on a local drive, where it did function adequately when tested; however, with three of us using this database from different computers and a history of projects mapped to the database, its not really a preferable option to put it on a local drives as the recommend. I would love to hear a solution to this, because for the time being, unless I drastically restructure my work flow and data structure, its not much fun doing GIS anymore.

Re: File Geodatabase and network problems

GavinMcGhie — Thu, 28 Apr 2011 17:20:05 GMT

FWIW, my take is that something esri is doing with the FGDB is writing something to your PC's registry, or some other permanent location that is buried deep. As I said, my problem originated with an esri function, only affected the esri FGDB on a network drive (0 other network problems and the FGDB folder did not have problems in windows explorer), and persisted until I rebuilt my PC from the ground up. Even migrating the basics to a new PC did not help. I spent hours digging through and swapping out various esri system files with no luck, so I assume it was something hidden to us normal users. Anyway, I no longer use FGDBs (call me paranoid).

One positive i would suggest (worked for me even with the broken PC) is to create a new blank PGDB in your preferred network location, and load all the layers from the FGDB (using the FGDB on a local drive) to the PGDB. Even with the FGDB problems, the PGDB performed flawlessly. Good luck!

Re: File Geodatabase and network problems

MichaelMirro — Thu, 28 Apr 2011 19:35:28 GMT

The PGDB seems to work, although I do want to do a bit more testing. And that's fine with me, as with an ArcView license, I don't see any advantages to having my as FGDBs. It works, that's all I care about. The only thing that will be a little bit of a nuisance, is that the file extension is different between the two database forms, so I will have relink to the data in about 100 different projects.

Nevertheless, I am still curious. There must be some network configuration that the FGDB is incompatible with, because this doesn't happen to everyone who keeps their data on a network. I am convinced its network incompatibility, because the behavior is on three machines with every FGDB we have (hundreds - one per project). Anyway...

Thanks for the advice.

Re: File Geodatabase and network problems

GavinMcGhie — Thu, 28 Apr 2011 19:40:49 GMT

If you find any solid info, I'm sure a lot of folks would be interested. For us, only my PC was affected (well my old one and prior new one), while dozens of others continued to work fine with the same network settings. I'll also mention that I could login to other PCs and not have problems, and other users could login to my PC and reproduce the problem. Definitely something that got stuck on my PCs hardware.

Re: File Geodatabase and network problems

AlexFriant — Wed, 15 Jun 2011 18:58:43 GMT

My problem is doubly frustrating because on some days FGDB's over the Local Area Network (LAN) run just fine, but other days they .... are....so.... slow!!!

For example, in ArcCatalog(9.3.1) just to *expand* a FGDB's contents like a dataset can take 6 seconds to respond. However, if I use another coworker's PC to expand the same FGDB over the LAN, it's near instantaneous. If I move the FGDB to a local drive on my PC, it works fine too.

So I know it's *not* the network or the server. It has to be something going on with ArcGIS Desktop and perhaps the underlying ArcObjects engine running on my PC, specific to network connectivity. It must be competing for resources with something else is my best guess. Somebody has to know why this happens. It's much too common a complaint.

Re: File Geodatabase and network problems

AndrewBrown1 — Thu, 17 Jan 2013 14:06:11 GMT

Has ESRI looked at this thread lately? We're running a gigbit network here and the performance with ANY feature class within a file geodatabase is very, very poor. In ArcMap, it took 27 seconds to select a label for a layer that's stored in a file geodatabase on our network.

Pretty pathetic if ESRI's workaround is to tell you to work locally.

Re: File Geodatabase and network problems

JimW1 — Thu, 17 Jan 2013 15:00:05 GMT

I would recommend turning off 'scan network files' on your anti-virus. We've found this is the performance culprit on local networks and FGDB. Everytime the FGDB does something it creates a file or a lock file or a change file or whatever the FGDB (Arcinfo Coverages 2.0 as I call it) is doing in the background. Some virus scanners lose their brains trying to keep up.

We've abandoned FGDB because they are unrealiable on our already unreliable corporate IT network. It's a perfect storm. No issues with PGDB or ArcSDE (except when the corporate network is slow of course).