|
POST
|
Thanks Vince. My user-schema GDBs have different uses, for example, a regulatory UGDB is versioned and then compressed nightly, another UGDB uses disconnected editing. I have a master, SDE, that holds base map data, and the UGDBs are functional, with different schedules. And, I have a data owner user that is what the SDE Admins use. In previous versions, this account was the owner of all spatial data, with the latest release that's not possible with UGDBs, so there is mixed ownership. Overall, most users have use a shared viewing account that has read-only on all spatial data. In the SQL Server world, would you make the compressed gdb its own database? I'm working through the security and functionality of sharing database between databases and between schemas, and the best way to handle data ownership. Thank you for your help, Sherrie
... View more
11-29-2016
06:14 AM
|
0
|
2
|
3471
|
|
POST
|
SQL Server 2016 SDE 10.5 Our SDE prototype to migrate from Oracle is ramping up. We have experience with SDE in Oracle, but not in SQL Server. Because this pilot will continue for the next year, we are going with the latest and greatest versions. I'm looking for best practices, suggestions, tips on using SDE in MS SQL. In Oracle, we have a master geodatabase and user-schema geodatabases in the same Oracle database. We do versioned editing in the user-schema gdbs. Can anyone share their experience? I'm just starting, getting the terminology down and a staging SQL instance and database up and running. There is a lot to learn. Sherrie
... View more
11-28-2016
12:41 PM
|
0
|
6
|
6410
|
|
POST
|
We are starting a prototype to migrate ArcSDE data from Oracle to SQL Server. Since we are planning for the future I want to do the latest versions of SDE and SQL Server. In the http://desktop.arcgis.com/en/system-requirements/latest/database-requirements-sqlserver.htm install guide I see that SQL 2016 is listed. Anyone have any recommendations or experiences to share?
... View more
10-28-2016
06:45 AM
|
0
|
0
|
1459
|
|
POST
|
Oracle RDBMS 12.1.0.2 SDE 10.2.2 In Oracle I am auditing as 'audit create session by access whenever not successful;' I frequently see these come back from ArcMAP sessions ORA-29904 Error in executing OCIINdexClose routine. The SDE Admins see no errors, I've had no other complaints. Any suggestions on how to dig into this deeper and find the root cause? Sherrie
... View more
09-07-2016
08:44 AM
|
0
|
2
|
4388
|
|
POST
|
Thanks Bruce, I'll pass that on to the developer. From a database perspective (I'm the DBA), I'm looking for similar experiences with GDB_TABLES_LAST_MODIFIED bottlenecks. This is a small table, as is GDB_ITEMS, and updates should be very quick. One line of thinking that I'm pursuing is how does arcpy do its updates to the database. Does it send chunks? When does GDB_ITEMS get updates, when does it commit? I see many SQLNet message to client entries in the trace files, meaning the database is doing its work and waiting for the arcpy to do something back. So process A comes in, starts to update GDB_ITEMS that in turn updates GDB_TABLES_LAST_MODIFIED, the additional processes queue up to do the same but eventually time out.
... View more
08-23-2016
12:08 PM
|
0
|
0
|
794
|
|
POST
|
Oracle RDBMS 12.1.0.2 SDE 10.2.2 We have many nightly update jobs that use arcpy, others use FME. Sporadically, some of the arcpy jobs fail. Since they run in batch mode, the developer is having trouble seeing what the returned error is. Sometimes the jobs all work without issue, other times maybe 5 to 10 of them fail. To determine the failures I created a login trigger for the data owner between the hours of the nightly updates. I found enq: TX - row lock contention on GDB_TABLES_LAST_MODIFIED. It was previously suggested to me to increase initrans from 4 to 8, but that made no difference. In the development environment, I increased it to 50 and it still made no difference, so I set it back to 4. Has anyone had similar issues? The failures happen with arcpy jobs, but not with FME jobs, both from the same Windows server as the client to the database. Sherrie
... View more
08-23-2016
08:26 AM
|
0
|
2
|
1928
|
|
POST
|
Thanks Vince. We'll stick with ST_GEOMETRY as that's what we're doing now. My first task is to prototype and do a feasibility study. Our Oracle environment is mature with many Enterprise applications hitting it. In some cases, the interaction of spatial data with SDE is back and forth, where SDE uses the tabular application data as attributes, or the application uses spatial data and maps. It's a huge migration that we'll try to break down into smaller pieces and come up with a plan. A little daunting, but it will be fun. In our Oracle environment we use partitioning and I non-active Data Guard for disaster recovery. I'm finding different flavors of PostgreSQL, so I'll need to research what functionality is available where. Do you know if I start with PostgreSQL Red Hat binaries, and we later decide that we need EnterpriseDB, is that a migration, or something less painful. Do you have a feel for the ESRI user base for PostgreSQL. We looked at it years ago, and at that time there were two users. I see more questions about it and feel it's becoming more popular and accepted. In the end, I believe this will be a management decision on cost versus risk. Our Oracle environment is solid, it provides good performance with much functionality, we have Oracle support. I know that I can make Postgres work, there will be a migration period, and there may be issues because we are not as skilled (yet). Much of our experience will move over and be useful, but there is a learning curve to get through. Sherrie
... View more
02-19-2016
10:23 AM
|
0
|
1
|
2873
|
|
POST
|
I'm just beginning research into PostgreSQL, with more questions that answers at the moment. Our history is that we are a long-term ESRI product user, and have been using SDE since version 3.2, always in Oracle. My direction now is to investigate migrating spatial data to PostgreSQL. I'd like to do this on Linux. For those who have gone before me: - how big is the market share of GIS users in PostgreSQL for production use? - What flavor of Linux is most commonly used? I see that RedHat and SUSE are supported. - I see this latest version of PostgreSQL noted: PostgreSQL 9.3.5 (64 bit) with PostGIS 2.1 But I also see may flavors of PostgreSQL advertised, Advanced Server from EnterpriseDB, PostgreSQL Plus. What flavor do you use? What has been your experience? Where have you trained? PostGIS - is this required? Any insights or comments are appreciated, I apologize in advance for the "newbie-ness" of the question.
... View more
02-19-2016
06:45 AM
|
0
|
4
|
6219
|
|
POST
|
Oracle RDBMS 12.1.0.5 Oracle Enterprise Linux 6.6 SDE 10.2.2 Patch 290200 We have some feature classes with srid 2882, and I've found some with srid 300002. I understand that the srid's should match to participate in an ST_ overlay function when EXTPROC kicks in. However, these must be supported transformations because for the most part, it works, just slower. However, there are times that this error returns instead of the in-place transformation happening: ERROR: ORA-28579: network error during callback from external procedure agent ORA-06512: at "SDE.ST_GEOMETRY_SHAPELIB_PKG", line 100 ORA-06512: at "SDE.ST_RELATION_OPERATORS", line 340 It's quite inconsistent, where sometimes it works, sometimes it doesn't. In troubleshooting other EXTPROC issues, I've created a nightly 'health check' programs, that does an ST_INTERSECT with feature classes that meet a certain criteria and another static multi polygon fc. It runs at night, no errors found. If I run the mixed srid interactively, it errors. I've been looking at this for a long time and tested may scenarios, but I'm stumped. My answer going forward is to only overlay those fc's with matching srid's. I'd like to understand what's going on here though. At one point we opened a ticket with ESRI support and the answer was that it's our data. Yes, it was, and i now know it was because the srid's were different. When two input geometries have different spatial references (different SRID values), the ST overlay operator transforms the shape geometry to the same spatial reference prior to performing the relational comparison. This results in extra time spent in memory while the transformation happens, but it should still work and not error. Sometimes it does, sometimes it doesn't. Any insights are appreciated. Sherrie
... View more
02-12-2016
08:33 AM
|
0
|
0
|
1592
|
|
POST
|
Before too long I'm proving myself wrong--somewhat. The literal doesn't have anything to do with the different errors. The first execution returns ORA-20011: Error generating shape. (SHAPE1) ORA-06512: at "SDE.ST_GEOMETRY_SHAPELIB_PKG", line 100 ORA-06512: at "SDE.ST_RELATION_OPERATORS", line 340 In the same session the next error is: ORA-28579: network error during callback from external procedure agent ORA-06512: at "SDE.ST_GEOMETRY_SHAPELIB_PKG", line 100 ORA-06512: at "SDE.ST_RELATION_OPERATORS", line 340 Sometimes we see just the second error. My mistake earlier is that I was testing scenario one, then scenario two immediately. It doesn't change the problem much, in the for an unknown reason, this error pops up.
... View more
02-10-2016
11:00 AM
|
0
|
0
|
2070
|
|
POST
|
Oracle RDBMS 12.1.0.5 Oracle Enterprise Linux 6.6 SDE 10.2.2 Patch 290200 We use ST_GEOEMTRY and ST functions, mostly ST_INTERSECTS. EXTPROC is configured and works well -- most of the time. We have this weird problem, when for no reason that I can find (ANYWHERE!), a feature class that participates in an overlay function, returns an error. They are always reference layers, meaning they are static and don't change. To avoid a production issue, I've created a health check program that creates a dynamic SQL that does an ST_INTERSECT with two layers; I then interrogate the log file and send an email when an error happens. The error: ORA-28579: network error during callback from external procedure agent ORA-06512: at "SDE.ST_GEOMETRY_SHAPELIB_PKG", line 100 ORA-06512: at "SDE.ST_RELATION_OPERATORS", line 340 The fix is to recreate the feature class from ArcCatalog, and then insert rows from the bad feature class, and generate statistics. I've asked the SDE Administrators to keep the erroring feature class so that I can use it for testing, looking for differences. Last night the health check ran without an issue. Today, I have two feature classes to work with: COUNTIES and COUNTIES_OLD. I know that COUNTIES is the current, valid FC, and COUNTIES_OLD was one that returned an error on 1/11/2016. My first test showed that the reverse is true. While COUNTIES was fine at 3am, it now returns an error. While COUNTIES_OLD returned an error on 1/11/2016 it returns fine today. Oddly enough, I see two different errors returning from COUNTIES, depending on an embedded literal: select ' fc: COUNTIES' , a.owner, a.numwells from asr a left outer join COUNTIES c ON sde.st_intersects (c.shape, a.shape) = 1; select ' fc: COUNTIES' , a.owner, a.numwells * ERROR at line 1: ORA-20011: Error generating shape. (SHAPE1) ORA-06512: at "SDE.ST_GEOMETRY_SHAPELIB_PKG", line 100 ORA-06512: at "SDE.ST_RELATION_OPERATORS", line 340 Removing the literal, with the same SQL (and this is the error I usually get, even with the literal): select a.owner, a.numwells from asr a left outer join COUNTIES c ON sde.st_intersects (c.shape, a.shape) = 1; select a.owner, a.numwells * ERROR at line 1: ORA-28579: network error during callback from external procedure agent ORA-06512: at "SDE.ST_GEOMETRY_SHAPELIB_PKG", line 100 ORA-06512: at "SDE.ST_RELATION_OPERATORS", line 340 This was odd enough behavior, not this makes it weirder. We had an open ticket with ESRI support, who asked for our data. After much back and forth, the answer was 'something in your data - recreate'. I also have an open SR with Oracle support. They've been very thorough and helpful, looking at traces, statistics, but their ultimate answer was to go back to the vendor. Maybe someone has an idea or has experienced similar issues. Any insights are appreciates.
... View more
02-10-2016
09:55 AM
|
0
|
1
|
4914
|
|
POST
|
In Oracle 12c we allow the nightly system stats gathering to collect statistics for us. We have one feature class that causes a timeout. In reproducing this manually, I find that it's the domain index, with this SQL running. This FC is dropped and recreated nightly, so the possibility of gathering and then lock stats isn't there. Also, I have yet to get it to finish. I tried to put a degree on the index, but running the stats doesn't pick that up. BEGIN SYS.DBMS_STATS.GATHER_TABLE_STATS ( OwnName => 'SDECREATOR' ,TabName => 'SITES_EDIT_WCPFLG1' ,Estimate_Percent => dbms_stats.auto_sample_size ,Method_Opt => 'FOR ALL COLUMNS SIZE AUTO ' ,Degree => dbms_stats.default_degree ,Cascade => FALSE ,No_Invalidate => FALSE); END; / BEGIN SYS.DBMS_STATS.GATHER_INDEX_STATS ( OwnName => 'SDECREATOR' ,IndName => 'A1245_IX1' ,Estimate_Percent => NULL ,Degree => dbms_stats.default_degree ,No_Invalidate => FALSE); END; / SELECT /*+ no_parallel(b) no_parallel_index(b) dbms_stats cursor_sharing_exact use_weak_name_resl dynamic_sampling(0) no_monitoring */ DBMS_ROWID.rowid_block_number (b.ROWID) FROM (SELECT s.sp_id, s.gx, s.gy, ROW_NUMBER () OVER (PARTITION BY s.sp_id ORDER BY s.gx, s.gy) rncol FROM SDECREATOR.S1375_IDX$ s) sp, SDECREATOR.SITES_EDIT_WCPFLG1 b WHERE rncol = 1 AND b.ROWID = sp.sp_id ORDER BY sp.gx, sp.gy, sp.sp_id;
... View more
08-31-2015
07:10 AM
|
0
|
0
|
2715
|
|
POST
|
I think so, too. Also, the "rumor" (and it's just that) I heard is that starting with Oracle 12.2, CDB/PDB is the only option. Those things have a way of getting pushed back though (remember LONG RAW desupport )
... View more
08-01-2014
09:28 AM
|
0
|
1
|
1346
|
|
POST
|
Thanks Vince. I was mistaken, we are going to ArcGIS 10.2 at the latest SP when we get there. I was behind the time on the planning. I suspected that SDE wouldn't work at the CDB, but only at the PDB.
... View more
08-01-2014
09:05 AM
|
0
|
3
|
1346
|
|
POST
|
We are upgrading Oracle from 11.1.0.7 to 12.1.0.4 (or the latest when we get there), as well as our SDE to ArcGIS 10.1 SP1. The reason for moving to Oracle 12c is that Oracle 11.2 premium support ends Jan 2015, it will take us that long to get there. Our new database servers are beefy, making Oracle 12c multitenancy a good fit. I need time to put my hands on these latest versions, from the onset I can't see how SDE would work at the container level, but perhaps it would work from the pluggable level. Or maybe there would be a way to make it work. We use roles extensively in our current SDE management with one data owner. The concept of one data owner with versioned geodatabases needs to change with SDE 10.1 prompting a rearchitecture of how we have been doing GIS database business anyway. The only certainty is change I guess. Has anyone implemented SDE with Oracle 12c? What are you experiences?
... View more
08-01-2014
06:56 AM
|
0
|
5
|
1368
|
| Title | Kudos | Posted |
|---|---|---|
| 1 | 10-26-2017 06:56 AM | |
| 1 | 07-24-2017 07:43 AM |
| Online Status |
Offline
|
| Date Last Visited |
11-11-2020
02:24 AM
|