Latest Contributions by Ravichandran_M_Kaushika

‎05-12-2021

Thank you for the info. In fact, I had done what was mentioned in the blog. So it is not working - there could be server resource or some other issue.

‎05-12-2021

Good afternoon. There was an enterprise wide push in our organization to move to ArcGIS Pro from ArcMap and Catalog. While trying to create a cache tile imagery service, I had the following difficulties: Publish the service with tiling scheme by selecting 'Using tiles from a cache' instead of 'Dynamically from data' would fail. After creating the dynamic image service, I could not 'start' tile generation process as it would throw an error. So I had to do a hack by copying the previous year imagery conf.xml to mimic the cache tile scheme that was requested by the end user. During the generation process, it took forever to create the tiles (total size of imagery = 10.1 TB) across the nation - small area spread out across the continental US. sometimes the connection to the image server would be lost - leaving the process hanging. Contents of L cache folders would stop updating (timestamp) but the process would not declare it complete for more than 24 hours.. After fighting with this for a few days, I saw that there were known bugs with cache tile scheme. The bug number is: BUG-000109510 https://community.esri.com/t5/arcgis-pro-questions/arcmap-vs-arcgis-pro-tile-cache-creation/m-p/127089#M5342 the performance of ArcGIS Pro has been unstable and causing stress to me. Has this bug been fixed? If yes, which version of ArcGIS Pro. thanks and regards ravi kaushika.

‎03-01-2021

I got around the problem by creating a schema that matched the app user id on SQL Server database. I was not a great fan of that idea. App user registered on the database server was modified to have the default schema to match the newly created schema on the spatial database. Once this was setup, I could transfer records from FGDB to SDE.

‎02-23-2021

Good afternoon. I am trying to debug a SDE sql server to file geodatabase missing records during export from both Arc Catalog and ArcGIS Pro - that is a critical task in our office. ESRI rep suggested to me 'move' that file gdb layer to SQL Server to compare the missing records to determine the next steps. I thought it would be a piece of cake. It turned out to be a very challenging task. When I tried an import into SDE from a file geodb, At first I got ERROR: 000210 - Cannot create output db connections\mySDEConn.sde\myTargetLyr failed to execute (FC to FC). I am not a SQL dba - let alone a SQL SDE dba. So I located the security panel on SQL Server Management Studio and made my accounts (windowsDomain\acct1 and database user acct2) as gods for that particular database I wanted to import the records. so I did an import into SDE from these 2 SDE connections and I got this error: Failed to Create Feature Class: Database user name and current schema do not match. [mySpatialDB."WINDOWSDOMAIN\ACCT1".testme] and [mySpatialDB."ACCT2".testme] https://community.esri.com/t5/arcgis-enterprise-questions/database-username-and-current-schema-don-t-match/m-p/541404 A couple of users at the bottom of the posting had expressed their displeasure on the thought that user name had to be same as the schema...🤔. I lost 6 hours trying to import 1 feature from file geodb to sql server sde. Luckily, this user name and schema mangling did not happen on the sql server side. We have a low level application user with privileges to run a stored procedure that dynamically names and creates tables (layer with geometry) . Luckily, it created it as dbo. I am lost right now - trying to fix my original problem of identifying the reasons for missing records when going from SQL Server SDE to file geodatabase. sorry for off loading my troubles. any suggestion thanks and regards ravi.

‎02-22-2021

Thank you for your response. I will work on your ideas and let you know. regards.

‎02-19-2021

@MichaelVolz , good morning. thank you for suggesting it. I saw that the exported to E:\ drive attached to the machine and the other export to the \\ share drive did not make a difference in the count. To confirm it further, I went and exported the features to C:\Temp\missingRecords.gdb\Iowa feature class. The record counts were the same...

‎02-18-2021

Readers, good afternoon. I was assigned a task to 'fix' problems with missing record counts from previous year reports. Last time a nationwide report of land use report was run during Oct 2019-Jan 2020 time frame and all was good. Similarly Oct 2018-Jan 2019 records were intact. Only thing that changed if it should affect - In August of 2020, many servers were upgraded from ArcGIS 10.5.1 to 10.7.1 (dev stack and prod stack - separately). Oct/November 2020, when the same programs were run, the record counts were at 40% of expected values. Here are the facts: SQL Server (w shape geometry) national table has 21.1 million records - as expected. We split it state wise using STIntersect() function and got many tables that added up 21.1 million records. When we wanted to deliver those many tables to the customers as file geodb, we did an export from Arc Catolog-->Right Click--> Export --> To Geodatabase (single) and To Geodatabase (multiple) and we lost many records. No difference whether we used the single or double option We did a shape.STIsValid() = 0 to see which records were failing - no records seemed to be invalid in SQL server. We use ArcGIS Pro and Arc Catalog to export and we found that there was no difference in the missing record counts (exploring 32 bit vs. 64 bit issues - but does not seem to be so). Please see the attached spreadsheet that talks about the differences. Thank you for your support. regards ravi kaushika

‎02-08-2021

On Friday, after internal discussions with our team, I am exploring the option of doing the clip on the sql server using the following sql: select --top 10000 myT.* from base.my_LAND_Table myT , ideamartspatial.base.STATES_A_UST as states where states.FIPS_C='01' and states.shape.STIntersects(myT.SHAPE) = 1 I will post the results of the original question very soon. the Clip_management should return 200K+ small polygons (small as in less than 100+ acres). thanks and regards ravi.

‎02-05-2021

@Kara_Shindle , @Anonymous User and @Anonymous User , good morning. thank you for the info. i will try the Arc Catalog idea and post the results. I have the .sde file as with the full path in the 1st input as shown in the python script. another idea I am thinking is to copy state layer from my xxSpatialMart database to intersect using SQL Server's STIntersect () . I will keep all of you updated. thank you for your support. regards ravi.

‎02-04-2021

Dear Readers, good afternoon. I am using ArcPy 3.6.10 from ArcGIS Pro. We are creating an intersection of a national layer from a SDE 'e:\\Idea\\Connections\\xxmartspatial.sde\\xxmartspatial.BASE.MY_LAND_UNIT' against a state feature 'e:\\IDEAData\\Extracts\\Work\\IDEAMapIT_10.gdb\\_DE_' (currently DE) in a file geodatabase and writing the result to the same file geodatabase: 'e:\\IDEAData\\Extracts\\Work\\IDEAMapIT_10.gdb\\MY_LAND_UNIT' ExecuteError('Failed to execute. Parameters are not valid.\n ERROR 000732: Input Features: Dataset e:\\Idea\\Connections\\xxmartspatial.sde\\xxmartspatial.BASE.MY_LAND_UNIT does not exist or is not supported\nFailed to execute (Clip).\n',) The connection to SDE for reading national layer is a superior user than the app user - once i get this code to work, I will degrade the SDE connection user. i verified the spelling cases for sde connection and all we are doing is a read- but the user has superior permissions on the SDE. arcpy.Clip_analysis(InputPLUFCFullName, TempStateFCFullName, OutputPLUFCFullName, "0.01 Meters") 'e:\\Idea\\Connections\\xxmartspatial.sde\\xxmartspatial.BASE.MY_LAND_UNIT' - #SDE input PLU FC FullName 'e:\\IDEAData\\Extracts\\Work\\IDEAMapIT_10.gdb\\_DE_' #Temp State 'e:\\IDEAData\\Extracts\\Work\\IDEAMapIT_10.gdb\\MY_LAND_UNIT' '0.01 Meters' Any direction would be of great help. thanks and regards ravi kaushika.

‎01-04-2021

dear Readers, good morning. thank you for taking the time to help us out. When we tried to 'identify' a layer that is not the top of the layer collection of a REST feature layer, ArcGIS Pro consistently returned the information pertaining to the top most layer even if was not selected for display. We tested it at different times and found the behavior of ArcGIS Pro to be predictable. To confirm it was not a REST service data issue, we opened ArcMap 10.7.x, we added the same REST service and chose a feature layer that was not on top of the stack. ArcMap correctly brought back the information of the desired and selected layer, not the unselected top most layer of the layer collection. Are their any work around for this situation. I have attached screen shots of the error encountered. thanks and regards Ravi Kaushika

‎11-30-2020

@JonathanQuinn , good afternoon. thank you for the prompt reply. Our REST and imagery services are used by field staff members across the country and extent of the layers are nation wide. Our users might not be worldwide like ESRI, but substantial. We have field offices in almost every county of the US (~3000+ offices). I cannot prove the performance of the services are degraded because servers are not rebooted. But I am forced to believe that memory leaks do degrade the performance of the servers - otherwise, reboots are NEVER needed and NEVER should be done. If nothing else, can ESRI prod team share how often they reboot their servers. I can at least use that as a justification to request a periodic reboot. I also understand that AGS 10.7.x (or 10.8) performs better than 10.5.1 in which I had great problems. I also understand that Win servers are much better these days - but I cannot agree a reboot is never needed. thank you for promptly replying. have a nice day. regards ravi kaushika.

‎11-25-2020

Thank you for taking the time to help us out. Q: What is ESRI's suggested reboot frequencies for HA servers? Q: On what reboot cycles are ESRI's external and internal servers? Background: We have ArcGIS enterprise servers serving national extent data layers for users across the country. Our IT and GIS staff are working together to optimize the services for performance. We had requested our hardware /IT support to put our DEV servers on a daily reboot schedule and they were not interested. They do not want to restart the servers and want to study underlying issues. Following are the considerations: We have national extent vector and raster layers shared with our internal and external clients. We have optimized rendering of the services using industry suggested scale dependent display for vector and raster layers. We can comfortably declare that no prospects of infinite loop errors due to any bad coding practice - for the IT staff to say that underlying issue should be addressed. if there are underlying issues, we would have identified them and would have got ESRI support or Microsoft's elevated support to identify work around steps. We are also using ESRI suggested optimized techniques for server performance. In the past, DEV server was accessed by many users from a web based application and we had to make special requests to place those servers on a nightly reboot schedule. Now ITS is refusing to place these servers on any kind of reboot schedule and would want to manually restart as discussed in this thread by some other ESRI user: https://community.esri.com/t5/python-questions/reboot-enterprise-server/m-p/692475#M53681 Do ESRI staff agree with user @jorisfrenkel 's suggestion of rebooting the servers once a week (~4 times or less a month): https://community.esri.com/t5/arcgis-enterprise-questions/service-recycling-vs-server-reboot/m-p/517389 thank you for your support. If I get some more thoughts, I would be adding to threads myself. regards, Ravi Kaushika

‎07-28-2020

dear Readers, good afternoon. We are aware of an enhancement request for ArcGIS Pro updating an image service (ENH-000121518). ArcGIS Enterprise: 10.71 We found the following issues and want to know whether it is a valid observation: Image Service On the Map view, we selected our 'combined mosaic dataset' to be published and chose Edit Metadata and entered information that would be useful for our field staff. Only summary and tags made it to the portal area. We had to copy paste from ArcGIS Pro UI to Edit Description in the portal. Summary, tag, description and other pertinent details did not transfer to the <AGS Install>/image/rest/services/MyFolder/islands/ImageServer page. Feature Layer (hosted) n Serv Definition: Summary and tags information came through from the publish process from ArcGIS Pro. Description never made it to both. if we manually update the contents, the next publish from Pro overwrites it. We would like to know whether there is another way to accomplish the issues that we are facing in the 2 scenarios. When we were in ArcMap and ArcCatalog world, we did not have this issue. thank you for your support.

‎07-06-2020

John, good afternoon. Thank you for the link. Our flagship JS based app is currently using 3.x and has a migration path to JS 4.1x. i will share this information with them. thanks and regards ravi kaushika

Online Status	Offline
Date Last Visited	yesterday

My Ideas

Latest Contributions by Ravichandran_M_Kaushika

Re: ArcGIS Pro cache tile creation issues - ArcCatalog more stable?

ArcGIS Pro cache tile creation issues - ArcCatalog more stable?

Re: One more: database username and current schema don't match

One more: database username and current schema don't match

Re: SDE to File geodatabase export missing records in File geodatabase

Re: SDE to File geodatabase export missing records in File geodatabase

SDE to File geodatabase export missing records in File geodatabase

Re: 000732; Py 3.6.10x64. Clip_Analysis ; Does not exist or is not supported.

Re: 000732; Py 3.6.10x64. Clip_Analysis ; Does not exist or is not supported.

000732; Py 3.6.10x64. Clip_Analysis ; Does not exist or is not supported.

Pro 2.6.x REST Feature layer(s) Identify not working

Re: Suggested Reboot frequency

Suggested Reboot frequency

ArcPro: Updating Feat n Img Serv Description in Portal

Re: Consume Time-Enabled Imagery Possible?

Re: Input of GP: GPFeatureRecordSetLayer ; how to ...

Input of GP: GPFeatureRecordSetLayer ; how to send...

Re: Portal for access rights n administration

Re: Suggested Reboot frequency

Pro 2.6.x REST Feature layer(s) Identify not worki...