I'm seeing wildly different performance when establishing Feature Layers in different SDE databases. ws1 = r '\\somenetworkpath\gdb1.sde' fcname = r'gdb1 . someschema . FCNAME input_fc1 = os . path . join ( ws1 , fcname ) arcpy . MakeFeatureLayer_management ( input_fc1 , "input_fl1" ) ws2 = r '\\somenetworkpath\gdb2.sde' fcname = r'gdb2 . someschema . FCNAME input_fc2 = os . path . join ( ws2 , fcname ) arcpy . MakeFeatureLayer_management ( input_fc2 , "input_fl2" ) In the above examples, ws1 takes over 6 seconds on the MakeFeatureLayer_management line, while the other is sub-1 second! ws1 is a "publication" SDE database where no editing is done. ws2 is non-versioned editing. Any input or what to look for? Thanks!

Are gdb1 and gdb2 completely different DBMS instances or databases? And if you reverse the order, gdb2 is the slow one and gdb1 the fast one? I suspect there is either a library or collection of libraries that get loaded by the first Make Feature Layer call involving an enterprise geodatabase. Since the libraries are already loaded, subsequent enterprise geodatabase connections go much faster, even connections to other databases. What if you do something like: ws2 = r '\\somenetworkpath\gdb2.sde' arcpy . env . workspace = ws2 arcpy . ListFeatureClasses ( ) ws1 = r '\\somenetworkpath\gdb1.sde' fcname = r'gdb1 . someschema . FCNAME input_fc1 = os . path . join ( ws1 , fcname ) arcpy . MakeFeatureLayer_management ( input_fc1 , "input_fl1" ) ws2 = r '\\somenetworkpath\gdb2.sde' fcname = r'gdb2 . someschema . FCNAME input_fc2 = os . path . join ( ws2 , fcname ) arcpy . MakeFeatureLayer_management ( input_fc2 , "input_fl2" ) or tmp_fc = arcpy . CreateFeatureClass_management ( "in_memory" , "tmp" , "POLYGON" ) arcpy . MakeFeatureLayer_management ( tmp_fc , "tmp_lyr" ) ws1 = r '\\somenetworkpath\gdb1.sde' fcname = r'gdb1 . someschema . FCNAME input_fc1 = os . path . join ( ws1 , fcname ) arcpy . MakeFeatureLayer_management ( input_fc1 , "input_fl1" ) ws2 = r '\\somenetworkpath\gdb2.sde' fcname = r'gdb2 . someschema . FCNAME input_fc2 = os . path . join ( ws2 , fcname ) arcpy . MakeFeatureLayer_management ( input_fc2 , "input_fl2" )

nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

MakeFeatureLayer_management Performance Issue

JamesCrandall

I'm seeing wildly different performance when establishing Feature Layers in different SDE databases.

ws1 <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'\\somenetworkpath\gdb1.sde'</SPAN>
fcname <SPAN class="operator token">=</SPAN> r'gdb1<SPAN class="punctuation token">.</SPAN>someschema<SPAN class="punctuation token">.</SPAN>FCNAME
input_fc1 <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>ws1<SPAN class="punctuation token">,</SPAN> fcname<SPAN class="punctuation token">)</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>MakeFeatureLayer_management<SPAN class="punctuation token">(</SPAN>input_fc1<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"input_fl1"</SPAN><SPAN class="punctuation token">)</SPAN>

ws2 <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'\\somenetworkpath\gdb2.sde'</SPAN>
fcname <SPAN class="operator token">=</SPAN> r'gdb2<SPAN class="punctuation token">.</SPAN>someschema<SPAN class="punctuation token">.</SPAN>FCNAME
input_fc2 <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>ws2<SPAN class="punctuation token">,</SPAN> fcname<SPAN class="punctuation token">)</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>MakeFeatureLayer_management<SPAN class="punctuation token">(</SPAN>input_fc2<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"input_fl2"</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

In the above examples, ws1 takes over 6 seconds on the MakeFeatureLayer_management line, while the other is sub-1 second!

ws1 is a "publication" SDE database where no editing is done. ws2 is non-versioned editing.

Any input or what to look for?

Thanks!

Vind meer berichten getagd met

Accepted answers

bixb0012

Are gdb1 and gdb2 completely different DBMS instances or databases? And if you reverse the order, gdb2 is the slow one and gdb1 the fast one?

I suspect there is either a library or collection of libraries that get loaded by the first Make Feature Layer call involving an enterprise geodatabase. Since the libraries are already loaded, subsequent enterprise geodatabase connections go much faster, even connections to other databases.

What if you do something like:

ws2 <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'\\somenetworkpath\gdb2.sde'</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>workspace <SPAN class="operator token">=</SPAN> ws2
arcpy<SPAN class="punctuation token">.</SPAN>ListFeatureClasses<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>

ws1 <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'\\somenetworkpath\gdb1.sde'</SPAN>
fcname <SPAN class="operator token">=</SPAN> r'gdb1<SPAN class="punctuation token">.</SPAN>someschema<SPAN class="punctuation token">.</SPAN>FCNAME
input_fc1 <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>ws1<SPAN class="punctuation token">,</SPAN> fcname<SPAN class="punctuation token">)</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>MakeFeatureLayer_management<SPAN class="punctuation token">(</SPAN>input_fc1<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"input_fl1"</SPAN><SPAN class="punctuation token">)</SPAN>

ws2 <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'\\somenetworkpath\gdb2.sde'</SPAN>
fcname <SPAN class="operator token">=</SPAN> r'gdb2<SPAN class="punctuation token">.</SPAN>someschema<SPAN class="punctuation token">.</SPAN>FCNAME
input_fc2 <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>ws2<SPAN class="punctuation token">,</SPAN> fcname<SPAN class="punctuation token">)</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>MakeFeatureLayer_management<SPAN class="punctuation token">(</SPAN>input_fc2<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"input_fl2"</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

tmp_fc <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>CreateFeatureClass_management<SPAN class="punctuation token">(</SPAN><SPAN class="string token">"in_memory"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"tmp"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"POLYGON"</SPAN><SPAN class="punctuation token">)</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>MakeFeatureLayer_management<SPAN class="punctuation token">(</SPAN>tmp_fc<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"tmp_lyr"</SPAN><SPAN class="punctuation token">)</SPAN>

ws1 <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'\\somenetworkpath\gdb1.sde'</SPAN>
fcname <SPAN class="operator token">=</SPAN> r'gdb1<SPAN class="punctuation token">.</SPAN>someschema<SPAN class="punctuation token">.</SPAN>FCNAME
input_fc1 <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>ws1<SPAN class="punctuation token">,</SPAN> fcname<SPAN class="punctuation token">)</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>MakeFeatureLayer_management<SPAN class="punctuation token">(</SPAN>input_fc1<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"input_fl1"</SPAN><SPAN class="punctuation token">)</SPAN>

ws2 <SPAN class="operator token">=</SPAN> r<SPAN class="string token">'\\somenetworkpath\gdb2.sde'</SPAN>
fcname <SPAN class="operator token">=</SPAN> r'gdb2<SPAN class="punctuation token">.</SPAN>someschema<SPAN class="punctuation token">.</SPAN>FCNAME
input_fc2 <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>ws2<SPAN class="punctuation token">,</SPAN> fcname<SPAN class="punctuation token">)</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>MakeFeatureLayer_management<SPAN class="punctuation token">(</SPAN>input_fc2<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"input_fl2"</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

All comments

JamesCrandall

I'm just timing each method to arcpy.MakeFeatureLayer_management -- and I might see 6 seconds on the first workspace (print msgtscratch), while the other may be 1 second or less (print msgtscratch2)! Something like this:

#time the first make feature layer call from SDE gdb1
tscratch = Timer()
with tscratch:
&nbsp;&nbsp;&nbsp;&nbsp; arcpy.MakeFeatureLayer_management(input_fc1, "input_fl1")
msgtscratch = "Create Scratch FL (EGIS) completed in %.02f secs." % (tscratch.interval)
print msgtscratch

#time the first make feature layer call from SDE gdb2
tscratch2 = Timer()
with tscratch2:
&nbsp;&nbsp;&nbsp;&nbsp; arcpy.MakeFeatureLayer_management(input_fc2, "input_fl2")
msgtscratch2 = "Create Scratch FL2 (EGIS2) completed in %.02f secs." % (tscratch2.interval)
print msgtscratch2<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

RandyBurton

Thanks. And things like "include arcpy" are not part of the section being timed?

JamesCrandall

Randy,

I have a Timer class that I use:

<SPAN class="keyword token">class</SPAN> <SPAN class="token class-name">Timer</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">def</SPAN> <SPAN class="token function">__enter__</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; self<SPAN class="punctuation token">.</SPAN>start <SPAN class="operator token">=</SPAN> time<SPAN class="punctuation token">.</SPAN>clock<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> self
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">def</SPAN> <SPAN class="token function">__exit__</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">*</SPAN>args<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; self<SPAN class="punctuation token">.</SPAN>end <SPAN class="operator token">=</SPAN> time<SPAN class="punctuation token">.</SPAN>clock<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; self<SPAN class="punctuation token">.</SPAN>interval <SPAN class="operator token">=</SPAN> self<SPAN class="punctuation token">.</SPAN>end <SPAN class="operator token">-</SPAN> self<SPAN class="punctuation token">.</SPAN>start<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Then just generate time messages at runtime to print out.

tscratch = Timer()
with tscratch:
&nbsp;&nbsp;&nbsp;&nbsp; arcpy.MakeFeatureLayer_management(input_fc1, "input_fl1")
msgtscratch = "Create Scratch FL (EGIS) completed in %.02f secs." % (tscratch.interval)
print msgtscratch<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

This is being executed in pyScripter.

RandyBurton

How are you timing the scripts? Also, is this inside/outside arcmap?

Doe mee aan het gesprek

Aangemelde leden kunnen berichten plaatsen, updates volgen en meer. Nieuw hier? Registreer een gratis account.

Snelle Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.