nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

How can I compare one row of data to the row that came before and the row that came after it.

MeganWelch1

I have a large group of gps points that was collected. I want to select all points that have a spar depth that is greater or less than 20% that of the points that came before or after it (based on the GISID).

GISID Spar Depth

2022 4.035

2023 4.066

2024 3.604

2025 3.576

2026 4.593

2027 2.690

2028 2.960

2029 4.59

import arcpy
counter =0
with arcpy.da.SearchCursor('GPS Gas Main Pipe Point',[ 'GISID', 'SPAR_DEPTH']) as cursor:
     for row in cursor:
         MSDepth = row[1]
         if counter > 0:
             diff = abs(MSDepth-oldMSDepth)
             if diff > 20:
                 print('GISID {}'.format(row[0]))
         oldMSDepth = row[1]
         oldGISID = row[0]
         counter+= 1

Find more posts tagged with

Accepted answers

All comments

RandyBurton

Sounds like a job for numpy array: FeatureClassToNumPyArray. Right, Dan Patterson‌?

DarrenWiens2

See example #2 here for how to read all records into a list, then access items by index (or similarly read into a dictionary and access by key): SearchCursor—Data Access module | ArcGIS Desktop

DanPatterson_Retired

Not sure exactly what you mean, but compare this to the answer you got for your example. a0 should be the forward comparison and a1 the backward comparison. If you see the answers are correct, I can finish it off with selecting from the input array, a, the index that meets one or both conditions. That is the part that needs clarification.

I presume then, that you just and the GISID of the entries(?)

a <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="number token">4.035</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.066</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.604</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.576</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">4.593</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.690</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.960</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.59</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>

a0 <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>diff<SPAN class="punctuation token">(</SPAN>a<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>a<SPAN class="punctuation token">[</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="operator token">*</SPAN><SPAN class="number token">100</SPAN>

a1 <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>diff<SPAN class="punctuation token">(</SPAN>a<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>a<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="operator token">*</SPAN><SPAN class="number token">100</SPAN>

a
array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="number token">4.035</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.066</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.604</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.576</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.593</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.69</SPAN> <SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.96</SPAN> <SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.59</SPAN> <SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>

a0
array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN>&nbsp; <SPAN class="number token">0.76242007</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">12.8190899</SPAN> <SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="operator token">-</SPAN><SPAN class="number token">0.78299776</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">22.14239059</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="operator token">-</SPAN><SPAN class="number token">70.74349442</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp;&nbsp; <SPAN class="number token">9.12162162</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">35.51198257</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>

a1
array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN>&nbsp; <SPAN class="number token">0.76827757</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">11.36251845</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="operator token">-</SPAN><SPAN class="number token">0.77691454</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">28.43959732</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="operator token">-</SPAN><SPAN class="number token">41.43261485</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">10.03717472</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">55.06756757</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

MeganWelch1

I am not sure something like this would work, I am running this script on 200,000+ gps points. I want to create some type of loop that looks at each point and compares the spar depth to the spar depth of the point collected before it and the point collected after it using the GISID to determine relationship.

My end goal is to select all points that has a spar depth that has a +-20% difference compared to the points collected before/after it.

bharold

Hi, Data Interoperability extension has native adjacent feature inspection handling, this is in the AttributeManager transformer, up to 100 prior or subsequent features.

https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Transformers/Transformers/attributemanager.htm

DanPatterson_Retired

My example is exactly what it does, compares the one before to the one after and check the difference.

If it agrees with your example, I can finish up the extra couple of lines that will append the resultant to your input table... unless of course you have the Data Interoperability extension and want to try that route first

DarrenWiens2

If I understand correctly, you can load your data into a list and select those that return 'true':

l <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="number token">4.035</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.066</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.604</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.576</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">4.593</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.690</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.960</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.59</SPAN><SPAN class="punctuation token">]</SPAN>

<SPAN class="keyword token">def</SPAN> <SPAN class="token function">compare</SPAN><SPAN class="punctuation token">(</SPAN>val_1<SPAN class="punctuation token">,</SPAN> val_2<SPAN class="punctuation token">,</SPAN> cur<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; diff <SPAN class="operator token">=</SPAN> abs<SPAN class="punctuation token">(</SPAN>val_2 <SPAN class="operator token">-</SPAN> val_1<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; thresh <SPAN class="operator token">=</SPAN> cur <SPAN class="operator token">*</SPAN> <SPAN class="number token">0.2</SPAN>
&nbsp;&nbsp;&nbsp; diff_minus_thresh <SPAN class="operator token">=</SPAN> diff <SPAN class="operator token">-</SPAN> thresh
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> diff_minus_thresh <SPAN class="operator token">></SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; sel <SPAN class="operator token">=</SPAN> <SPAN class="token boolean">True</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">else</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; sel <SPAN class="operator token">=</SPAN> <SPAN class="token boolean">False</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">return</SPAN> <SPAN class="punctuation token">(</SPAN>l<SPAN class="punctuation token">[</SPAN>i<SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> diff<SPAN class="punctuation token">,</SPAN> thresh<SPAN class="punctuation token">,</SPAN> diff_minus_thresh<SPAN class="punctuation token">,</SPAN> sel<SPAN class="punctuation token">)</SPAN>

<SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">'COMPARE BACKWARD'</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="keyword token">for</SPAN> i <SPAN class="keyword token">in</SPAN> range<SPAN class="punctuation token">(</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">,</SPAN> len<SPAN class="punctuation token">(</SPAN>l<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN>compare<SPAN class="punctuation token">(</SPAN>l<SPAN class="punctuation token">[</SPAN>i<SPAN class="number token">-1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> l<SPAN class="punctuation token">[</SPAN>i<SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> l<SPAN class="punctuation token">[</SPAN>i<SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; 
<SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">'COMPARE FORWARD'</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="keyword token">for</SPAN> i <SPAN class="keyword token">in</SPAN> range<SPAN class="punctuation token">(</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">,</SPAN> len<SPAN class="punctuation token">(</SPAN>l<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN>compare<SPAN class="punctuation token">(</SPAN>l<SPAN class="punctuation token">[</SPAN>i<SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> l<SPAN class="punctuation token">[</SPAN>i<SPAN class="operator token">+</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> l<SPAN class="punctuation token">[</SPAN>i<SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>

COMPARE BACKWARD
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">4.066</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.030999999999999694</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.8132</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.7822000000000003</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">3.604</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.46199999999999974</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.7208000000000001</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.25880000000000036</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">3.576</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.028000000000000025</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.7152000000000001</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.6872</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">4.593</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.017</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.9186000000000001</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.09839999999999982</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">True</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">2.69</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.903</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.538</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.365</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">True</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">2.96</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.27</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.592</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.32199999999999995</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">4.59</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.63</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.918</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.7119999999999999</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">True</SPAN><SPAN class="punctuation token">)</SPAN>
COMPARE FORWARD
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">4.035</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.030999999999999694</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.807</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.7760000000000004</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">4.066</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.46199999999999974</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.8132</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.3512000000000003</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">3.604</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.028000000000000025</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.7208000000000001</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.6928000000000001</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">3.576</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.017</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.7152000000000001</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.30179999999999985</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">True</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">4.593</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.903</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.9186000000000001</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.9843999999999999</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">True</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">2.69</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.27</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.538</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">0.268</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="punctuation token">(</SPAN><SPAN class="number token">2.96</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.63</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0.592</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1.0379999999999998</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="token boolean">True</SPAN><SPAN class="punctuation token">)</SPAN>

‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

DanPatterson_Retired

Ready for arcpy.da.ExtendTable

gisid <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="number token">2022</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2023</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2024</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2025</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2026</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2027</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2028</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2029</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>
a <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="number token">4.035</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.066</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.604</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.576</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">4.593</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.690</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.960</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.59</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="comment token">#</SPAN>
<SPAN class="comment token"># ---- get the differences and put them into an array (z)</SPAN>
<SPAN class="comment token">#</SPAN>
a0 <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>diff<SPAN class="punctuation token">(</SPAN>a<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>a<SPAN class="punctuation token">[</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="operator token">*</SPAN><SPAN class="number token">100</SPAN>
a1 <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>diff<SPAN class="punctuation token">(</SPAN>a<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>a<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="operator token">*</SPAN><SPAN class="number token">100</SPAN>
z <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>zeros<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="number token">8</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">4</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'float'</SPAN><SPAN class="punctuation token">)</SPAN>
z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN> <SPAN class="operator token">=</SPAN> a
z<SPAN class="punctuation token">[</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN> <SPAN class="operator token">=</SPAN> a0
z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2</SPAN><SPAN class="punctuation token">]</SPAN> <SPAN class="operator token">=</SPAN> a1
z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3</SPAN><SPAN class="punctuation token">]</SPAN> <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">(</SPAN>abs<SPAN class="punctuation token">(</SPAN>z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="operator token">></SPAN><SPAN class="number token">20</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="operator token">|</SPAN> <SPAN class="punctuation token">(</SPAN>abs<SPAN class="punctuation token">(</SPAN>z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">2</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="operator token">></SPAN> <SPAN class="number token">20</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">.</SPAN>astype<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'float'</SPAN><SPAN class="punctuation token">)</SPAN>
<SPAN class="comment token">#</SPAN>
<SPAN class="comment token"># ---- make an output array that can be joined to the input table</SPAN>
<SPAN class="comment token">#</SPAN>
names <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="string token">'GISID'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'Spar_depth'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'A0'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'A1'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'Bool'</SPAN><SPAN class="punctuation token">]</SPAN>
vals <SPAN class="operator token">=</SPAN><SPAN class="punctuation token">[</SPAN>gisid<SPAN class="punctuation token">,</SPAN> z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">2</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> z<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">3</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">]</SPAN>
dt_kind <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="string token">'i4'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'<f8'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'<f8'</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="string token">'<f8'</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="string token">'<i4'</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">]</SPAN>
dt <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>dtype<SPAN class="punctuation token">(</SPAN>list<SPAN class="punctuation token">(</SPAN>zip<SPAN class="punctuation token">(</SPAN>names<SPAN class="punctuation token">,</SPAN> dt_kind<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
out <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>recarray<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="number token">8</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN> dtype<SPAN class="operator token">=</SPAN>dt<SPAN class="punctuation token">)</SPAN>
<SPAN class="keyword token">for</SPAN> n <SPAN class="keyword token">in</SPAN> range<SPAN class="punctuation token">(</SPAN>len<SPAN class="punctuation token">(</SPAN>names<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp; nme <SPAN class="operator token">=</SPAN> names<SPAN class="punctuation token">[</SPAN>n<SPAN class="punctuation token">]</SPAN>
&nbsp;&nbsp; out<SPAN class="punctuation token">[</SPAN>nme<SPAN class="punctuation token">]</SPAN> <SPAN class="operator token">=</SPAN> vals<SPAN class="punctuation token">[</SPAN>n<SPAN class="punctuation token">]</SPAN>
<SPAN class="comment token">#&nbsp;&nbsp; </SPAN>
<SPAN class="comment token"># ---- here is the output ready for joining to the input table</SPAN>
<SPAN class="comment token">#</SPAN>
out 
rec<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="number token">2022</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.035</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp;&nbsp; <SPAN class="number token">0</SPAN><SPAN class="punctuation token">.</SPAN>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">,</SPAN>&nbsp;&nbsp; <SPAN class="number token">0.76827757</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="number token">2023</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.066</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp;&nbsp; <SPAN class="number token">0.76242007</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">11.36251845</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="number token">2024</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.604</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">12.8190899</SPAN> <SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="operator token">-</SPAN><SPAN class="number token">0.77691454</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="number token">2025</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3.576</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="operator token">-</SPAN><SPAN class="number token">0.78299776</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">28.43959732</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="number token">2026</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.593</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">22.14239059</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">41.43261485</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="number token">2027</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.69</SPAN> <SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">70.74349442</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">10.03717472</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="number token">2028</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2.96</SPAN> <SPAN class="punctuation token">,</SPAN>&nbsp;&nbsp; <SPAN class="number token">9.12162162</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">55.06756757</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="number token">2029</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4.59</SPAN> <SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">35.51198257</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp;&nbsp; <SPAN class="number token">0</SPAN><SPAN class="punctuation token">.</SPAN>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; dtype<SPAN class="operator token">=</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">'GISID'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'<i4'</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="punctuation token">(</SPAN><SPAN class="string token">'Spar_depth'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'<f8'</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="punctuation token">(</SPAN><SPAN class="string token">'A0'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'<f8'</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">(</SPAN><SPAN class="string token">'A1'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'<f8'</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="punctuation token">(</SPAN><SPAN class="string token">'Bool'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'<i4'</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="comment token">#</SPAN>

<SPAN class="comment token">#---- in your table in *map or *Pro, simply do a query on the Bool column‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

JoshuaBixby

I am not clear what percentage you are interested in applying the 20% threshold to in your question. Using GISID 2024 as an example, are you interested in 2024 being 11.4% lower than 2023 or 2023 being 12.8% higher than 2024? If your threshold was 12% instead of 20%, would 2024 be selected based on 2023 or not?

DanPatterson_Retired

Or is the percentage difference to be 20% over 2023 and 2025....

I wondered about that trailing-leading difference thing, when it is more common to do differences across the key point (ie 2024)

MarianneRohrbach

It is probably not possible to solve the problem in a single iteration. I therefore suggest to save selected gisids in a table and join it to the layer to select the affected points.

You could to the following based on your sequental approach without caching: (I didn't test it...)

<SPAN class="keyword token">import</SPAN> arcpy
counter <SPAN class="operator token">=</SPAN> <SPAN class="number token">0</SPAN>
FirstMSDepth <SPAN class="operator token">=</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN>
InspectMSDepth <SPAN class="operator token">=</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN>
NextMSDepth <SPAN class="operator token">=</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN>
FirstGisID <SPAN class="operator token">=</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN>
InspectGisID <SPAN class="operator token">=</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN>
NextGisID <SPAN class="operator token">=</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">1</SPAN>
thresHold <SPAN class="operator token">=</SPAN> <SPAN class="number token">0.2</SPAN>
gisIDArray <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>

<SPAN class="keyword token">with</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>da<SPAN class="punctuation token">.</SPAN>SearchCursor<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'GPS Gas Main Pipe Point'</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="punctuation token">[</SPAN> <SPAN class="string token">'GISID'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'SPAR_DEPTH'</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> sql_clauses<SPAN class="operator token">=</SPAN><SPAN class="string token">'ORDER BY GISID'</SPAN><SPAN class="punctuation token">)</SPAN> <SPAN class="keyword token">as</SPAN> cursor<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">for</SPAN> row <SPAN class="keyword token">in</SPAN> cursor<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; currRate <SPAN class="operator token">=</SPAN> <SPAN class="number token">0</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> counter <SPAN class="operator token">></SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; currRate <SPAN class="operator token">=</SPAN> abs<SPAN class="punctuation token">(</SPAN>FirstMSDepth<SPAN class="operator token">-</SPAN>InspectMSDepth<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>InspectMSDepth
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> currRate <SPAN class="operator token"><</SPAN> thresHold <SPAN class="operator token">and</SPAN> counter <SPAN class="operator token">></SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; currRate <SPAN class="operator token">=</SPAN> abs<SPAN class="punctuation token">(</SPAN>NextMSDepth<SPAN class="operator token">-</SPAN>InspectMSDepth<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>InspectMSDepth
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">if</SPAN> currRate <SPAN class="operator token">>=</SPAN> thresHold<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"GISID {} - Rate {}"</SPAN><SPAN class="punctuation token">.</SPAN>format<SPAN class="punctuation token">(</SPAN>InspectGisID<SPAN class="punctuation token">,</SPAN> currRate<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; gisIDArray <SPAN class="operator token">+=</SPAN> <SPAN class="punctuation token">[</SPAN>InspectGisID<SPAN class="punctuation token">]</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; FirstMSDepth<SPAN class="punctuation token">,</SPAN> FirstGisID <SPAN class="operator token">=</SPAN> InspectMSDepth<SPAN class="punctuation token">,</SPAN> InspectGisID 
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; InspectMSDepth<SPAN class="punctuation token">,</SPAN> InspectGisID <SPAN class="operator token">=</SPAN> NextMSDepth<SPAN class="punctuation token">,</SPAN> NextGisID
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NextMSDepth<SPAN class="punctuation token">,</SPAN> NextGisID <SPAN class="operator token">=</SPAN> row<SPAN class="punctuation token">[</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> row<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; counter<SPAN class="operator token">+=</SPAN> <SPAN class="number token">1</SPAN>

<SPAN class="keyword token">if</SPAN> counter <SPAN class="operator token">></SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; currRate <SPAN class="operator token">=</SPAN> abs<SPAN class="punctuation token">(</SPAN>FirstMSDepth<SPAN class="operator token">-</SPAN>InspectMSDepth<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>InspectMSDepth
<SPAN class="keyword token">if</SPAN> currRate <SPAN class="operator token"><</SPAN> thresHold <SPAN class="operator token">and</SPAN> counter <SPAN class="operator token">></SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; currRate <SPAN class="operator token">=</SPAN> abs<SPAN class="punctuation token">(</SPAN>NextMSDepth<SPAN class="operator token">-</SPAN>InspectMSDepth<SPAN class="punctuation token">)</SPAN><SPAN class="operator token">/</SPAN>InspectMSDepth
<SPAN class="keyword token">if</SPAN> currRate <SPAN class="operator token">>=</SPAN> thresHold<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="keyword token">print</SPAN><SPAN class="punctuation token">(</SPAN><SPAN class="string token">"GISID {} - Rate {}"</SPAN><SPAN class="punctuation token">.</SPAN>format<SPAN class="punctuation token">(</SPAN>InspectGisID<SPAN class="punctuation token">,</SPAN> currRate<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; gisIDArray <SPAN class="operator token">+=</SPAN> <SPAN class="punctuation token">[</SPAN>InspectGisID<SPAN class="punctuation token">]</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Since you need a selection, you would probably want to save the gisids in a table to join and select these records.

To join and select use GP-Tools:
- CreateTable_management to persist selected gisids
- Use
  for gisID in gisIDArray:
  .. insertcursor to append gisID to the table
AddIndex_management for the GisID-Fields where the join is based on
AddJoin_management to join the new GisID-Table to the original GPS Gas Main Pipe Point Layer with KEEP_COMMON
SelectLayerbyAttribute_management with NEW_SELECTION and e.g. OBJECTID >= 0 to select all
RemoveJoin_management

DanPatterson_Retired

How do your results compare to those already posted? Are they the same? With the numpy solution the forward and backward looking are done in one pass

JessicaFraver1_1-1627954746224.png

MarianneRohrbach

The difference is, that it does not cache data in memory. Loading all data first into arrays is often not possible for big data. So you need sequential algorithms or geoprocessing tools to solve the problem.

In addition it expands the original approach, which is probably better understood.

NeilAyres

I have found that you can handle dictionaries with +2million records before you run out of memory.

If that happens, then switch to the 64bit version of python. 64bit is installed when you install the back ground geoprocessing module for Desktop

DanPatterson_Retired

With numpy you don't need to load the whole set of data into memory either. I doubt that a searchcursor does a dice on the data before it begins to process.

Join the Conversation

Signed in members can post, follow updates, and more. New here? Register a free account.

Quick Links

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.