nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

How to calculate the percentile for each cell from timeseries raster

BennyIstanto

Branched from: https://community.esri.com/thread/95403

Hi Xander Bakker thank you for above script. I have tested and it works using my data.

But I have question. Let say I have timeseries raster data from 1981 to 2016, its the max of daily rainfall in a year, so its just 1 raster data for 1 year. For each cell in x,y location from 1981 to 2016, I would like to calculate the percentile of i.e 90%.

How to calculate the percentile for each cell from timeseries raster using your script?

Finde mehr Beiträge mit dem Tag

Accepted answers

DanPatterson_Retired

<SPAN class="keyword token">import</SPAN> numpy
<SPAN class="keyword token">import</SPAN> arcpy

flder <SPAN class="operator token">=</SPAN> r<SPAN class="string token">"C:\Temp\Max3days"</SPAN>&nbsp;&nbsp; <SPAN class="comment token"># where I unzipped your files</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>workspace <SPAN class="operator token">=</SPAN> flder
rasters <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListRasters<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>

arrs <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
<SPAN class="keyword token">for</SPAN> i <SPAN class="keyword token">in</SPAN> rasters<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; arrs<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>arcpy<SPAN class="punctuation token">.</SPAN>RasterToNumPyArray<SPAN class="punctuation token">(</SPAN>i<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
a <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN>arrs<SPAN class="punctuation token">)</SPAN>

<SPAN class="comment token"># ---- create the masked arrays assuming 0.0 is the null/nodata value ----</SPAN>
arrs_m <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
<SPAN class="keyword token">for</SPAN> i <SPAN class="keyword token">in</SPAN> arrs<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; m <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>where<SPAN class="punctuation token">(</SPAN>a<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN> <SPAN class="operator token">==</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; am <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>ma<SPAN class="punctuation token">.</SPAN>MaskedArray<SPAN class="punctuation token">(</SPAN>i<SPAN class="punctuation token">,</SPAN> mask<SPAN class="operator token">=</SPAN>m<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; arrs_m<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>am<SPAN class="punctuation token">)</SPAN>
a_m <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN>arrs_m<SPAN class="punctuation token">)</SPAN>
n_90 <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>nanpercentile<SPAN class="punctuation token">(</SPAN>a_m<SPAN class="punctuation token">,</SPAN> <SPAN class="number token">90</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">,</SPAN> axis<SPAN class="operator token">=</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN>

<SPAN class="string token">""" ---- I would like the coordinates and cell size of the lower left corner !!!
 NumPyArrayToRaster (in_array,
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {lower_left_corner},
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {x_cell_size},
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {y_cell_size},
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {value_to_nodata})
"""</SPAN>

out <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>NumPyArrayToRaster<SPAN class="punctuation token">(</SPAN>n_90<SPAN class="punctuation token">,</SPAN> value_to_nodata<SPAN class="operator token">=</SPAN><SPAN class="number token">0.0</SPAN><SPAN class="punctuation token">)</SPAN>
out_name <SPAN class="operator token">=</SPAN> <SPAN class="string token">"\\"</SPAN><SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN>flder<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"n_90.tif"</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>
out<SPAN class="punctuation token">.</SPAN>save<SPAN class="punctuation token">(</SPAN>out_name<SPAN class="punctuation token">)</SPAN>
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Now if you could fill me in on what the values should look like, I can change stuff.

The attached is the nanpercentile at the 90% percentile for the array stack.

Keep me posted, I haven't had a look in Arc anything yet, so do not add it into a dataframe or map with other data, since it has no coordinate or cell size information yet,.

ADDENDUM

pretty coarse grid or a small area

n_90.zip

All comments

XanderBakker

Hi Benny Istanto ,

I branched your question to another thread since it is not a zonal statistics operation but rather a pixel based analysis. As far as I know there is no tool that will determine the 90% percentile on a cell based analysis for a series of rasters. However, you could follow the example provided here: https://community.esri.com/thread/198969-trend-analysis-through-time-series-of-raster-data#comment-711148

This will loop through all the cells and read out the values of the different rasters. Then you can determine the 90% percentile in a separate function and write that to a new raster. If you have a set of sample data, I can help you tweak the script.

DanPatterson_Retired

Interesting, you just need to convert your rasters to numpy arrays (RasterToNumPyArray in arcpy)

a <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>arange<SPAN class="punctuation token">(</SPAN><SPAN class="number token">9</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">.</SPAN>reshape<SPAN class="punctuation token">(</SPAN><SPAN class="number token">3</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">3</SPAN><SPAN class="punctuation token">)</SPAN>&nbsp; <SPAN class="comment token"># ---- a sample simple array</SPAN>

<SPAN class="comment token"># ---- make some fake arrays representing different times -----</SPAN>
a_s <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
<SPAN class="keyword token">for</SPAN> i <SPAN class="keyword token">in</SPAN> range<SPAN class="punctuation token">(</SPAN><SPAN class="number token">10</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; a_s<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>a <SPAN class="operator token">+</SPAN> i<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; 
a_n <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN>a_s<SPAN class="punctuation token">)</SPAN>&nbsp; <SPAN class="comment token"># --- stack them depth-wise ----</SPAN>

frmt_<SPAN class="punctuation token">(</SPAN>a_n<SPAN class="punctuation token">,</SPAN> title<SPAN class="operator token">=</SPAN><SPAN class="string token">'Ten arrays'</SPAN><SPAN class="punctuation token">)</SPAN>&nbsp; <SPAN class="comment token"># ---- let's look at them in sequence ----</SPAN>
Ten arrays<SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN>
<SPAN class="operator token">-</SPAN>shape <SPAN class="punctuation token">(</SPAN><SPAN class="number token">10</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN> ndim <SPAN class="number token">3</SPAN>
&nbsp; <SPAN class="punctuation token">.</SPAN>&nbsp; <SPAN class="number token">0</SPAN>&nbsp; <SPAN class="number token">1</SPAN>&nbsp; <SPAN class="number token">2</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">1</SPAN>&nbsp; <SPAN class="number token">2</SPAN>&nbsp; <SPAN class="number token">3</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">2</SPAN>&nbsp; <SPAN class="number token">3</SPAN>&nbsp; <SPAN class="number token">4</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">3</SPAN>&nbsp; <SPAN class="number token">4</SPAN>&nbsp; <SPAN class="number token">5</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">4</SPAN>&nbsp; <SPAN class="number token">5</SPAN>&nbsp; <SPAN class="number token">6</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">5</SPAN>&nbsp; <SPAN class="number token">6</SPAN>&nbsp; <SPAN class="number token">7</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">6</SPAN>&nbsp; <SPAN class="number token">7</SPAN>&nbsp; <SPAN class="number token">8</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">7</SPAN>&nbsp; <SPAN class="number token">8</SPAN>&nbsp; <SPAN class="number token">9</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">8</SPAN>&nbsp; <SPAN class="number token">9</SPAN> <SPAN class="number token">10</SPAN>&nbsp;&nbsp; <SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN>
&nbsp; <SPAN class="punctuation token">.</SPAN>&nbsp; <SPAN class="number token">3</SPAN>&nbsp; <SPAN class="number token">4</SPAN>&nbsp; <SPAN class="number token">5</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">4</SPAN>&nbsp; <SPAN class="number token">5</SPAN>&nbsp; <SPAN class="number token">6</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">5</SPAN>&nbsp; <SPAN class="number token">6</SPAN>&nbsp; <SPAN class="number token">7</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">6</SPAN>&nbsp; <SPAN class="number token">7</SPAN>&nbsp; <SPAN class="number token">8</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">7</SPAN>&nbsp; <SPAN class="number token">8</SPAN>&nbsp; <SPAN class="number token">9</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">8</SPAN>&nbsp; <SPAN class="number token">9</SPAN> <SPAN class="number token">10</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">9</SPAN> <SPAN class="number token">10</SPAN> <SPAN class="number token">11</SPAN>&nbsp;&nbsp; <SPAN class="number token">10</SPAN> <SPAN class="number token">11</SPAN> <SPAN class="number token">12</SPAN>&nbsp;&nbsp; <SPAN class="number token">11</SPAN> <SPAN class="number token">12</SPAN> <SPAN class="number token">13</SPAN>&nbsp;&nbsp; <SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN>
&nbsp; <SPAN class="punctuation token">.</SPAN>&nbsp; <SPAN class="number token">6</SPAN>&nbsp; <SPAN class="number token">7</SPAN>&nbsp; <SPAN class="number token">8</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">7</SPAN>&nbsp; <SPAN class="number token">8</SPAN>&nbsp; <SPAN class="number token">9</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">8</SPAN>&nbsp; <SPAN class="number token">9</SPAN> <SPAN class="number token">10</SPAN>&nbsp;&nbsp;&nbsp; <SPAN class="number token">9</SPAN> <SPAN class="number token">10</SPAN> <SPAN class="number token">11</SPAN>&nbsp;&nbsp; <SPAN class="number token">10</SPAN> <SPAN class="number token">11</SPAN> <SPAN class="number token">12</SPAN>&nbsp;&nbsp; <SPAN class="number token">11</SPAN> <SPAN class="number token">12</SPAN> <SPAN class="number token">13</SPAN>&nbsp;&nbsp; <SPAN class="number token">12</SPAN> <SPAN class="number token">13</SPAN> <SPAN class="number token">14</SPAN>&nbsp;&nbsp; <SPAN class="number token">13</SPAN> <SPAN class="number token">14</SPAN> <SPAN class="number token">15</SPAN>&nbsp;&nbsp; <SPAN class="number token">14</SPAN> <SPAN class="number token">15</SPAN> <SPAN class="number token">16</SPAN>&nbsp;&nbsp; <SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">.</SPAN>

cell <SPAN class="operator token">=</SPAN> a_n<SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">:</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN>&nbsp; <SPAN class="comment token"># ---- take the top left cell for all arrays</SPAN>

cell
array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">2</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">3</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">4</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">5</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">6</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">7</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">8</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">9</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>

np<SPAN class="punctuation token">.</SPAN>percentile<SPAN class="punctuation token">(</SPAN>cell<SPAN class="punctuation token">,</SPAN> <SPAN class="number token">50</SPAN><SPAN class="punctuation token">)</SPAN>&nbsp; <SPAN class="comment token"># ---- the median</SPAN>
<SPAN class="number token">4.5</SPAN>

np<SPAN class="punctuation token">.</SPAN>percentile<SPAN class="punctuation token">(</SPAN>cell<SPAN class="punctuation token">,</SPAN> <SPAN class="number token">25</SPAN><SPAN class="punctuation token">)</SPAN>&nbsp; <SPAN class="comment token"># ---- lower quartile</SPAN>
<SPAN class="number token">2.25</SPAN>

np<SPAN class="punctuation token">.</SPAN>percentile<SPAN class="punctuation token">(</SPAN>cell<SPAN class="punctuation token">,</SPAN> <SPAN class="number token">90</SPAN><SPAN class="punctuation token">)</SPAN>&nbsp; <SPAN class="comment token"># ---- 90th percentile</SPAN>
<SPAN class="number token">8.0999999999999996</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Then you can do the percentile for all the cells at once.

np<SPAN class="punctuation token">.</SPAN>percentile<SPAN class="punctuation token">(</SPAN>a_n<SPAN class="punctuation token">,</SPAN> q<SPAN class="operator token">=</SPAN><SPAN class="number token">90</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">,</SPAN> axis<SPAN class="operator token">=</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN>
 
array<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">[</SPAN>&nbsp; <SPAN class="number token">8.1</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp;&nbsp; <SPAN class="number token">9.1</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">10.1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">[</SPAN> <SPAN class="number token">11.1</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">12.1</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">13.1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <SPAN class="punctuation token">[</SPAN> <SPAN class="number token">14.1</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">15.1</SPAN><SPAN class="punctuation token">,</SPAN>&nbsp; <SPAN class="number token">16.1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Read the docs associated with numpy percentile and scipy percentile... there are other controlling factors that can be put into play without the need to compile a complete ogive for each cell.

BennyIstanto

Thank you Dan Patterson and Xander Bakker for explanation. Unfortunately it's difficult for me to modified above python script with numpy.

So far I have try using gdal, I found a script from StackExchange "gdal_calc.py -A stack.vrt allBands=A --calc='nanpercentile(A.astype(int16),85,axis=0)' --outfile out.tif" and arcpy script mentioned in this discussion Pool of raster values to calculate percentile

I am getting an output using both script, however looks entirely wrong if I compared using manual calculation using Excel (I convert all raster data to csv, and calculate the percentile for each point using formula below)

The idea is to get the rainfall threshold and rainfall-triggered flood with return period, let say for 10 and 25 year. If my data is in excel format, I used =PERCENTILE(DATARANGE,0.9) for calculating the rainfall threshold for 10 year return period of rainfall-triggered flood.

I have upload example data of rainfall below.

Rainfall Timeseries 1981 - 2016

DanPatterson_Retired

<SPAN class="keyword token">import</SPAN> numpy
<SPAN class="keyword token">import</SPAN> arcpy

flder <SPAN class="operator token">=</SPAN> r<SPAN class="string token">"C:\Temp\Max3days"</SPAN>&nbsp;&nbsp; <SPAN class="comment token"># where I unzipped your files</SPAN>
arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>workspace <SPAN class="operator token">=</SPAN> flder
rasters <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>ListRasters<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>

arrs <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
<SPAN class="keyword token">for</SPAN> i <SPAN class="keyword token">in</SPAN> rasters<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; arrs<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>arcpy<SPAN class="punctuation token">.</SPAN>RasterToNumPyArray<SPAN class="punctuation token">(</SPAN>i<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>
a <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN>arrs<SPAN class="punctuation token">)</SPAN>

<SPAN class="comment token"># ---- create the masked arrays assuming 0.0 is the null/nodata value ----</SPAN>
arrs_m <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
<SPAN class="keyword token">for</SPAN> i <SPAN class="keyword token">in</SPAN> arrs<SPAN class="punctuation token">:</SPAN>
&nbsp;&nbsp;&nbsp; m <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>where<SPAN class="punctuation token">(</SPAN>a<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN> <SPAN class="operator token">==</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">1</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; am <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>ma<SPAN class="punctuation token">.</SPAN>MaskedArray<SPAN class="punctuation token">(</SPAN>i<SPAN class="punctuation token">,</SPAN> mask<SPAN class="operator token">=</SPAN>m<SPAN class="punctuation token">)</SPAN>
&nbsp;&nbsp;&nbsp; arrs_m<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>am<SPAN class="punctuation token">)</SPAN>
a_m <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>array<SPAN class="punctuation token">(</SPAN>arrs_m<SPAN class="punctuation token">)</SPAN>
n_90 <SPAN class="operator token">=</SPAN> np<SPAN class="punctuation token">.</SPAN>nanpercentile<SPAN class="punctuation token">(</SPAN>a_m<SPAN class="punctuation token">,</SPAN> <SPAN class="number token">90</SPAN><SPAN class="punctuation token">.</SPAN><SPAN class="punctuation token">,</SPAN> axis<SPAN class="operator token">=</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">)</SPAN>

<SPAN class="string token">""" ---- I would like the coordinates and cell size of the lower left corner !!!
 NumPyArrayToRaster (in_array,
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {lower_left_corner},
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {x_cell_size},
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {y_cell_size},
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {value_to_nodata})
"""</SPAN>

out <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>NumPyArrayToRaster<SPAN class="punctuation token">(</SPAN>n_90<SPAN class="punctuation token">,</SPAN> value_to_nodata<SPAN class="operator token">=</SPAN><SPAN class="number token">0.0</SPAN><SPAN class="punctuation token">)</SPAN>
out_name <SPAN class="operator token">=</SPAN> <SPAN class="string token">"\\"</SPAN><SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN>flder<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"n_90.tif"</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>
out<SPAN class="punctuation token">.</SPAN>save<SPAN class="punctuation token">(</SPAN>out_name<SPAN class="punctuation token">)</SPAN>
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>

Now if you could fill me in on what the values should look like, I can change stuff.

The attached is the nanpercentile at the 90% percentile for the array stack.

Keep me posted, I haven't had a look in Arc anything yet, so do not add it into a dataframe or map with other data, since it has no coordinate or cell size information yet,.

ADDENDUM

pretty coarse grid or a small area

n_90.zip

BennyIstanto

Wow excellent!

The result almost same with manual version, slightly different on the minimum value (your script is 109.391 and manual version is 105.947, for the max is same. See pictures attached (map and statistics info from gdal).

The raster extent is not exactly same with yours, because its from excel - convert to point - convert to raster and clip with boundary. Here's the file: n_90_manual.zip

n_90_manual

statistic

And yes you are correct, its pretty coarse grid with 0.05 deg spatial resolution.

The data came from CHIRPS global precipitation data CHG - Data and this data is the best available global precipitation data with temporal resolution daily, 5days, 10days, monthly, 2monthly, 3monthly and annual from 1981 until now and free for public. So far this data are very useful for me when getting weather station data from govt is very difficult.

Thank you Dan Patterson

DanPatterson_Retired

Glad it worked Benny, Other statistics can be rapidly derived from the data if needed. Let me know if there is anything else that is required.

BennyIstanto

One more thing, the TIF output don't have any spatial reference. How to make it available automatically on the output during the calculation, so it's ready to overlay with other data.

Nimm an der Diskussion teil

Angemeldete Mitglieder können Beiträge verfassen, Updates folgen und mehr. Neu hier? Registriere ein kostenloses Konto.

Schnellzugriffe

Community Help
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.