topic Re: Calculate list of raster from two different subfolder using ArcPy in Python Questions

Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Sat, 11 Dec 2021 22:01:20 GMT

I have two different folder (workspace1 and workspace2) with Rasters data with the two different parameters. Whatever raster in workspace1 (input raster name e.g 001_mean, 002_mean, 003_mean, 004_mean ….012_mean ), I would like to execute below equation

((Raster – Min Rater value) * (0.95 – 0.01)) / (Max raster value – Min Raster Value )‍‍

and save it into outputfolder 1 name of output (e.g. 001_FPAR, 002_FPAR, 003_FPAR, 004_FPAR ….012_FPAR)

After calculating workspace1, I want to take different raster file from workspace 2 (raster name , 001_SR, 002_SR, 003_SR, 004_SR……012_SR) and multiply it with each raster file with calculated raster from workspace 1 and save it into outputfolder 2 as name of 001_APAR, 002_APAR, 003_APAR, 004_APAR ……012_APAR.

I have attached below the list of input raster.

I have written the code below but its giving error

import arcpy 
arcpy.CheckOutExtension("Spatial") 
from arcpy.sa import * 
 
workspace1 = glob.glob(r"D:\MODIS-NDVI-2012\MASKED-NDVI-2012A") 
workspace2 = glob.glob(r"D:\MODIS-NDVI-2012\MASKED")
outFolder1 = r"D:\MODIS-NDVI-2012\FPAR"
outFolder2 = r"D:\MODIS-NDVI-2012\APAR"
list = arcpy.ListRasters()
for inRaster in list:
 localRaster = Raster(inRaster) 
for r in workspace1 
NDVIMINResult = arcpy.GetRasterProperties_management(inRaster1, "MINIMUM") 
NDVIMAXResult = arcpy.GetRasterProperties_management(inRaster1, "MAXIMUM") 
 
NDVIMin = float(NDVIMINResult.getOutput(0)) 
NDVIMax = float(NDVIMAXResult.getOutput(0))
outminus = Minus(inRaster1, NDVIMin)
outminus1 = Minus(0.95-0.01)
outmultiply = Multiply(outminus,outminus1)
outminus2 = Minus(NDVIMax, NDVIMin)
outdevide = Devide(outmultiply,outminus2)
outdevide.save = (outdevide) 
for r in workspace2
outmultiply1 = Multiply (outdevide,Raster)
outmultiply1.save (outmultiply1)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Sat, 11 Dec 2021 22:01:23 GMT

I would probably do something like this:

def main():
    import arcpy
    import os

    # Checkout extension
    arcpy.CheckOutExtension("Spatial")

    # avoid using - in folders in combination with raster calculations!
    ws_in_mean = r'D:\MODIS-NDVI-2012\MASKED-NDVI-2012A'
    ws_in_sr = r'D:\MODIS-NDVI-2012\MASKED'
    ws_out_fpar = r'D:\MODIS-NDVI-2012\FPAR'
    ws_out_apar = r'D:\MODIS-NDVI-2012\APAR'

    # list "mean" rasters
    arcpy.env.workspace = ws_in_mean
    lst_ras_mean = arcpy.ListRasters()
##    lst_ras_mean = ['001_mean','002_mean','003_mean','004_mean',
##                   '005_mean','006_mean','007_mean','008_mean',
##                   '009_mean','010_mean','011_mean','012_mean']

    # list "sr" rasters
    arcpy.env.workspace = ws_in_sr
    lst_ras_sr = arcpy.ListRasters()
##    lst_ras_sr =  ['001_sr','002_sr','003_sr','004_sr',
##                    '005_sr','006_sr','007_sr','008_sr',
##                    '009_sr','010_sr','011_sr','012_sr']

    for ras_name in lst_ras_mean:
        ras_mean = arcpy.Raster(os.path.join(ws_in_mean, ras_name))

        # calculate ((Raster – Min Rater value) * (0.95 – 0.01)) / (Max raster value – Min Raster Value )
        ras_fpar = ((ras_mean - ras_mean.minimum) * (0.95 - 0.01)) / (ras_mean.maximum - ras_mean.minimum)

        # save raster
        ras_num = ras_name[:3]
        out_name_fpar = os.path.join(ws_out_fpar, 'r{0}_fpar'.format(ras_num))
        ras_fpar.save(out_name_fpar)

        # calculate apar raster
        ras_name_sr = '{0}_sr'.format(ras_num)
        if ras_name_sr in lst_ras_sr:
            ras_sr = arcpy.Raster(os.path.join(ws_in_sr, ras_name))
            ras_apar = ras_sr * ras_fpar

            # save raster
            out_name_apar = os.path.join(ws_out_apar, 'r{0}_apar'.format(ras_num))
            ras_aparsave(out_name_apar)


if __name__ == '__main__':
    main()‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Some points to understand:

Avoid using "-" in your paths with raster data if you want to perform calculations on them. This may cause errors
Avoid starting the names of raster with a number
You can use the list rasters in a folder if you set the workspace previously (see lines 15 + 16 and 22 + 23)
Use raster objects (see line 29) so you can access the properties minimum and maximum directly from the raster (see line 32) and perform raster algebra (see line 32 and 43)

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Wed, 17 Aug 2016 15:25:04 GMT

BTW, the code has not been tested, since I do not have access to sample data...

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Wed, 17 Aug 2016 17:01:27 GMT

Xander Bakker‌ , Thank you. I have run the updated code given by you, upto FPAR program run correctly but after FPAR program not working (APAR folder is empty) while its successfully execute. There is no output file for APAR. Even there is no error massage showing after finished the program.

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Wed, 17 Aug 2016 17:48:20 GMT

Glad to hear to some part works... The probleable reason for the APAR folder to be empty is the validation performed on line 41. It checks literally if the name exists in the folder with the SR rasters. I notice that I used lowercase. That will probably be the reason for not creating the APAR rasters. Will get back shortly with some code that provides more info and a better way for checking the existence of the required rasters.

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Sat, 11 Dec 2021 22:01:26 GMT

Try something like this:

def main():
    import arcpy
    import os

    # Checkout extension
    arcpy.CheckOutExtension("Spatial")
    arcpy.env.overwriteOutput = True

    # avoid using - in folders in combination with raster calculations!
    ws_in_mean = r'D:\MODIS-NDVI-2012\MASKED-NDVI-2012A'
    ws_in_sr = r'D:\MODIS-NDVI-2012\MASKED'
    ws_out_fpar = r'D:\MODIS-NDVI-2012\FPAR'
    ws_out_apar = r'D:\MODIS-NDVI-2012\APAR'

    # list "mean" rasters
    arcpy.env.workspace = ws_in_mean
    lst_ras_mean = arcpy.ListRasters()
    print "lst_ras_mean", lst_ras_mean

    # list "sr" rasters
    arcpy.env.workspace = ws_in_sr
    lst_ras_sr = arcpy.ListRasters()
    print "lst_ras_sr", lst_ras_sr

    for ras_name in lst_ras_mean:
        ras_mean = arcpy.Raster(os.path.join(ws_in_mean, ras_name))
        print "ras_mean", ras_name

        # calculate ((Raster – Min Rater value) * (0.95 – 0.01)) / (Max raster value – Min Raster Value )
        ras_fpar = ((ras_mean - ras_mean.minimum) * (0.95 - 0.01)) / (ras_mean.maximum - ras_mean.minimum)

        # save raster
        ras_num = ras_name[:3]
        out_name_fpar = os.path.join(ws_out_fpar, 'r{0}_FPAR'.format(ras_num))
        ras_fpar.save(out_name_fpar)

        # calculate apar raster
        ras_name_sr = '{0}_SR'.format(ras_num)
        
        if ras_name_sr.upper() in [r.upper() for r in lst_ras_sr]:
            print "ras_name_sr", ras_name_sr
            ras_sr = arcpy.Raster(os.path.join(ws_in_sr, ras_name))
            ras_apar = ras_sr * ras_fpar

            # save raster
            out_name_apar = os.path.join(ws_out_apar, 'r{0}_APAR'.format(ras_num))
            ras_aparsave(out_name_apar)

        else:
            print "Error:", ras_name_sr, "not in lst_ras_sr"


if __name__ == '__main__':
    main()‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Sat, 11 Dec 2021 22:01:28 GMT

Following error massage appearing. 001_SR to 012_SR. This program also calculate upto FPAR and when its execute APAR function that time might be error occurring. Below i have attached two images from two workspace . Kindly find it for reference purpose. Thank you

lst_ras_mean [u'001_mean.tif', u'002_mean.tif', u'003_mean.tif', u'004_mean.tif', u'005_mean.tif', u'006_mean.tif', u'007_mean.tif', u'008_mean.tif', u'009_mean.tif', u'010_mean.tif', u'011_mean.tif', u'012_mean.tif']
lst_ras_sr [u'001_sr.tif', u'002_sr.tif', u'003_sr.tif', u'004_sr.tif', u'005_sr.tif', u'006_sr.tif', u'007_sr.tif', u'008_sr.tif', u'009_sr.tif', u'010_sr.tif', u'011_sr.tif', u'012_sr.tif']‍‍‍‍‍‍‍‍

ras_mean 001_mean.tif
Error: 001_SR not in lst_ras_sr ‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Thu, 18 Aug 2016 03:43:16 GMT

I did not include the .tif extension in the name on line 38. Change this line to:

        ras_name_sr = '{0}_SR.TIF'.format(ras_num)‍

Then you will probably want to have tif files for all the outputs. In that case change line 34 to:

        out_name_fpar = os.path.join(ws_out_fpar, 'r{0}_FPAR.TIF'.format(ras_num))‍

... and line 46 to:

            out_name_apar = os.path.join(ws_out_apar, 'r{0}_APAR.TIF'.format(ras_num))‍

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Sat, 11 Dec 2021 22:01:31 GMT

I have rerun the updated code, following error massage appearing. And into mask folder raster name like 001_sr, but program reading different file in that folder

Runtime error 
Traceback (most recent call last):
 File "<string>", line 53, in <module>
 File "<string>", line 41, in main
RuntimeError: ERROR 000732: Input Raster: Dataset D:\MODIS-NDVI-2012\MASKED\001_mean.tif does not exist or is not supported‍‍‍‍‍‍‍‍‍‍

Re: Calculate list of raster from two different subfolder using ArcPy

DanPatterson_Retired — Thu, 18 Aug 2016 04:49:57 GMT

paths with dashes are flakey and filenames beginning with a number can be suspect as well. create a simple folder and filename to rule out file reading issues

r"c:\test\test.tif"

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Thu, 18 Aug 2016 05:18:55 GMT

Xander Bakker‌. Thank you very much. Finally i have solved the issue. Now the code is running fine without any issues. There was small correction on line 42, Corrected line is, after the rster name sr command did not include. Once again thank you very much.

ras_sr = arcpy.Raster(os.path.join(ws_in_sr, ras_name_sr))

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Thu, 18 Aug 2016 05:21:27 GMT

Thank you Dan_Patterson‌.There was small correction needed, i have solved the issue. Thank you very much

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Thu, 18 Aug 2016 18:34:18 GMT

Xander Bakker‌ I want to do small modification on above code, following instruction, Instead of multiplication (Line no 43) FPAR * sr raster, i want to do multiplication FPAR * (any numaric value e.g 20) and output raster pass it to APAR folder. meanwhile upto FPAR i want to keep the program same, only APAR stage i want to modify by multiply Numeric digit (any numaric value e.g 20) with FPAR instead of SR raster.

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Thu, 18 Aug 2016 18:56:19 GMT

line 43 contains this code:

ras_apar = ras_sr * ras_fpar

but you can change it to:

ras_apar = ras_sr * 20

and it will still work.

Is that want you want? It will still generate the same output apar filename, so if you don't want to loose the other results, you should change the output filename on line 46

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Fri, 19 Aug 2016 02:38:43 GMT

xander_bakker‌. Thank you. Yes exactly same i was looking for which you mentioned .The modified code is working perfectly. Once again thank you very much for the cooperation.

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Fri, 19 Aug 2016 03:29:24 GMT

You're welcome. I'm glad it works!

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Tue, 23 Aug 2016 09:42:36 GMT

Xander Bakker‌. I would like to do small modification on above code.

Instead of Multiplication sr raster with FPAR (Line no 43). I want to multiply some specific value with monthly FPAR raster. And keep as it same.

JANUARY	FEBRUARY	MARCH	APRIL	MAY	JUNE	JULY	AUGUST	SEPTEMBER	OCTOBER	NOVEMBER	DECEMBER
179.36	194.95	239.44	289.05	318.66	272.35	227.13	182.76	168.53	210.87	176.31	182.41

(Line no 43:  ras_apar = ras_sr * ras_fpar) ‍‍‍

Than i want to execute this equation to calculate one more parameter (e.g for JANUARY : 0.5 + 0.5 * (001_APAR/179.36) , for FEBRUARY: 0.5 + 0.5*(002_APAR/194.95 (For JANUARY)), and save it to workspace (D:\MODIS-NDVI-2012\ws_out_wscaler).

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Sat, 11 Dec 2021 22:01:34 GMT

Not a complete solution, but below an example of how you can implement it. The idea is to create a dictionary (lines 5 to 7). You can extract the value for each month using the numbers that represent the month and multiply that value directly with the raster. The solution to the second question is shown starting at line 27 and uses the same concept.

def main():
    
    # you should create a dictionary that allows you to get the values you need
    # in this case the key is the month indicator
    dct = {'001': 179.36, '002': 194.95, '003': 239.44, '004': 289.05,
           '005': 318.66, '006': 272.35, '007': 227.13, '008': 182.76,
           '009': 168.53, '010': 210.87, '011': 176.31, '012': 182.41}


    # Instead of Multiplication sr raster with FPAR (Line no 43).
    # I want to multiply some specific value with monthly FPAR raster
    ras_name = '007_SR'
    ras_num = ras_name[:3]

    # extract the value based on the month numbers (ras_num)
    multiply_val = dct[ras_num]
    print ras_name, ras_num, multiply_val

    # multiply the value with the raster, and save the raster



    # Than I want to execute this equation to calculate one more parameter
    # (e.g for JANUARY : 0.5 + 0.5 * (001_APAR/179.36) ,
    # for FEBRUARY: 0.5 + 0.5*(002_APAR/194.95 (For JANUARY)),
    # and save it to workspace (D:\MODIS-NDVI-2012\ws_out_wscaler)
    ws_out_wscaler = r'D:\MODIS-NDVI-2012\ws_out_wscaler'
    ras_name = '005_APAR'
    ras_num = ras_name[:3]
    divide_val = dct[ras_num]
    
    ras_wscalar = 0.5 + 0.5 * ras_apar / divide_val

    out_name_wscalar = os.path.join(ws_out_wscalar, 'r{0}_WSCALAR'.format(ras_num))
    ras_wscalar.save(out_name_wscalar)



if __name__ == '__main__':
    main()‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Calculate list of raster from two different subfolder using ArcPy

ShouvikJha — Sat, 11 Dec 2021 22:01:37 GMT

Xander Bakker‌. Thank you. I have forget to mentioned one more step, I am extremely sorry for the inconvenience.

Here with i am giving clear picture of the code, kind consider it

def main():
 import arcpy
 import os
 arcpy.env.overwriteOutput = True
 # Checkout extension
 arcpy.CheckOutExtension("Spatial")
 arcpy.env.overwriteOutput = True
 ws_in_mean = r'D:\MODIS-NDVI-2012\MASKED-NDVI-2012A'
 ws_out_Vfraction= r'D:\MODIS-NDVI-2012\VEGETATION_Fraction'
 ws_out_AET= r'D:\MODIS-NDVI-2012\ACTUAL_ET'
 ws_out_Wscalar = r'D:\MODIS-NDVI-2012\W_SCALAR'
# list "mean" rasters
 arcpy.env.workspace = ws_in_mean
 lst_ras_mean = arcpy.ListRasters()
 print "lst_ras_mean", lst_ras_mean
for ras_name in lst_ras_mean:
 ras_mean = arcpy.Raster(os.path.join(ws_in_mean, ras_name))
 print "ras_mean", ras_name

# calculate ((Raster * Min Rater value) * (0.95 * 0.01)) / (Max raster value * Min Raster Value )
 ras_Vfraction = sqrt((ras_mean - ras_mean.minimum) / (ras_mean.maximum - ras_mean.minimum))
 ras_Vfraction.save(out_name_Vfraction)
 # save raster
 ras_num = ras_name[:3]
 out_name_fpar = os.path.join(ws_out_fpar, 'r{0}_Vfraction.TIF'.format(ras_num))
 ras_fpar.save(out_name_vfraction)

# calculate Wscalar raster
 dct = {'001': 179.36, '002': 194.95, '003': 239.44, '004': 289.05,
 '005': 318.66, '006': 272.35, '007': 227.13, '008': 182.76,
 '009': 168.53, '010': 210.87, '011': 176.31, '012': 182.41}

# Next multiplication of monthly Vfraction raster with monthwise dct value
 # and store it to ws_out_AET folder name of 001_AET to 012_AET
      ras_AET = 001_Vfraction * 179.36 (001)


# After that i want to execute this equation to calculate monthly step WScalar
# And save it to ws_out_Wscalar folder name of 001_WScalar‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍
  ras_wscalar = 0.5 + 0.5 * 001_AET / 001_dct Value (179.36)
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Calculate list of raster from two different subfolder using ArcPy

XanderBakker — Tue, 23 Aug 2016 15:08:58 GMT

The code is a little hard to interpret, because it does not have correct indentation. Furthermore on line 22 you save a raster with a name stored in the variable "out_name_Vfraction" and this variable does not exist. When you post code, enter the advanced editor (upper right corner when you add a reply):

Expand the toolbar:

In the expanded toolbar, click more and Syntax highlighter:

Select the language (Python):

Paste you code:

Click OK in the lower part of the screen

And the code will appear with the correct format:

Perhaps it is better if you paste the latest working code and explain the additional steps you want to include and I post back the new code.