topic Re: Batch process to Clip Raster by Polygon in Python Questions

Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 13:37:48 GMT

I'm not a python script writer thus the question. What's needed is a script that will do the following:

Run a definition query for each record in a polygon shapefile called "LineBuf.shp" on an attribute field named "LINENUM". (There are 441 unique records).
For each unique polygon, run a raster clip on "MN_DEM3second", the raster dataset. The option to "Use Input Features for Clipping Geometry" should be selected.
The file name of the resultant raster layer (in ESRI grid format) for each record should be the value of "LINENUM" (from the original definition query).
The script should create 441 raster layers.

Re: Batch process to Clip Raster by Polygon

JakeSkinner — Sat, 11 Dec 2021 11:08:18 GMT

Try the following:

import arcpy
arcpy.env.overwriteOutput = 1

shapefile = r"C:\temp\LineBuf.shp"
raster = r"C:\temp\MN_DEM3second"

with arcpy.da.SearchCursor(shapefile, "LINENUM") as cursor:
    for row in cursor:
        print("Creating Feature Layer for " + str(row[0]))
        arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LINENUM = " + row[0])
        print("Clipping raster")
        arcpy.Clip_management(raster, "", r"C:\temp\DEM_" + str(row[0]), "", "fLayer", "MAINTAIN_EXTENT")

del cursor‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 14:21:40 GMT

Jake,

Many thanks for script but I get the following error message. Note that I changed the folder paths to the shapefile and raster inputs. The field "LineNum" is a text field if that is an issue.

>>> import arcpy

arcpy.env.overwriteOutput = 1

shapefile = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\LineBuf.shp"

raster = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\MN_DEM3second"

with arcpy.da.SearchCursor(shapefile, "LineNum") as cursor:

for row in cursor:

print("Creating Feature Layer for " + str(row[0]))

arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LineNum = " + row[0])

print("Clipping raster")

arcpy.Clip_management(raster, "", r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\DEM_" + str(row[0]), "", "fLayer", "MAINTAIN_EXTENT")

del cursor

Creating Feature Layer for 0517

Runtime error Traceback (most recent call last): File "<string>", line 10, in <module> File "c:\program files (x86)\arcgis\desktop10.3\arcpy\arcpy\management.py", line 6520, in MakeFeatureLayer raise e ExecuteError: ERROR 000358: Invalid expression LineNum = 0517 Failed to execute (MakeFeatureLayer).

>>>

Re: Batch process to Clip Raster by Polygon

DanPatterson_Retired — Fri, 24 Aug 2018 14:31:10 GMT

exp = "LineNum = {}".format(roww[0])

arcpy.MakeFeatureLayer_management(shapefile, "fLayer", exp)

maybe?

For reference

/blogs/dan_patterson/2016/08/14/script-formatting

since you have no line numbers

Re: Batch process to Clip Raster by Polygon

JakeSkinner — Sat, 11 Dec 2021 11:08:21 GMT

You can replace the following line:

arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LINENUM = " + row[0])

with

arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LINENUM = '" + row[0] + "'")

Or Dan Patterson's approach (he was missing single quotes around the {}:

exp = "LineNum = '{}'".format(row[0])
arcpy.MakeFeatureLayer_management(shapefile, "fLayer", exp)

Re: Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 14:49:38 GMT

Thanks, Jake and Dan but now I'm getting this message:

Runtime error Traceback (most recent call last): File "<string>", line 12, in <module> File "c:\program files (x86)\arcgis\desktop10.3\arcpy\arcpy\management.py", line 13594, in Clip raise e ExecuteError: ERROR 000622: Failed to execute (Clip). Parameters are not valid. ERROR 000800: The value is not a member of ClippingGeometry | NONE.

>>>

Probably something easy with the ClippingGeometry arguments?

Jim

Re: Batch process to Clip Raster by Polygon

JakeSkinner — Sat, 11 Dec 2021 11:08:23 GMT

Looks like the raster extent is needed. Try the following:

import arcpy
arcpy.env.overwriteOutput = 1

shapefile = r"C:\temp\LineBuf.shp"
raster = r"C:\temp\MN_DEM3second"
desc = arcpy.Describe(raster)
extent = str(desc.extent.XMin) + " " + str(desc.extent.YMin) + " " + str(desc.extent.XMax) + " " + str(desc.extent.YMax)

with arcpy.da.SearchCursor(shapefile, "LINENUM") as cursor:
    for row in cursor:
        print("Creating Feature Layer for " + str(row[0]))
        arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LINENUM = '" + row[0] + "'")
        print("Clipping raster")
        arcpy.Clip_management(raster, extent, r"C:\temp\DEM_" + str(row[0]), "", "fLayer", "MAINTAIN_EXTENT")

del cursor‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 15:15:00 GMT

Getting this message now:

Runtime error Traceback (most recent call last): File "<string>", line 14, in <module> File "c:\program files (x86)\arcgis\desktop10.3\arcpy\arcpy\management.py", line 13594, in Clip raise e ExecuteError: ERROR 000622: Failed to execute (Clip). Parameters are not valid. ERROR 000800: The value is not a member of ClippingGeometry | NONE.

Re: Batch process to Clip Raster by Polygon

JimFritz — Sat, 11 Dec 2021 11:08:26 GMT

import arcpy
arcpy.env.overwriteOutput = 1

shapefile = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\LineBuf.shp"
raster = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\MN_DEM3second"
desc = arcpy.Describe(raster)
extent = str(desc.extent.XMin) + " " + str(desc.extent.YMin) + " " + str(desc.extent.XMax) + " " + str(desc.extent.YMax)

with arcpy.da.SearchCursor(shapefile, "LineNum") as cursor:
    for row in cursor:
        print("Creating Feature Layer for " + str(row[0]))
        arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LINENUM = '" + row[0] + "'")
        print("Clipping raster")
        arcpy.Clip_management(raster, "", r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\DEM_" + str(row[0]), "", "fLayer", "MAINTAIN_EXTENT")

del cursor‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Batch process to Clip Raster by Polygon

JakeSkinner — Fri, 24 Aug 2018 15:25:04 GMT

You're missing the 'extent' variable in the arcpy.Clip_management function. You should have:

arcpy.Clip_management(raster, extent, r"S:\Gen......

Re: Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 15:35:20 GMT

OK thanks but still getting an error (for some reason I can't post in Python format):

>>> import arcpy

arcpy.env.overwriteOutput = 1

shapefile = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\LineBuf.shp"

raster = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\MN_DEM3second"

desc = arcpy.Describe(raster)

extent = str(desc.extent.XMin) + " " + str(desc.extent.YMin) + " " + str(desc.extent.XMax) + " " + str(desc.extent.YMax)

with arcpy.da.SearchCursor(shapefile, "LineNum") as cursor:

for row in cursor:

print("Creating Feature Layer for " + str(row[0]))

arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LINENUM = '" + row[0] + "'")

print("Clipping raster")

arcpy.Clip_management(raster, extent, r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\DEM_" + str(row[0]), "", "fLayer", "MAINTAIN_EXTENT")

del cursor

Creating Feature Layer for 0517

Clipping raster

>>>

Re: Batch process to Clip Raster by Polygon

JakeSkinner — Sat, 11 Dec 2021 11:08:29 GMT

I believe I had some parameters incorrect, and we should be getting the extent of the shapefile, not the raster. Try:

with arcpy.da.SearchCursor(shapefile, "LINENUM") as cursor:
    for row in cursor:
        print("Creating Feature Layer for " + str(row[0]))
        arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LINENUM = '" + row[0] + "'")
        desc = arcpy.Describe("fLayer")
        extent = str(desc.extent.XMin) + " " + str(desc.extent.YMin) + " " + str(desc.extent.XMax) + " " + str(desc.extent.YMax)
        print("Clipping raster")
        arcpy.Clip_management(raster, extent, r"C:\temp\DEM_" + str(row[0]), "fLayer", "", "ClippingGeometry", "MAINTAIN_EXTENT")
del cursor‍‍‍‍‍‍‍‍‍

Re: Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 15:48:15 GMT

This could be a projection issue, bad me. I'm going to project the polygon layer to geographic to match the DEM. I'll try running the script again after the fix.

Re: Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 16:01:49 GMT

Re-running right now and no issues so far. I'll keep you posted.

Many thanks, Jake and Dan!

Re: Batch process to Clip Raster by Polygon

JimFritz — Fri, 24 Aug 2018 17:46:20 GMT

Hi Jake,

I just wanted to thank you again for the script. However, I am still waiting for the first raster to be clipped and was wondering if you had any idea on why it might be taking so long. When I do the processing interactively (on just one query) the clip takes less than a couple minutes to process.

Any ideas?

Thanks,

Jim Fritz, GISP

Xcel Energy | Responsible By Nature

Sr. Geospatial Analyst

414 Nicollet Mall, 6th Floor, Minneapolis, MN 55401

P: 612.330.6956 C: 781.588.5829 F: 612.330.6590

E: james.w.fritz@xcelenergy.com<mailto:james.w.fritz@xcelenergy.com>

Re: Batch process to Clip Raster by Polygon

JimFritz — Sat, 11 Dec 2021 11:08:31 GMT

After running the script over the weekend no clipped rasters were created. The script showed each polygon being created (selected?) and a clip created. Unfortunately, when I checked the grid folder there were none there.

Any ideas??

Thanks,

Jim

import arcpy
arcpy.env.overwriteOutput = 1

shapefile = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\STLM_NSP.gdb\LineBuf_geo"
raster = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\MN_DEM3second"

with arcpy.da.SearchCursor(shapefile, "LineNum") as cursor:
    for row in cursor:
        print("Creating Feature Layer for " + str(row[0]))
        arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LineNum = '" + row[0] + "'")
        desc = arcpy.Describe("fLayer")
        extent = str(desc.extent.XMin) + " " + str(desc.extent.YMin) + " " + str(desc.extent.XMax) + " " + str(desc.extent.YMax)
        print("Clipping raster")
        arcpy.Clip_management(raster, extent, r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\clips\DEM_" + str(row[0]), "fLayer", "", "ClippingGeometry", "MAINTAIN_EXTENT")
del cursor1‍2‍3‍4‍5‍6‍7‍8‍9‍10‍11‍12‍13‍14‍15‍
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Batch process to Clip Raster by Polygon

JakeSkinner — Sat, 11 Dec 2021 11:08:34 GMT

Try changing the output type to a TIF to see if that changes anything:

import arcpy
arcpy.env.overwriteOutput = 1

shapefile = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\STLM_NSP.gdb\LineBuf_geo"
raster = r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\MN_DEM3second"

with arcpy.da.SearchCursor(shapefile, "LineNum") as cursor:
    for row in cursor:
        print("Creating Feature Layer for " + str(row[0]))
        arcpy.MakeFeatureLayer_management(shapefile, "fLayer", "LineNum = '" + row[0] + "'")
        desc = arcpy.Describe("fLayer")
        extent = str(desc.extent.XMin) + " " + str(desc.extent.YMin) + " " + str(desc.extent.XMax) + " " + str(desc.extent.YMax)
        print("Clipping raster")
        arcpy.Clip_management(raster, extent, r"S:\General-Offices-GO-Trans\SLR-Mapping\GIS_Projects_2018\Smart_T_Line_Model\geodata\clips\DEM_" + str(row[0]) + ".tif", "fLayer", "", "ClippingGeometry", "MAINTAIN_EXTENT")
del cursor‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Batch process to Clip Raster by Polygon

JimFritz — Mon, 27 Aug 2018 18:16:09 GMT

Hi Jake,

I tried re-running with outputs to tif format. Unfortunately, the script seems to run fine but no tif files are appearing in the “clips” subfolder.

Kind of strange.

Here’s what a file should look like spatially, created interactively.

Thanks for helping out.

Jim Fritz, GISP

Xcel Energy | Responsible By Nature

Sr. Geospatial Analyst

414 Nicollet Mall, 6th Floor, Minneapolis, MN 55401

P: 612.330.6956 C: 781.588.5829 F: 612.330.6590

E: james.w.fritz@xcelenergy.com<mailto:james.w.fritz@xcelenergy.com>

Re: Batch process to Clip Raster by Polygon

JakeSkinner — Tue, 28 Aug 2018 13:23:47 GMT

Attached is some sample data you can test with. I was able to get this to work with the script you posted previously. One other thing to try is to write everything to your local C drive.

Re: Batch process to Clip Raster by Polygon

JimFritz — Tue, 28 Aug 2018 13:49:48 GMT

Hi Jake,

The zip file did not have a clipping polygon shapefile. Did you intend to send that?

Thanks,

Jim