Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Cancel
- Home
- :
- About BIJOYGAYEN
BIJOYGAYEN
Emerging Contributor
since
06-03-2018
11-11-2020
72
Posts created
4
Kudos given
0
Solutions
0
Kudos received
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
My Ideas
(0 Idea Submissions)Latest Contributions by BIJOYGAYEN
|
POST
|
Code flow Sir Joshua Bixby if you notice my previous code here initially I define three land type corresponding Geoprocesses 1,2,3 def geoprocess1(base_path,category,file_name,file,land_use):
try:
#land_use='LAND_10'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 10")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] > 0.10 and row[0] < 0.20):
row[5] = land_use
print ("processing_A:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 10 " )
print('Sucess: geoprocess1 complete!')
except Exception as err:
print('Error: unable to complete geoprocess1')
print(err)
def geoprocess2(base_path,category,file_name,file,land_use):
try:
#land_use='LAND_20'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 20")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] >= 0.20 and row[0] < 0.50):
row[5] = land_use
print ("processing_B:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 20 " )
print('Sucess: geoprocess2 complete!')
except Exception as err:
print('Error: unable to complete geoprocess2')
print(err)
def geoprocess3(base_path,category,file_name,file,land_use):
try:
#land_use='LAND_30'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 30")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] >= 0.50):
row[5] = land_use
print ("processing_C:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 30 " ) and it defines into the main function as like this. def main(base_path,category,file_name,file):
geoprocess1(base_path,category,file_name,file,"LAND_10")
geoprocess2(base_path,category,file_name,file,"LAND_20")
geoprocess3(base_path,category,file_name,file,"LAND_30") Further, I use this main function Into the three categories "AAA","BBB","CCC". try:
if __name__ == "__main__":
t1=time.time()
main(base_path,"AAA",file_name,AAA)
main(base_path,"BBB",file_name,BBB)
main(base_path,"CCC",file_name,CCC)
print "serial processing took:",time.time()-t1 Initially, you can make the for loop and conditional statement for different geoprocess(1,2,3) after that I will make another seven geoprocesses.
... View more
06-12-2019
10:47 PM
|
0
|
0
|
1305
|
|
POST
|
Joshua Bixby sir, I am a little bit confused to write your mentioning for loop and conditional statement for different geoprocess(1,2,3). arcpy.MakeFeatureLayer_management(shape,"lyr1")
AAA = arcpy.SelectLayerByAttribute_management("lyr1", "NEW_SELECTION", "\"Name\" = 'AAA'")
print "Successfully Process : Select Layer By Attribute for AAA "
arcpy.MakeFeatureLayer_management(shape,"lyr2")
BBB = arcpy.SelectLayerByAttribute_management("lyr2", "NEW_SELECTION", "\"Name\" = 'BBB'")
print "Successfully Process : Select Layer By Attribute for BBB "
arcpy.MakeFeatureLayer_management(shape,"lyr3")
CCC = arcpy.SelectLayerByAttribute_management("lyr3", "NEW_SELECTION", "\"Name\" = 'CCC'")
print "Successfully Process : Select Layer By Attribute for CCC "
# Writing tables for categories("AAA","BBB,"CCC") and individual category have three Land type
# that will be save in different folder and their individual name
#------------------First we write category "AAA" and their indiviual land type--------------------------------------#
def geoprocess1(base_path,category,file_name,file):
try:
land_use='LAND_10'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 10")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] > 0.10 and row[0] < 0.20):
row[5] = 'landuse_10'
print ("processing_A:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 10 " )
print('Sucess: geoprocess1 complete!')
except Exception as err:
print('Error: unable to complete geoprocess1')
print(err)
def geoprocess2(base_path,category,file_name,file):
try:
land_use='LAND_20'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 20")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] >= 0.20 and row[0] < 0.50):
row[5] = 'landuse_20'
print ("processing_B:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 20 " )
print('Sucess: geoprocess2 complete!')
except Exception as err:
print('Error: unable to complete geoprocess2')
print(err)
def geoprocess3(base_path,category,file_name,file):
try:
land_use='LAND_30'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 30")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] >= 0.50):
row[5] = 'landuse_30'
print ("processing_C:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 30 " )
print('Sucess: geoprocess3 complete!')
except Exception as err:
print('Error: unable to complete geoprocess3')
print(err)
def main(base_path,category,file_name,file):
geoprocess1(base_path,category,file_name,file)
geoprocess2(base_path,category,file_name,file)
geoprocess3(base_path,category,file_name,file)
#category="AAA"
file_name=filename
base_path = r"F:\\DB_test_data\\VAR4\\"
try:
if __name__ == "__main__":
t1=time.time()
main(base_path,"AAA",file_name,AAA)
main(base_path,"BBB",file_name,BBB)
main(base_path,"CCC",file_name,CCC)
print "serial processing took:",time.time()-t1
... View more
06-12-2019
02:15 PM
|
0
|
2
|
1305
|
|
POST
|
Luke Webb sir I am trying to flow your instruction as per your mentioning comments. I seem that geoprocesses 1,2,3 have a different different argument. geoprocess1 have greater than and less than sign if (row[0] > 0.10 and row[0] < 0.20): geoprocess2 have greater than equal and less than sign if (row[0] >= 0.20 and row[0] < 0.50): geoprocess3 have greater than equal sign if (row[0] >= 0.50): That's why we cannot write one single def function for every geoprocess(1 to3) please check this code import datetime
start = datetime.datetime.now()
print 'start run: %s\n' % (start)
import arcpy ,os ,sys,csv,errno
from arcpy import env
from arcpy.sa import *
import datetime
import re
import glob
import itertools
arcpy.env.overwriteOutput = True
import multiprocessing
print("Number of processors: ", multiprocessing.cpu_count())
try:
point_shp=r"F:\\DB_test_data\\VAR4\\VAR4.shp"
[arcpy.AddField_management(point_shp,field_name, "TEXT", field_length = 50)
for field_name in ["Name", "Name2"]]
arcpy.AddMessage("Successfully Added NAME fields ")
fieldss = ['Band1','Name']
with arcpy.da.UpdateCursor(point_shp, fieldss) as cursor:
for row in cursor:
if (row[0] > 0.02 and row[0] < 0.05):
row[1] = 'AAA'
print ("processing1:""{0:.8f}, {1}".format(row[0], row[1]))
elif (row[0] >= 0.05 and row[0] < 0.09):
row[1] = 'BBB'
## print ("processing1:""{0:.8f}, {1}".format(row[0], row[1]))
elif (row[0] >= 0.09):
row[1] = 'CCC'
else:
row[1] = 'NA'
# Update the cursor with the updated list
cursor.updateRow(row)
# Process: Select Layer By Attribute for separate the catagories "AAA","BBB,"CCC"
arcpy.MakeFeatureLayer_management(point_shp,"lyr1")
AAA = arcpy.SelectLayerByAttribute_management("lyr1", "NEW_SELECTION", "\"Name\" = 'AAA'")
print "Successfully Process : Select Layer By Attribute for AAA "
arcpy.MakeFeatureLayer_management(point_shp,"lyr2")
BBB = arcpy.SelectLayerByAttribute_management("lyr2", "NEW_SELECTION", "\"Name\" = 'BBB'")
print "Successfully Process : Select Layer By Attribute for BBB "
arcpy.MakeFeatureLayer_management(point_shp,"lyr3")
CCC = arcpy.SelectLayerByAttribute_management("lyr3", "NEW_SELECTION", "\"Name\" = 'CCC'")
print "Successfully Process : Select Layer By Attribute for CCC "
category="xxx"
file_name="MOD02HKM_2017_01"
base_path = r"F:\\DB_test_data\\VAR4\\"
Input_Data = point_shp
def geoprocess (Input_Data,base_path,category,land_use,tolerance_minimum, tolerance_maximum):
#land_use='LAND_10'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 10")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(Input_Data, fields) as cursor:
for row in cursor:
if (row[0] > tolerance_minimum and row[0] < tolerance_maximum):
row[5] = land_use
print ("processing_A:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 10 " )
print "Code is OK"
except:
print "Error in code"
def main(base_path,category,file_name,file):
geoprocess(base_path,category,file_name,file, 'LAND_10', 0.1, 0.20)
geoprocess(base_path,category,file_name,file, 'LAND_20', 0.20,0.50)
geoprocess(base_path,category,file_name,file, 'LAND_30', 0.50, tolerance_maximum)
try:
if __name__ == '__main__':
t1=time.time()
main(base_path,"AAA",file_name,AAA)
main(base_path,"BBB",file_name,BBB)
main(base_path,"CCC",file_name,CCC)
print "serial processing took:",time.time()-t1
print "serial processing is OK"
except:
print "Error in serial processing"
print arcpy.GetMessages()
print 'finished run: %s\n\n' % (datetime.datetime.now() - start)
... View more
06-12-2019
01:44 PM
|
0
|
0
|
1305
|
|
POST
|
Thank you, sir, for your swift response. I will try to make this conditional loop as per your instruction.
... View more
06-12-2019
11:41 AM
|
0
|
0
|
1305
|
|
POST
|
Thank you Joshua Bixby Sir for sharing your views to clear the concept of Multiprocessing and single processing Function during the analysis of intensive data.
... View more
06-12-2019
11:39 AM
|
0
|
0
|
1494
|
|
POST
|
Thank you so much, sir. That's a great trick. I will manipulate my code as per your instruction. Sir have any way to use the multiprocessing function in the main function(Combine of GeoProcess 1 to 10)?
... View more
06-12-2019
07:24 AM
|
0
|
1
|
1305
|
|
POST
|
Can I assume that my code has no further improvement in this context and I will Write more Ten geoprocess functions? Another thing, there is any option to use the multiprocessing function? Please, sir, give me a final suggestion regarding this code because I am waiting for it. Joshua Bixby Dan PattersonXander Bakker
... View more
06-11-2019
09:25 PM
|
0
|
7
|
1305
|
|
POST
|
First of all, the code does not show any error But when I include the multiprocessing function is not working. In every category ("AAA","BBB","CCC") have Ten landuse_type initially I write three types (geoprocess1 to 3) it needs to write more seven processes then the code will be bigger that's why I need to reduce this code. I previously uploaded my folder structure of one category( "AAA") and their output text file. Dan Patterson
... View more
06-09-2019
10:06 AM
|
0
|
0
|
1685
|
|
POST
|
Here I attach my working flow and folder destination system and output files. I think you will understand what I want to do. import datetime
start = datetime.datetime.now()
print 'start run: %s\n' % (start)
import arcpy ,os ,sys,csv,errno
from arcpy import env
from arcpy.sa import *
import datetime
import re
import glob
import itertools
arcpy.env.overwriteOutput = True
import multiprocessing
print("Number of processors: ", multiprocessing.cpu_count())
cellsize = "F:\\DB_test_data\\TEST_RAY\\TEST1\\MOD02HKM_A2017001_0530_NDVI_AA.img"
d1="F:\\DB_test_data\\VAR2\\cldmask\\tt"
CLDMASK = glob.glob(d1 + os.sep + "*.Aerosol_Cldmask_Land_Ocean-Aerosol_Cldmask_Land_Ocean.tif")
CLDMASK.sort()
if CLDMASK is None:
print 'Could not open the CLDMASK raster files'
sys.exit(1)
else:
print 'The CLDMASK raster files was opened successfully'
#print CLDMASK
d2="F:\\DB_test_data\\TEST_RAY\\TEST1"
NDVI = glob.glob(d2 + os.sep + "*A2017001_0530_NDVI_AA.img")
NDVI.sort()
if NDVI is None:
print 'Could not open the NDVI raster files'
sys.exit(1)
else:
print 'The NDVI raster files was opened successfully'
#print NDVI
d3="F:\\DB_test_data\\VAR2\\IDL\\MOD02HKM\\TEST"
BAND1 = glob.glob(d3 + os.sep + "*A2017001_0530_006_BAND_1.img")
BAND1.sort()
if BAND1 is None:
print 'Could not open the BAND1 raster files'
sys.exit(1)
else:
print 'The BAND1 raster files was opened successfully'
#print BAND1
d4="F:\\DB_test_data\\VAR2\\IDL\\MOD02HKM\\TEST"
BAND2 = glob.glob(d4 + os.sep + "*A2017001_0530_006_BAND_2.img")
BAND2.sort()
if BAND2 is None:
print 'Could not open the BAND2 raster files'
sys.exit(1)
else:
print 'The BAND2 raster files was opened successfully'
#print BAND2
d4="F:\\DB_test_data\\VAR2\\IDL\\MOD09\\TEST"
BAND3 = glob.glob(d4 + os.sep + "*A2017001_0530_006_BAND_3.img")
BAND3.sort()
if BAND3 is None:
print 'Could not open the BAND3 raster files'
sys.exit(1)
else:
print 'The BAND3 raster files was opened successfully'
#print BAND3
d5="F:\\DB_test_data\\VAR2\\IDL\\MOD02HKM\\TEST"
BAND4 = glob.glob(d5 + os.sep + "*A2017001_0530_006_BAND_4.img")
BAND4.sort()
if BAND4 is None:
print 'Could not open the BAND4 raster files'
sys.exit(1)
else:
print 'The BAND4 raster files was opened successfully'
#print BAND4
d6 = r"F:\\DB_test_data\\VAR2\\MOD04_l2"
AOD = glob.glob(d6 + os.sep + "*Corrected_Optical_Depth_Land_2-Corrected_Optical_Depth_Land.tif")
AOD.sort()
if AOD is None:
print 'Could not open the AOD raster files'
sys.exit(1)
else:
print 'The AOD raster files was opened successfully'
Scale_factor = float(0.0010000000474974513)
add_offset = float(0.0)
Fill_value = float(-9999)
outdir="F:\\DB_test_data\\VAR4\\"
for a,b,c,d,e,f,g in zip (CLDMASK ,NDVI ,BAND1 ,BAND2 ,BAND3 ,BAND4,AOD):
print ("processing:"+ a)
arcpy.AddMessage("processing:{}".format(b.split('\\')[4][9:30]))
name = c.split("\\")
filename=name[6][9:33]
print filename
arcpy.AddMessage("processing:{}".format(d.split('\\')[6][9:33]))
arcpy.AddMessage("processing:{}".format(e.split('\\')[6][9:30]))
arcpy.AddMessage("processing:{}".format(f.split('\\')[6][9:33]))
print ("processing:"+ g)
#######################################################################
setnull =arcpy.gp.SetNull_sa(g,g, "in_memory/dat", "\"Value\" = -9999")
ras=arcpy.Raster(setnull)
Data=(ras-add_offset)*Scale_factor
da = Con((Data >= 0.0) & (Data <= 0.1),1)
# Process: Extract by Cloud_Mask
tempEnvironment0 = arcpy.env.cellSize
arcpy.env.cellSize = "MAXOF"
ndvi_msk=arcpy.gp.ExtractByMask_sa(b, a)
Band1_mask=arcpy.gp.ExtractByMask_sa(c, a)
Band2_mask=arcpy.gp.ExtractByMask_sa(d, a)
Band3_mask=arcpy.gp.ExtractByMask_sa(e, a)
Band4_mask=arcpy.gp.ExtractByMask_sa(f, a)
arcpy.env.cellSize = tempEnvironment0
# Process: Extract by Mask using AOD less than 0.1 value
tempEnvironment0 = arcpy.env.cellSize
arcpy.env.cellSize = cellsize
ndvi_msk1=arcpy.gp.ExtractByMask_sa(ndvi_msk, da)
Band1_mask1=arcpy.gp.ExtractByMask_sa(Band1_mask, da)
Band2_mask2=arcpy.gp.ExtractByMask_sa(Band2_mask, da)
Band3_mask3=arcpy.gp.ExtractByMask_sa(Band2_mask, da)
Band4_mask4=arcpy.gp.ExtractByMask_sa(Band2_mask, da)
arcpy.env.cellSize = tempEnvironment0
try:
# Raster to point
field ="VALUE"
Point=arcpy.RasterToPoint_conversion(ndvi_msk1,"in_memory/fileroot",field)
shape=arcpy.sa.ExtractMultiValuesToPoints(Point,[[ndvi_msk1,"NDVI"],[Band1_mask1,"Band1"],[Band2_mask2,"Band2"],
[Band3_mask3 ,"Band3"],[Band4_mask4,"Band4"]], "NONE")
#Add Two Fields Name and Name2
[arcpy.AddField_management(shape,field_name, "TEXT", field_length = 50)
for field_name in ["Name", "Name2"]]
arcpy.AddMessage("Successfully Added NAME fields ")
fieldss = ['Band1','Name']
with arcpy.da.UpdateCursor(shape, fieldss) as cursor:
for row in cursor:
if (row[0] > 0.02 and row[0] < 0.06):
row[1] = 'AAA'
print ("processing1:""{0:.8f}, {1}".format(row[0], row[1]))
elif (row[0] >= 0.06 and row[0] < 0.09):
row[1] = 'BBB'
# print ("processing1:""{0:.8f}, {1}".format(row[0], row[1]))
elif (row[0] >= 0.09):
row[1] = 'CCC'
else:
row[1] = 'NA'
# Update the cursor with the updated list
cursor.updateRow(row)
# Process: Select Layer By Attribute for separate the catagories "AAA","BBB,"CCC"
arcpy.MakeFeatureLayer_management(shape,"lyr1")
AAA = arcpy.SelectLayerByAttribute_management("lyr1", "NEW_SELECTION", "\"Name\" = 'AAA'")
print "Successfully Process : Select Layer By Attribute for AAA "
arcpy.MakeFeatureLayer_management(shape,"lyr2")
BBB = arcpy.SelectLayerByAttribute_management("lyr2", "NEW_SELECTION", "\"Name\" = 'BBB'")
print "Successfully Process : Select Layer By Attribute for BBB "
arcpy.MakeFeatureLayer_management(shape,"lyr3")
CCC = arcpy.SelectLayerByAttribute_management("lyr3", "NEW_SELECTION", "\"Name\" = 'CCC'")
print "Successfully Process : Select Layer By Attribute for CCC "
# Writing tables for categories("AAA","BBB,"CCC") and individual category have three Land type
# that will be save in different folder and their individual name
#------------------First we write category "AAA" and their indiviual land type--------------------------------------#
def geoprocess1(base_path,category,file_name,file):
try:
land_use='LAND_10'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 10")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] > 0.10 and row[0] < 0.20):
row[5] = 'landuse_10'
print ("processing_A:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 10 " )
print('Sucess: geoprocess1 complete!')
except Exception as err:
print('Error: unable to complete geoprocess1')
print(err)
def geoprocess2(base_path,category,file_name,file):
try:
land_use='LAND_20'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 20")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] >= 0.20 and row[0] < 0.50):
row[5] = 'landuse_20'
print ("processing_B:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 20 " )
print('Sucess: geoprocess2 complete!')
except Exception as err:
print('Error: unable to complete geoprocess2')
print(err)
def geoprocess3(base_path,category,file_name,file):
try:
land_use='LAND_30'
outdir = os.path.join(base_path,category,land_use)
if not os.path.exists(outdir):
try:
print('\nCreating new output directory!\n'+outdir+'\n')
os.makedirs(outdir)
except OSError:
print ("Creation of the directory failed" )
else:
print ("Successfully created the directory" )
ras_name = os.path.join(outdir,("{0}_{1}{2}_{3}".format(category,file_name,land_use,".txt")))
fields = ['grid_code', 'Band1', 'Band2','Band3','Name',"Name2"]
with open(ras_name, 'wb') as txtfile:
arcpy.AddMessage("fields Writing For landuse 30")
txtfile.write(" {0} {1} {2} {3} {4} {5}\n".format(fields[0],fields[1],fields[2],fields[3],fields[4],fields[5]))
with arcpy.da.UpdateCursor(file, fields) as cursor:
for row in cursor:
if (row[0] >= 0.50):
row[5] = 'landuse_30'
print ("processing_C:""{0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.write(" {0:.8f} {1:.8f} {2:.8f} {3:.8f} {4} {5}\n".format(row[0],row[1],row[2], row[3],row[4],row[5]))
txtfile.close()
print ("Successfully save the landuse 30 " )
print('Sucess: geoprocess3 complete!')
except Exception as err:
print('Error: unable to complete geoprocess3')
print(err)
def main(base_path,category,file_name,file):
geoprocess1(base_path,category,file_name,file)
geoprocess2(base_path,category,file_name,file)
geoprocess3(base_path,category,file_name,file)
#category="AAA"
file_name=filename
base_path = r"F:\\DB_test_data\\VAR4\\"
if __name__ == "__main__":
#category="AAA"
file_name="MOD022"
base_path = r"F:\\DB_test_data\\VAR4\\"
try:
t1=time.time()
main(base_path,"AAA",file_name,AAA)
main(base_path,"BBB",file_name,BBB)
main(base_path,"CCC",file_name,CCC)
print "serial processing took:",time.time()-t1
print "serial processing is OK"
except Exception as e:
print "Error in serial processing"
print(err)
try:
t2=time.time()
pool = multiprocessing.Pool(processes=4)
A=pool.map(main,(base_path,"AAA",file_name,AAA))
B=pool.map(main,(base_path,"BBB",file_name,BBB))
C=pool.map(main,(base_path,"CCC",file_name,CCC))
A.close()
B.close()
C.close()
A.join()
B.join()
C.join()
print "Pool took",time.time()-t2
print "multiprocessing is OK"
except Exception as e:
print "Error in multiprocessing "
#print(err)
print arcpy.GetMessages()
print 'finished run: %s\n\n' % (datetime.datetime.now() - start)
... View more
06-08-2019
11:00 AM
|
0
|
1
|
1685
|
|
POST
|
Base on my previous code I am trying to used multiprocessing function but is not working. please check this issue and give me a suggestion to resolve this issue. Joshua Bixby Xander BakkerDan Patterson if __name__ == "__main__":
category="AAA"
file_name="MOD022"
base_path = r"F:\\DB_test_data\\VAR4\\"
try:
t1=time.time()
main(base_path,category,file_name,AAA)
print "serial processing took:",time.time()-t1
print "serial processing is OK"
except Exception as e:
print "Error in serial processing"
print(err)
try:
t2=time.time()
pool = multiprocessing.Pool(processes=4)
A=pool.map(main,(base_path,"AAA",file_name,AAA))
B=pool.map(main,(base_path,"BBB",file_name,BBB))
C=pool.map(main,(base_path,"CCC",file_name,CCC))
A.close()
B.close()
C.close()
A.join()
B.join()
C.join()
print "Pool took",time.time()-t2
print "multiprocessing is OK"
except Exception as e:
print "Error in multiprocessing "
#print(err)
... View more
06-08-2019
06:24 AM
|
0
|
1
|
1685
|
|
POST
|
How do I configure my code with multiprocessing and multithreading?
... View more
06-07-2019
11:09 AM
|
0
|
0
|
1685
|
|
POST
|
What is your final suggestion for my code? Please, sir, refer me any who can resolve this matter.
... View more
06-07-2019
07:15 AM
|
0
|
1
|
1685
|
Activity Feed
- Posted Re: Raster Data analysis with trigonometry function in arcpy. Giving Attribute Error: 'Raster' on Python Questions. 07-25-2019 12:56 PM
- Posted Re: Raster Data analysis with trigonometry function in arcpy. Giving Attribute Error: 'Raster' on Python Questions. 07-24-2019 10:39 AM
- Posted Re: Raster Data analysis with trigonometry function in arcpy. Giving Attribute Error: 'Raster' on Python Questions. 07-23-2019 10:44 AM
- Posted Raster Data analysis with trigonometry function in arcpy. Giving Attribute Error: 'Raster' on Python Questions. 07-23-2019 10:03 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 07-14-2019 08:36 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 07-05-2019 01:07 PM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 07-04-2019 12:27 PM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 07-03-2019 11:06 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 07-02-2019 06:49 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-29-2019 09:43 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-28-2019 01:11 PM
- Kudoed Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function for JoeBorgione. 06-28-2019 12:52 PM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-28-2019 12:10 PM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-28-2019 11:53 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-27-2019 01:33 PM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-27-2019 01:20 PM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-27-2019 06:56 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-26-2019 10:34 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-26-2019 07:11 AM
- Posted Re: RuntimeError: ERROR 999998: Unexpected Error in Set null function on Python Questions. 06-23-2019 10:49 AM
Contact Me
| Online Status |
Offline
|
| Date Last Visited |
11-11-2020
02:24 AM
|