topic Re: Python Performance Vs Model or Manually in Python Questions

Python Performance Vs Model or Manually

TerryScott — Tue, 26 Nov 2013 13:23:29 GMT

Hi I'm new to ARCGIS and Python and I've written several python scripts to automate some of the regular nightly data extraction.    This very simply script takes 2-3 hours to run when I can manually accomplish the same task in 2-3 minutes or in a model I built in 12 minutes.

I am simply trying to open a text file and save it as a Shape file. the text file has Civic Address coordinates in it.     I created a model and it ran in 12 minutes so I exported it to a python script so I could schedule the task.    It now takes 2-3 hours to run.

Here's the code.   any ideas why it is taking this long.   I compared it in a 32 bit and 64 bit environment.

[INDENT][INDENT]import arcpy
from arcpy import env

##   create Ca_Points.

arcpy.env.overwriteOutput= True

env.workspace = "c:\\geolinc"


env.workspace = "n:\\tel_update"

arcpy.MakeXYEventLayer_management("master_ca.txt", "X_COORD", "Y_COORD", "ca_points","",)
arcpy.FeatureClassToShapefile_conversion(["ca_points"], "c:\\geolinc")[/INDENT][/INDENT]

Re: Python Performance Vs Model or Manually

SachinKanaujia — Tue, 26 Nov 2013 14:24:08 GMT

What is N: drive? Is it a local drive or a mapped network location?

env.workspace = "n:\\tel_update"

I wanted to understand the complete scenario? How many records are there is your text file and you were able to run the complete process including conversion to shapefile manually in couple of seconds?

Re: Python Performance Vs Model or Manually

TerryScott — Tue, 26 Nov 2013 14:46:26 GMT

Hi There is 71,000 records with about 25 fields.    Not a huge dataset by any means.

N:\tel_update is a network path to the file.   I've tried it locally with not much of a difference.

If I run the complete scenario in ARCMAP manually it takes about a minute.   I'm just importing X/Y data then exporting it as a shapefile.

thanks

Re: Python Performance Vs Model or Manually

SachinKanaujia — Tue, 26 Nov 2013 19:21:07 GMT

Can you try this? Also in the script add a Coordinate Reference system when creating points based on the points you have in your text file. I am assuming that its in WGS84?

import arcpy
from arcpy import env

## create Ca_Points.

arcpy.env.overwriteOutput= True
env.workspace = "c:\\geolinc"

# Process: Make XY Event Layer
arcpy.MakeXYEventLayer_management("master_ca.txt", "X_COORD", "Y_COORD", "ca_points", "GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.257223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]];-400 -400 1000000000;-100000 10000;-100000 10000;8.98315284119522E-09;0.001;0.001;IsHighPrecision", "")

# Process: Copy Features
arcpy.CopyFeatures_management("ca_points", "capoints_output.shp")

Re: Python Performance Vs Model or Manually

BillRose — Mon, 12 Jan 2015 17:45:04 GMT

Did you ever solve this?