topic Re: Write records to csv in Python Questions

Write records to csv

DaveJordan1 — Mon, 28 Nov 2011 12:23:27 GMT

My ultimate goal is to create mailing labels from selected parcel polygons. using the following code I am attempting to write out to a txt file the selected records. It works but I am having issues with the output it is giving me.
1) before each field that contains a string value it is inserting the letter "u".
2) I want to remove the quotes from each field and the brackets.
3) If there is a better way to do this, please let me know

Here is the code followed by a sample of the output
-----------------------------------------------------
import arcpy
from arcpy import env
try:
mxd = arcpy.mapping.MapDocument("Current")
df = arcpy.mapping.ListDataFrames(mxd, "ParcelDF")[0]
Parcels = "parcels"
fc = arcpy.mapping.ListLayers(mxd, Parcels, df)[0]
f = open("Y:\Notification Radius Pkgs\Setup10\Test.txt", 'w')

# Create a search cursor
rows = arcpy.SearchCursor(fc)

# Create a list of fields
fields = arcpy.ListFields(fc, "", "")

# Write the output to a text file
record = [""]
for row in rows:
for field in fields:
if field.type != "Geometry":
#print "%s: Value = %s" % (field.name, row.getValue(field.name))
record.append(row.getValue(field.name))
f.writelines("%s\n" % record)
record = [""]

f.close-------------------------------------------------------------------------
SAMPLE OUTPUT
[' ', 27521, u'24', u'37', u'22', u'01', u'B', u'7', 0, u' ', u' ', 0.59999999999999998]

Re: Write records to csv

JakeSkinner — Sat, 11 Dec 2021 23:55:13 GMT

Hi Dave,

You can do this by iterating through each item in your list. Add the following to your script:

import arcpy
from arcpy import env

mxd = arcpy.mapping.MapDocument("Current")
df = arcpy.mapping.ListDataFrames(mxd, "ParcelDF")[0]
Parcels = "parcels"
fc = arcpy.mapping.ListLayers(mxd, Parcels, df)[0]

f = open("Y:\Notification Radius Pkgs\Setup10\Test.txt", 'w')

rows = arcpy.SearchCursor(fc, "OBJECTID < 5")

fields = arcpy.ListFields(fc)

record = []
for row in rows:
    for field in fields:
        if field.type != "Geometry":
            ##print "%s: Value = %s" % (field.name, row.getValue(field.name))
            record.append(row.getValue(field.name))
            for item in record:
                   f.writelines("%s\n" % item)
            record = []

f.close()
del row, rows

Re: Write records to csv

DaveJordan1 — Mon, 28 Nov 2011 19:10:42 GMT

Thank you for taking time to look at this. Your suggestion does clean up the output, but it prints each field value in the record to a newline. I need each value to be separated by a comma and each record to a newline...

example:
24, 37, 22', 01, B, 7, 0, , , 0.59999999999999998
24, 37, 22', 01, B, 8, 0, , , 0.59999999999999998
24, 37, 22', 01, B, 9, 0, , , 0.59999999999999998

Re: Write records to csv

JakeSkinner — Sat, 11 Dec 2021 23:55:16 GMT

There may be an easier way, but I was able to accomplish this by writing each field to the output text file. Ex:

import arcpy
from arcpy import env

mxd = arcpy.mapping.MapDocument("Current")
df = arcpy.mapping.ListDataFrames(mxd, "ParcelDF")[0]
Parcels = "parcels"
fc = arcpy.mapping.ListLayers(mxd, Parcels, df)[0]

f = open("Y:\Notification Radius Pkgs\Setup10\Test.txt", 'w')

rows = arcpy.SearchCursor(fc)

for row in rows:
            f.write(str(row.getValue("OBJECTID")) + ", " + str(row.getValue("LU_CODE")) + ", " + str(row.getValue("ZONE_CODE")) + "\n")

f.close()
del row, rows

Re: Write records to csv

DaveJordan — Wed, 30 Nov 2011 18:38:26 GMT

Jake,

I've spent the better part of the day trying to get this to work. I keep thinking that I must be missing something. Its failing on the WRITE statement. I've simplified it down to just a single field (OBJECTID) for testing.   Here is the error I am getting:

Running script Test...
Traceback (most recent call last):
File "C:\Dev\ArcGIS10\Python\DaveTest.py", line 44, in <module>
    f.write(str(row.getValue("OBJECTID")) + "\n")
File "C:\Program Files (x86)\ArcGIS\Desktop10.0\arcpy\arcpy\arcobjects\arcobjects.py", line 945, in getValue
    return convertArcObjectToPythonObject(self._arc_object.GetValue(*gp_fixargs(args)))
RuntimeError: ERROR 999999: Error executing function.
ERROR 999999: Error executing function.
Completed script Test...
Failed to execute (Test).

Re: Write records to csv

MathewCoyle — Sat, 11 Dec 2021 23:55:18 GMT

Hi Dave, I tested Jake's script and it works fine for me. Are you using proper syntax/indentation? Is there a field called "OBJECTID"? Do you have write access to that directory on Y-drive? Not sure what would be causing this issue.

Try something simple like

rows = arcpy.SearchCursor("parcels")
for row in rows:
    print row.getValue("OBJECTID")

Then add on line by line until you run into a wall.

Re: Write records to csv

JakeSkinner — Wed, 30 Nov 2011 19:09:42 GMT

Hi Dave,

Feel free to post your entire block of code. Be sure to wrap it in

 tags (using # symbol above) to preserve indentation.

Re: Write records to csv

DaveJordan1 — Sat, 11 Dec 2021 23:55:21 GMT

Here is the entire code:

import arcpy
from arcpy import env
try:
  mxd = arcpy.mapping.MapDocument("Current")
  df = arcpy.mapping.ListDataFrames(mxd, "ParcelDF")[0]
  Parcels = "parcels"
  fc = arcpy.mapping.ListLayers(mxd, Parcels, df)[0]
  f = open("Y:\Notification Radius Pkgs\Setup10\Test.txt", 'w')

  # Create a list of fields
  fields = arcpy.ListFields(fc, "", "")

  # Create a search cursor 
  rows = arcpy.SearchCursor(fc,"","","TOWNSHIP; RANGE; SEC; SUBCODE; BLOCK; LOT","") 


  for row in rows:
        f.write(str(row.getValue("OBJECTID")) + "\n")
# Previous attempts-
#      f.writelines(str(row.getValue("TOWNSHIP")) + ", " + "\n")
#  (row.getValue("TOWNSHIP") + ", " str(row.getValue("RANGE")) + ", " + str(row.getValue("SEC")) + ", " + str(row.getValue("SUBCODE")) + ", " + str(row.getValue("BLOCK")) + ", " + str(row.getValue("LOT")) + "\n")


  f.close()
  del row, rows 

except Exception, e:
  import traceback
  f.close
  map(arcpy.AddError, traceback.format_exc().split("\n"))
  arcpy.AddError(str(e))

Re: Write records to csv

MathewCoyle — Thu, 01 Dec 2011 19:18:03 GMT

Oh, your field limiters are taking out OBJECTID...

rows = arcpy.SearchCursor(fc,"","","TOWNSHIP; RANGE; SEC; SUBCODE; BLOCK; LOT","")

Oh sorry, after testing even that should work, I guess OBJECTID is protected from field limiters. Not sure what your issue is, works fine even with the non raw path and improper indentation.

Re: Write records to csv

DaveJordan1 — Sat, 11 Dec 2021 23:55:23 GMT

Hi Dave, I tested Jake's script and it works fine for me. Are you using proper syntax/indentation? Is there a field called "OBJECTID"? Do you have write access to that directory on Y-drive? Not sure what would be causing this issue.

Try something simple like
rows = arcpy.SearchCursor("parcels")
for row in rows:
    print row.getValue("OBJECTID")
Then add on line by line until you run into a wall.

I tried your sample also. It gives the same 99999 useless error. I believe I am using the proper indentation. Yes there is a field called OBJECTID and yes I have write permission to the directory.

Extra info - I have kept it simple for development purposes, There is only one data frame and one feature class (parcels) in this mxd.
I have successfully written out individual values from fields in the row using - For Field in Fields -

Thanks for helping with this.

Re: Write records to csv

MathewCoyle — Sat, 11 Dec 2021 23:55:26 GMT

If you are failing on this,

rows = arcpy.SearchCursor("parcels")
for row in rows:
    print row.getValue("OBJECTID")

and "parcels" is a valid feature layer with OBJECTID as a field, you have some other environment problems outside of your code. Try rebooting your computer and running it again.

Re: Write records to csv

DaveJordan1 — Thu, 01 Dec 2011 19:35:08 GMT

Oh, your field limiters are taking out OBJECTID...
rows = arcpy.SearchCursor(fc,"","","TOWNSHIP; RANGE; SEC; SUBCODE; BLOCK; LOT","") 
Oh sorry, after testing even that should work, I guess OBJECTID is protected from field limiters. Not sure what your issue is, works fine even with the non raw path and improper indentation.

Yes, I added OBJECTID in and it still fails. I think my next step is to start all over with a clean script...
I 've tried so many different approaches... Is'nt the measure of insanity something like, "One's tendancy to perform the same act over and over again, hoping for different results, regardless of the fact that the results are constant"...or something like that!

Re: Write records to csv

MathewCoyle — Sat, 11 Dec 2021 23:55:29 GMT

That's Einstein's definition yes.

Try to copy and paste this in the ArcMap python window after a reboot.

import arcpy
from arcpy import env
try:
    mxd = arcpy.mapping.MapDocument("Current")
    df = arcpy.mapping.ListDataFrames(mxd, "Layers")[0]
    Parcels = "parcels"
    fc = arcpy.mapping.ListLayers(mxd, Parcels, df)[0]
    f = open(r"Y:\Notification Radius Pkgs\Setup10\Test\Test.txt", 'w')

    # Create a search cursor
    rows = arcpy.SearchCursor(fc)
    for row in rows:
        f.write(str(row.getValue("OBJECTID")) + "\n")

    f.close()
    del row, rows

except Exception, e:
    import traceback
    f.close
    map(arcpy.AddError, traceback.format_exc().split("\n"))
    arcpy.AddError(str(e))

Re: Write records to csv

DaveJordan1 — Fri, 02 Dec 2011 16:45:32 GMT

I figured out the cause, or at least I got past it. The Parcels layer I was working with was Joined to another table. Once I removed the join, it ran as expected. Even though I wasn't referencing any joined fields...

Re: Write records to csv

JakeSkinner — Mon, 05 Dec 2011 12:27:15 GMT

Hi Dave,

When a join exists, the field name will change to 'feature class/table name.field name'. So when calling the fields to write to the text file you would need to specify the parcel feature class name. Ex:

f.write(str(row.getValue("parcels.OBJECTID")) + ", " + str(row.getValue("parcels.LU_CODE")) + ", " + str(row.getValue("parcels.ZONE_CODE")) + "\n")