topic Re: Model Builder to Create Python Script for xls to csv Conversion in ModelBuilder Questions

Model Builder to Create Python Script for xls to csv Conversion

MagdalenaMartinez — Tue, 12 Feb 2019 20:32:55 GMT

I am currently trying to create a python script within model builder to convert an xls file to csv.

I created one already using the "Excel to Table" tool which was successful. However, I tried to add data to the xls file and run the script again and it choked on the "csv already exists". I tried adding "Application.DisplayAlerts = False" to overwrite the csv already existing, but it still choked when I tried to run it again.

My ultimate goal is to create a script I can set up in task scheduler to run on it's own everyday to convert an xls to csv, without using a script that requires macros to be enabled in the xls.

I am at the beginner beginner level when it comes to python script. Any help would be much appreciated!

Re: Model Builder to Create Python Script for xls to csv Conversion

DanPatterson_Retired — Tue, 12 Feb 2019 21:07:33 GMT

You have ruled out just saving the excel file to a csv from within excel? It would actually take less steps.

Re: Model Builder to Create Python Script for xls to csv Conversion

MagdalenaMartinez — Tue, 12 Feb 2019 21:12:04 GMT

I'm trying to have it set to convert itself each day so that a person does not have to manually do it everyday. Is there a way to set this within excel?

Re: Model Builder to Create Python Script for xls to csv Conversion

DanPatterson_Retired — Tue, 12 Feb 2019 23:08:54 GMT

using File Save As would be the excel route, but the person would have to know it.

Perhaps a picture

pick a folder, specify a filename and extension, then click on the dropdown and select CSV.

Not elegant, but beats the Excel to Table tool, then export it out to csv/text format

Re: Model Builder to Create Python Script for xls to csv Conversion

DuncanHornby — Thu, 14 Feb 2019 11:43:59 GMT

Have a look at this tool box on the ESRI Code Sharing website before you invest any more time on this problem...

Re: Model Builder to Create Python Script for xls to csv Conversion

StephenM — Sun, 12 Dec 2021 10:37:12 GMT

To overwrite outputs, set arcpy.env.overwriteOutput = True.

overwriteOutput

(Read and Write)

Controls whether tools will automatically overwrite any existing output when run. When set to True, tools will execute and overwrite the output dataset. When set to False, existing outputs will not be overwritten, and the tool will return an error.

Boolean

env—Help | ArcGIS Desktop

You could do this using Excel To Table to convert the Excel sheet to a table, then Table To Table to convert the table to a CSV.

In my testing the output CSV always had an OID field added to it, so I used the pandas library to drop the OID field.

import arcpy
import pandas as pd

arcpy.env.overwriteOutput = True

# Input Excel file
excel_file = r"C:\Users\Username\Desktop\test_book.xlsx"

# Intermediate converted table
interm_table = r"C:\Users\Username\Documents\ArcGIS\Default.gdb\test_book"

# Convert Excel file to table
arcpy.ExcelToTable_conversion(excel_file, interm_table, "Sheet1")

# Directory and name for the output CSV
output_dir = r"C:\Users\Username\Desktop"
csv_name = "test_book.csv"

# Convert intermediate table to CSV
arcpy.TableToTable_conversion(interm_table, output_dir, csv_name)

# Set full path of the CSV
csv_fullpath = output_dir + "\\" + csv_name

# Read CSV into pandas DataFrame
df = pd.read_csv(csv_fullpath)

# Drop OID column
df.drop('OID', axis=1, inplace=True)

# Write DataFrame to the same CSV as the input
df.to_csv(csv_fullpath, index=False)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

pandas.read_csv — pandas 0.24.1 documentation

pandas.DataFrame.drop — pandas 0.24.1 documentation

pandas.DataFrame.to_csv — pandas 0.24.1 documentation

Re: Model Builder to Create Python Script for xls to csv Conversion

JoeBorgione — Thu, 14 Feb 2019 20:20:38 GMT

Duncan Hornby‌ Can this toolbox and the four tools be used in ArcGIS Pr0 2.3?

Re: Model Builder to Create Python Script for xls to csv Conversion

DuncanHornby — Thu, 14 Feb 2019 21:03:56 GMT

Joe,

Not sure , never tried. If they don't I can't imagine it would take too much editing to get them working?

Re: Model Builder to Create Python Script for xls to csv Conversion

JoeBorgione — Thu, 14 Feb 2019 21:25:56 GMT

I'll download and check it out; I didn't realize those tools were written so long ago; a couple of them are now bundled with the core release.

Re: Model Builder to Create Python Script for xls to csv Conversion

DanPatterson_Retired — Thu, 14 Feb 2019 21:35:27 GMT

Joe

/blogs/dan_patterson/2018/02/12/table-tools-a-set-of-tools-for-working-with-tabular-data description and tools at

https://www.arcgis.com/home/item.html?id=90d9ca933e8c4b96bf341a20ae1f2514

Re: Model Builder to Create Python Script for xls to csv Conversion

JoeBorgione — Thu, 14 Feb 2019 21:39:52 GMT

Beauty!

Re: Model Builder to Create Python Script for xls to csv Conversion

curtvprice — Thu, 21 Feb 2019 09:01:50 GMT

The OP asked about Model Builder. I think pandas is a little more than they were interested in... did you try simply modifying the field map on the Table to Table tool to drop the OID? Seems like that would be less trouble (especially if using Model Builder).

Re: Model Builder to Create Python Script for xls to csv Conversion

StephenM — Thu, 21 Feb 2019 20:04:08 GMT

Yeah, I tried using FieldMappings and also tried using table view FieldInfo. With field mapping, the ObjectID field didn't seem to be accessible using the fields property of the FieldMappings object. With FieldInfo, even if I hid the ObjectID field it still showed up in the output CSV. Hiding fields worked with all the other fields, just not ObjectID.

Re: Model Builder to Create Python Script for xls to csv Conversion

MichaelBruening — Wed, 30 Dec 2020 13:33:45 GMT

Just wanted to say thank you for posting this solution as I was able to use some of the code to help with a similar process of dropping the "OID" field from a CSV file that was exported from the "Table to Table" tool.

Re: Model Builder to Create Python Script for xls to csv Conversion

MesfinLenth17 — Wed, 02 Apr 2025 17:58:10 GMT

Thank you for this resource! The script worked in my case.

But I also tried to export to CSV straight from Model Builder and that seems to be working (I have ArcGIS Pro version 3.3.1).

You can use Export Table (aka Table to Table) geoprocessing tool within your Model Builder. Enter your Input File Path, and for the Output Table, specify the file name or file path ends in .csv (filepath.csv). Finally drop any field using Field Map and schedule your model to run on a needed basis.