arcpy toolbox- import csv table and join to shapefile

OliverCoudert

Hello,

How do you import a csv file, add fields to it, and join it with a shapefile?  Attached is the failing code I've got so far.  I can successfully join the table and the shapefile manually through the GUI, so the datafiles are good.  However, i am unable to recreated this with a Toolbox script.  I have been unable import the table, much less add fields and join it with a shapefile.

I'm new to ArcGIS.    I have found some code snippets, but nothing that seems to work.  

Thanks

goPuree.pyt.zip

LanceCole

Try this to see if works from a new map.  Took a few guesses as to what you need in a couple of places.  Code is not tested as I am traveling at the moment.  Code can also be substantially reduced but did not want to re-write your code entirely.  Assume you have more planed as you created fields but did not do anything with them.

You really do not need to add the table and feature class to the Map but I left it as you had it.  You can do all the data manipulation in the GDB or even in memory only saving the final product.  Once the script runs, look at the default database for the project to see the location of the table and feature class.

<SPAN class="keyword token">import</SPAN> arcpy<SPAN class="punctuation token">,</SPAN> os

<SPAN class="keyword token">class</SPAN> <SPAN class="token class-name">Toolbox</SPAN><SPAN class="punctuation token">(</SPAN>object<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
    <SPAN class="keyword token">def</SPAN> <SPAN class="token function">__init__</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
        <SPAN class="string token">"""Define the toolbox (the name of the toolbox is the name of the
        .pyt file)."""</SPAN>
        self<SPAN class="punctuation token">.</SPAN>label <SPAN class="operator token">=</SPAN>  <SPAN class="string token">'actionPuree'</SPAN>
        self<SPAN class="punctuation token">.</SPAN>alias  <SPAN class="operator token">=</SPAN> <SPAN class="string token">'actionPureeToolBox'</SPAN>

        <SPAN class="comment token"># List of tool classes associated with this toolbox</SPAN>
        self<SPAN class="punctuation token">.</SPAN>tools <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN>grindMixPuree<SPAN class="punctuation token">]</SPAN>


<SPAN class="keyword token">class</SPAN> <SPAN class="token class-name">grindMixPuree</SPAN><SPAN class="punctuation token">(</SPAN>object<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
    <SPAN class="keyword token">def</SPAN> <SPAN class="token function">__init__</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
        <SPAN class="string token">"""Define the tool (tool name is the name of the class)."""</SPAN>
        self<SPAN class="punctuation token">.</SPAN>label       <SPAN class="operator token">=</SPAN> <SPAN class="string token">'grindMixPuree'</SPAN>
        self<SPAN class="punctuation token">.</SPAN>description <SPAN class="operator token">=</SPAN> <SPAN class="string token">'Slices, dices, juliannes '</SPAN> <SPAN class="operator token">+</SPAN> \
                           <SPAN class="string token">'purees during the matinee '</SPAN> <SPAN class="operator token">+</SPAN> \
                           <SPAN class="string token">'and ready to serve'</SPAN>
        self<SPAN class="punctuation token">.</SPAN>canRunInBackground <SPAN class="operator token">=</SPAN> <SPAN class="token boolean">False</SPAN>

    <SPAN class="keyword token">def</SPAN> <SPAN class="token function">getParameterInfo</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
        <SPAN class="string token">"""Define parameter definitions"""</SPAN>
        parameters <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">]</SPAN>
        
        <SPAN class="comment token"># Reference States layer</SPAN>
        baseStatesLayer <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>Parameter<SPAN class="punctuation token">(</SPAN>
            displayName<SPAN class="operator token">=</SPAN><SPAN class="string token">"Base States Layer"</SPAN><SPAN class="punctuation token">,</SPAN>
            name<SPAN class="operator token">=</SPAN><SPAN class="string token">"baseStatesLayer"</SPAN><SPAN class="punctuation token">,</SPAN>
            <SPAN class="comment token"># You will need "DEShapefile" here as your input is a shapefile,</SPAN>
            datatype<SPAN class="operator token">=</SPAN><SPAN class="string token">"DEShapefile"</SPAN><SPAN class="punctuation token">,</SPAN> 
            parameterType<SPAN class="operator token">=</SPAN><SPAN class="string token">"Required"</SPAN><SPAN class="punctuation token">,</SPAN>
            direction<SPAN class="operator token">=</SPAN><SPAN class="string token">"Input"</SPAN><SPAN class="punctuation token">)</SPAN>
        parameters<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>baseStatesLayer<SPAN class="punctuation token">)</SPAN>
        
        <SPAN class="comment token"># Data dump CSV file</SPAN>
        inputDataDumpFile <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>Parameter<SPAN class="punctuation token">(</SPAN>
            displayName<SPAN class="operator token">=</SPAN><SPAN class="string token">"Data Dump File"</SPAN><SPAN class="punctuation token">,</SPAN>
            name<SPAN class="operator token">=</SPAN><SPAN class="string token">"inputDataDumpFile"</SPAN><SPAN class="punctuation token">,</SPAN>
            <SPAN class="comment token"># You will need "DEFile" here as a CSV is a file,</SPAN>
            datatype<SPAN class="operator token">=</SPAN><SPAN class="string token">"DEFile"</SPAN><SPAN class="punctuation token">,</SPAN>
            parameterType<SPAN class="operator token">=</SPAN><SPAN class="string token">"Required"</SPAN><SPAN class="punctuation token">,</SPAN>
            direction<SPAN class="operator token">=</SPAN><SPAN class="string token">"Input"</SPAN><SPAN class="punctuation token">)</SPAN>
        parameters<SPAN class="punctuation token">.</SPAN>append<SPAN class="punctuation token">(</SPAN>inputDataDumpFile<SPAN class="punctuation token">)</SPAN>
        
        <SPAN class="keyword token">return</SPAN> parameters

    <SPAN class="keyword token">def</SPAN> <SPAN class="token function">isLicensed</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
        <SPAN class="string token">"""Set whether tool is licensed to execute."""</SPAN>
        <SPAN class="keyword token">return</SPAN> <SPAN class="token boolean">True</SPAN>

    <SPAN class="keyword token">def</SPAN> <SPAN class="token function">updateParameters</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">,</SPAN> parameters<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
        <SPAN class="string token">"""Modify the values and properties of parameters before internal
        validation is performed.  This method is called whenever a parameter
        has been changed."""</SPAN>
        <SPAN class="keyword token">return</SPAN>

    <SPAN class="keyword token">def</SPAN> <SPAN class="token function">updateMessages</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">,</SPAN> parameters<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
        <SPAN class="string token">"""Modify the messages created by internal validation for each tool
        parameter.  This method is called after internal validation."""</SPAN>
        <SPAN class="keyword token">return</SPAN>

    <SPAN class="keyword token">def</SPAN> <SPAN class="token function">execute</SPAN><SPAN class="punctuation token">(</SPAN>self<SPAN class="punctuation token">,</SPAN> parameters<SPAN class="punctuation token">,</SPAN> messages<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">:</SPAN>
        <SPAN class="string token">"""The source code of the tool."""</SPAN>
        
	<SPAN class="comment token"># Get and set current project and geodatabase info</SPAN>
        arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>overwriteOutput <SPAN class="operator token">=</SPAN> <SPAN class="token boolean">True</SPAN>
        aprx <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>mp<SPAN class="punctuation token">.</SPAN>ArcGISProject<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'CURRENT'</SPAN><SPAN class="punctuation token">)</SPAN>
        defaultGeoDb <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>env<SPAN class="punctuation token">.</SPAN>workspace
        aprx<SPAN class="punctuation token">.</SPAN>defaultGeodatabase <SPAN class="operator token">=</SPAN> defaultGeoDb
        currentMap <SPAN class="operator token">=</SPAN> aprx<SPAN class="punctuation token">.</SPAN>activeMap
        
        <SPAN class="comment token">#Create target names based on name of input table (assuming you want the CSV filename)</SPAN>
        tempStr <SPAN class="operator token">=</SPAN> os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>splitext<SPAN class="punctuation token">(</SPAN>os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>basename<SPAN class="punctuation token">(</SPAN>parameters<SPAN class="punctuation token">[</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">.</SPAN>valueAsText<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN>
        newMapName<SPAN class="operator token">=</SPAN> <SPAN class="string token">'lyr_'</SPAN> <SPAN class="operator token">+</SPAN> tempStr
        newTableName <SPAN class="operator token">=</SPAN> <SPAN class="string token">'tbl_'</SPAN> <SPAN class="operator token">+</SPAN> tempStr
        
        <SPAN class="comment token"># convert CSV data into table and add to default database - look in database to see it was added</SPAN>
        arcpy<SPAN class="punctuation token">.</SPAN>TableToTable_conversion<SPAN class="punctuation token">(</SPAN>parameters<SPAN class="punctuation token">[</SPAN><SPAN class="number token">1</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">.</SPAN>valueAsText<SPAN class="punctuation token">,</SPAN>defaultGeoDb<SPAN class="punctuation token">,</SPAN>newTableName<SPAN class="punctuation token">)</SPAN>
        
        <SPAN class="comment token"># Add fields to the new table</SPAN>
        arcpy<SPAN class="punctuation token">.</SPAN>AddField_management<SPAN class="punctuation token">(</SPAN>newTableName<SPAN class="punctuation token">,</SPAN><SPAN class="string token">'Calc01Perc'</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="string token">'DOUBLE'</SPAN><SPAN class="punctuation token">)</SPAN>
        arcpy<SPAN class="punctuation token">.</SPAN>AddField_management<SPAN class="punctuation token">(</SPAN>newTableName<SPAN class="punctuation token">,</SPAN><SPAN class="string token">'Calc02'</SPAN><SPAN class="punctuation token">,</SPAN><SPAN class="string token">'DOUBLE'</SPAN><SPAN class="punctuation token">)</SPAN>
        
        <SPAN class="comment token"># Add table to current Map - not really needed.  Use full path name to table in GDB</SPAN>
        currentMap<SPAN class="punctuation token">.</SPAN>addDataFromPath<SPAN class="punctuation token">(</SPAN>os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>defaultGeoDb<SPAN class="punctuation token">,</SPAN> newTableName<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>

        <SPAN class="comment token">#Join table with shapefile</SPAN>
        newJoinLayer <SPAN class="operator token">=</SPAN> arcpy<SPAN class="punctuation token">.</SPAN>management<SPAN class="punctuation token">.</SPAN>AddJoin<SPAN class="punctuation token">(</SPAN>parameters<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">.</SPAN>valueAsText<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'STUSPS'</SPAN><SPAN class="punctuation token">,</SPAN> newTableName<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'Abbr'</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">'KEEP_ALL'</SPAN><SPAN class="punctuation token">)</SPAN>

        <SPAN class="comment token"># Copy the shaperfile with join to a new permanent feature class in GDB - join will not be needed after</SPAN>
        arcpy<SPAN class="punctuation token">.</SPAN>CopyFeatures_management<SPAN class="punctuation token">(</SPAN>newJoinLayer<SPAN class="punctuation token">,</SPAN> newMapName<SPAN class="punctuation token">)</SPAN>

	<SPAN class="comment token"># Add new feature class to Map - full path need to FC in database</SPAN>
        currentMap<SPAN class="punctuation token">.</SPAN>addDataFromPath<SPAN class="punctuation token">(</SPAN>os<SPAN class="punctuation token">.</SPAN>path<SPAN class="punctuation token">.</SPAN>join<SPAN class="punctuation token">(</SPAN>defaultGeoDb<SPAN class="punctuation token">,</SPAN> newMapName<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">)</SPAN>

        <SPAN class="keyword token">return</SPAN>
<SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>