How to update Feature Layer contents from a Spatially Enabled Dataframe?

MatthewThompson

Hi all. Sorry, I'm relatively new to all of this and wanted to ask what the easiest way to accomplish this would be. Below is an example of the code I am working with:

import pandas as pd
from arcgis.gis import GIS
gis = GIS(ServerURL, username, password, verify_cert=False)
df1 = pd.DataFrame([["foo", -90.0, 30.0], ["bar", -91.0, 31.0]], columns = ["ID", "Longitude", "Latitude"])
df1SEDF = df1.spatial.from_xy(df1, "Longitude", "Latitude")
dataFrameLayer = df1SEDF.spatial.to_featurelayer("DataFrame to a layer", gis)
# df1SEDF is published to the server

df2 = pd.DataFrame([["foo", -90.0, 30.0], ["fighter", -93.0, 33.0]], columns = ["ID", "Longitude", "Latitude"])
df2SEDF = df1.spatial.from_xy(df2, "Longitude", "Latitude")

The first six lines of code runs fine, takes the two points in the dataframe and adds them to the server (as a Shapefile and Feature Layer (hosted)).

What would be the easiest way to update the layer with the contents of the second dataframe? The ID column is unique if that matters. It could be an overwrite, or update only the changes (remove "bar" and add "fighter").

Any help is much appreciated. Thanks!

jskinner

Hi Matthew,

You could truncate the service and then add the features if editing is enabled on the feature service:

<SPAN class="keyword token">import</SPAN> pandas <SPAN class="keyword token">as</SPAN> pd
<SPAN class="keyword token">from</SPAN> arcgis<SPAN class="punctuation token">.</SPAN>gis <SPAN class="keyword token">import</SPAN> GIS

<SPAN class="comment token"># Variables</SPAN>
portal <SPAN class="operator token">=</SPAN> <SPAN class="string token">'https://portal.esri.com/portal'</SPAN>
username <SPAN class="operator token">=</SPAN> <SPAN class="string token">'jskinner@ESRI'</SPAN>
password <SPAN class="operator token">=</SPAN> <SPAN class="string token">'*******'</SPAN>

<SPAN class="comment token"># Create connection to AGOL/Portal</SPAN>
gis <SPAN class="operator token">=</SPAN> GIS<SPAN class="punctuation token">(</SPAN>portal<SPAN class="punctuation token">,</SPAN> username<SPAN class="punctuation token">,</SPAN> password<SPAN class="punctuation token">,</SPAN> verify_cert<SPAN class="operator token">=</SPAN><SPAN class="token boolean">False</SPAN><SPAN class="punctuation token">)</SPAN>

<SPAN class="comment token"># Publish feature services from DF</SPAN>
df1 <SPAN class="operator token">=</SPAN> pd<SPAN class="punctuation token">.</SPAN>DataFrame<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="string token">"foo"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">90.0</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">30.0</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="string token">"bar"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">91.0</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="number token">31.0</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">,</SPAN> columns <SPAN class="operator token">=</SPAN> <SPAN class="punctuation token">[</SPAN><SPAN class="string token">"ID"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"Longitude"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"Latitude"</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN>
df1SEDF <SPAN class="operator token">=</SPAN> df1<SPAN class="punctuation token">.</SPAN>spatial<SPAN class="punctuation token">.</SPAN>from_xy<SPAN class="punctuation token">(</SPAN>df1<SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"Longitude"</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"Latitude"</SPAN><SPAN class="punctuation token">)</SPAN>
dataFrameLayer <SPAN class="operator token">=</SPAN> df1SEDF<SPAN class="punctuation token">.</SPAN>spatial<SPAN class="punctuation token">.</SPAN>to_featurelayer<SPAN class="punctuation token">(</SPAN><SPAN class="string token">"DataFrame to a layer"</SPAN><SPAN class="punctuation token">,</SPAN> gis<SPAN class="punctuation token">)</SPAN>

<SPAN class="comment token"># Get Item ID of previous published data frame</SPAN>
searchResults <SPAN class="operator token">=</SPAN> gis<SPAN class="punctuation token">.</SPAN>content<SPAN class="punctuation token">.</SPAN>search<SPAN class="punctuation token">(</SPAN><SPAN class="string token">'title:DataFrame to a layer AND owner:{0}'</SPAN><SPAN class="punctuation token">.</SPAN>format<SPAN class="punctuation token">(</SPAN>username<SPAN class="punctuation token">)</SPAN><SPAN class="punctuation token">,</SPAN> item_type<SPAN class="operator token">=</SPAN><SPAN class="string token">'Feature Layer'</SPAN><SPAN class="punctuation token">)</SPAN>
sourceId <SPAN class="operator token">=</SPAN> searchResults<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">[</SPAN><SPAN class="string token">'id'</SPAN><SPAN class="punctuation token">]</SPAN>

<SPAN class="comment token"># Reference layer in feature service</SPAN>
fLayer <SPAN class="operator token">=</SPAN> gis<SPAN class="punctuation token">.</SPAN>content<SPAN class="punctuation token">.</SPAN>get<SPAN class="punctuation token">(</SPAN>sourceId<SPAN class="punctuation token">)</SPAN>
editTable <SPAN class="operator token">=</SPAN> fLayer<SPAN class="punctuation token">.</SPAN>layers<SPAN class="punctuation token">[</SPAN><SPAN class="number token">0</SPAN><SPAN class="punctuation token">]</SPAN>

<SPAN class="comment token"># Truncate feature service</SPAN>
editTable<SPAN class="punctuation token">.</SPAN>manager<SPAN class="punctuation token">.</SPAN>truncate<SPAN class="punctuation token">(</SPAN><SPAN class="punctuation token">)</SPAN>

<SPAN class="comment token"># List of edits as dictionaries</SPAN>
addFeatures1 <SPAN class="operator token">=</SPAN>  <SPAN class="punctuation token">{</SPAN>
    <SPAN class="string token">"attributes"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="punctuation token">{</SPAN>
        <SPAN class="string token">"id"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="string token">"foo"</SPAN><SPAN class="punctuation token">,</SPAN>
        <SPAN class="string token">"longitude"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">90.0</SPAN><SPAN class="punctuation token">,</SPAN>
        <SPAN class="string token">"latitude"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="number token">30.0</SPAN>
    <SPAN class="punctuation token">}</SPAN><SPAN class="punctuation token">,</SPAN>
    <SPAN class="string token">"geometry"</SPAN><SPAN class="punctuation token">:</SPAN>
           <SPAN class="punctuation token">{</SPAN><SPAN class="string token">"x"</SPAN><SPAN class="punctuation token">:</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">90.0</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"y"</SPAN><SPAN class="punctuation token">:</SPAN> <SPAN class="number token">30.0</SPAN><SPAN class="punctuation token">}</SPAN>
    <SPAN class="punctuation token">}</SPAN>

addFeatures2 <SPAN class="operator token">=</SPAN>  <SPAN class="punctuation token">{</SPAN>
    <SPAN class="string token">"attributes"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="punctuation token">{</SPAN>
        <SPAN class="string token">"id"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="string token">"fighter"</SPAN><SPAN class="punctuation token">,</SPAN>
        <SPAN class="string token">"longitude"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">91.0</SPAN><SPAN class="punctuation token">,</SPAN>
        <SPAN class="string token">"latitude"</SPAN> <SPAN class="punctuation token">:</SPAN> <SPAN class="number token">31.0</SPAN>
    <SPAN class="punctuation token">}</SPAN><SPAN class="punctuation token">,</SPAN>
    <SPAN class="string token">"geometry"</SPAN><SPAN class="punctuation token">:</SPAN>
           <SPAN class="punctuation token">{</SPAN><SPAN class="string token">"x"</SPAN><SPAN class="punctuation token">:</SPAN> <SPAN class="operator token">-</SPAN><SPAN class="number token">91.0</SPAN><SPAN class="punctuation token">,</SPAN> <SPAN class="string token">"y"</SPAN><SPAN class="punctuation token">:</SPAN> <SPAN class="number token">31.0</SPAN><SPAN class="punctuation token">}</SPAN>
    <SPAN class="punctuation token">}</SPAN>

<SPAN class="comment token"># Add features</SPAN>
editTable<SPAN class="punctuation token">.</SPAN>edit_features<SPAN class="punctuation token">(</SPAN>adds<SPAN class="operator token">=</SPAN><SPAN class="punctuation token">[</SPAN>addFeatures1<SPAN class="punctuation token">,</SPAN> addFeatures2<SPAN class="punctuation token">]</SPAN><SPAN class="punctuation token">)</SPAN><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN>