topic Automatic Update layer via Google Docs in Data Management Questions

Automatic Update layer via Google Docs

FireRidge — Sat, 08 May 2021 03:56:02 GMT

Hello all. Here is my scenario. In integromat I am:

calling a Geojson API
converting data to a csv (the Geojson layer kept assigning a number field to a string hence with a csv upload I had control over the field type)
updating the original csv file in google docs
said google doc is what created the feature layer.

Is there a way to auto append or auto overwrite the table without doing it manually in the content viewer for said layer?

thanks

FireRidge

Re: Automatic Update layer via Google Docs

jcarlson — Sat, 08 May 2021 14:04:14 GMT

There is an overwrite function in the Python API that will take a CSV as an input. A bit of python scripting can automate the process easily enough. It's important to note that when you add a Google Sheet to AGOL / Enterprise, all it's really doing is reading that spreadsheet as text, so if you have the CSV, you can eliminate the Google Docs step entirely.

Also, if your layer has a unique identifier field, you can use append instead, which preserves existing settings and field types.

Re: Automatic Update layer via Google Docs

FireRidge — Sun, 09 May 2021 14:55:38 GMT

Thank you for the response. The csv has been a work around since the https geojson address I keep trying to add keeps giving me general error. Is there a way to clean up the geojson file (to make sure fields have the correct type) before I import nor overwrite layer?
So far I can’t figure out why I keep getting an error when trying to import this geojson file —see below

https://www.fire.ca.gov/umbraco/api/IncidentApi/GeoJsonList?inactive=true&year=2021

Re: Automatic Update layer via Google Docs

jcarlson — Mon, 10 May 2021 13:17:02 GMT

You can convert a GEOJON directly to a FeatureSet using FeatureSet.from_geojson. From there, you can convert the FeatureSet to a Spatially Enabled DataFrame, which would let you control the field types prior to uploading / appending.

Re: Automatic Update layer via Google Docs

FireRidge — Mon, 10 May 2021 20:08:58 GMT

Josh

You have been s super help with directing me towards a final solution.

I am going to try and call https://www.fire.ca.gov/umbraco/api/IncidentApi/GeoJsonList?inactive=true&year=2021

within a google python function (https trigger)

Before I go down the rabbit hole ( i do not have experience with python) do you think it is possible to use the ArcGIS Python api in a google function to

populate said geojson as a layer
Format said layer
overwrite said layer (with https trigger set on timer)

Thanks again

Josh

Re: Automatic Update layer via Google Docs

jcarlson — Mon, 10 May 2021 20:11:50 GMT

I imagine you could. I have not used Google functions in ages, but I have seen users on here mention using it for certain tasks.