Hi,
I am using ArcGIS version 2.4.0 in Databricks and was trying to publish large number of records from our Databricks Environment to the ArcGIS Enterprise (10.9.1). We created a ticket for this and got it working with workaround.
I tried this method to publish: Overwriting feature layers | ArcGIS API for Python
and Appending Features | ArcGIS API for Python
The workaround that we tried: Use add item to the updated or new CSV file to add it to your portal. Once we have our updated CSV file in our portal, we removed the original published CSV layer from portal. Overwrite the old layer by using the publish method to force the name and item_id to be the same.
But the ESRI consultant also told us that even though installation is possible, ArcGIS Python API is not meant for cloud environments which I also felt in the documentation above that they have only tested that locally but not for any data stored in the cloud environment. In my case, the dataset is stored in the managed_volumes in the Databricks.
It would be great if we have more support for ArcGIS python API for cloud environments. Any recommendations / comments would be welcome.
Thanks
Prasandeep
A/IT Analyst, Transport Canada
