topic Re: Overwrite not working, wrong number of records returned in ArcGIS API for Python Questions

Overwrite not working, wrong number of records returned

TregChristopher — Sun, 12 Dec 2021 10:49:12 GMT

I'm using Python API's flc.manager.overwrite method to overwrite an existing HFS with new data from a feat class in a fgdb. Although the operation says "success" the records returned are the either the same as before or they are zero.

To test, I downloaded a hosted feature service (HFS) as a fgdb, deleted a few records in ArcMap and then specified the following for overwriting.

flc = arcgis.features.FeatureLayerCollection.fromitem(item)
flc

lyr = flc.layers[0]
lyr.query(return_count_only=True)

Output:39

flc.manager.overwrite(r"C:\data\Data\Projects\jupyter\WDFW_JupyterNotebooks_Master\Data\test.gdb\test_county")

Output:{'success': True}

lyr = flc.layers[0]
lyr.query(return_count_only=True)

Output:39 #this should be 34 since I removed some counties from the local feature class

A second test with adding new features in ArcMap and then running method gave the "success:true" message

but results returned was zero records.

Any ideas what I'm doing wrong?

Re: Overwrite not working, wrong number of records returned

JohnYaist1 — Tue, 06 Feb 2018 01:35:48 GMT

Hey Treg

Let me run some testing on this function. I'll get back to you on what I find.

John

Re: Overwrite not working, wrong number of records returned

TregChristopher — Tue, 13 Feb 2018 16:43:54 GMT

Hi John,

Any luck troubleshooting this issue?

Treg

Re: Overwrite not working, wrong number of records returned

JohnYaist1 — Tue, 13 Feb 2018 17:11:49 GMT

Hey Treg - I'm seeing the same problem you documented in certain cases. Can you try running the `overwrite` function with a zipped up gdb as the input rather than the gdb feature class? Let me know what results you get.

Re: Overwrite not working, wrong number of records returned

TregChristopher — Tue, 13 Feb 2018 17:33:42 GMT

I’m still getting the same number of records after zipping

Also, I tried to diff pathways (below…1.include zip and gdb 2 include just zip) and they both gave “success” message and both returned the original # records instead of 5 less counties from the local version.

lyr = flc.layers[0]

lyr.query(return_count_only=True)

#the records in local'test_county_incomplete'=34

flc.manager.overwrite(r"C:\data\Data\Projects\jupyter\WDFW_JupyterNotebooks_Master\Data\test_county.gdb.zip\test_county.gdb\test_county_incomplete")

#flc.manager.overwrite(r"C:\data\Data\Projects\jupyter\WDFW_JupyterNotebooks_Master\Data\test_county.gdb.zip\test_county_incomplete")

{'success': True}

lyr = flc.layers[0]

lyr.query(return_count_only=True)

Re: Overwrite not working, wrong number of records returned

JohnYaist1 — Mon, 19 Mar 2018 16:50:01 GMT

Hey treg‌ -

I'm seeing similiar behavior to what you've documented with the FeatureLayerCollection.manager. We've logged this issue internally and are investigating the featurelayercollection.manager.overwrite() method. Will the item.publish(overwrite=True) work in your scenario?

Re: Overwrite not working, wrong number of records returned

TregChristopher — Tue, 20 Mar 2018 17:29:44 GMT

Thanks for looking into this further John. Your suggested workaround “item.publish(overwrite=True)” might work fine. I won’t have time to test anytime soon though. One of our eventual needs is to have some version of overwrite working so we can we can make major schema changes on existing Hosted Feature Services that are used by a survey123 form (but was published initially from a feature class…not created in S123). I’ll post a response to GeoNet when I have some time to investigate your workaround.

Thanks,

Treg

Re: Overwrite not working, wrong number of records returned

dmacq — Thu, 03 May 2018 20:15:40 GMT

I'm having the same issue. The overwrite method essentially restores the Feature Service to its state when initially published, or last overwritten via desktop tools. I can delete all the features from a feature layer (from Pro, or from a Web Map), run the overwrite method, and my feature layer is back to the way it was prior to the deletes.

John, are you able to provide a basic sample using the publish method? I'm have some trouble with the publish_parameters.

Re: Overwrite not working, wrong number of records returned

StephenRoss — Thu, 12 Jul 2018 17:36:57 GMT

I am having the same issue as Treg. Has the esri team investigated the issues with the featurelayercollection.manager.overwrite() method?

Re: Overwrite not working, wrong number of records returned

TregChristopher — Sun, 12 Dec 2021 10:49:14 GMT

This still wasn't working about a month ago but there must have been a recent update because I can confirm that this is working now (Py API 1.4.1):

##delete all features via truncate
tblTaxo.manager.truncate()

Pre-overwriteFeature count: 0

from arcgis.features import FeatureLayerCollection
tblTaxo_flayer_collection = FeatureLayerCollection.fromitem(items)

#call the overwrite() method which can be accessed using the manager property
tblTaxo_flayer_collection.manager.overwrite(tblTaxoGeolib)

Post-Overwrite Feature count: 2431

Re: Overwrite not working, wrong number of records returned

KellyTaylor — Thu, 30 Jan 2020 22:05:18 GMT

Has this been resolved? Over a year later and I am having the same problem. Getting {'success': True} from my script, but none of the features have been updated and the feature layer's symbology goes back how it was when first published.

I am wondering if it has to do with trying to overwrite using a feature class which lives within a data set in a geodatabase. Any thoughts?

Re: Overwrite not working, wrong number of records returned

TregChristopher — Sun, 12 Dec 2021 10:49:17 GMT

Apparently I haven't been using this much because I just tried again and it seemed unsuccessful...the record count remained the same between the original 2431 and the overwrite, which should now have 2434 records. I didn't check whether any changed attribute values were overwritten or remained the same but the lack of change to the record count would seem to indicate that nothing else was overwritten either.

This is a table in an SDE,so I don't think your source as a feature class in a file geodb is the problem. I did get a warning (not an error) that the dataframe (df) is being deprecated in favor of the spatial dataframe but since it was a warning, I don't think that is the error either.

I am now working off of Py API version 1.6.1

Now removing all records from taxo table... Pre-Truncate Feature count: 2431 Post-Truncate Feature count: 0
Now overwriting taxo table...
Post-Overwrite Feature count: 2431

C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\arcgis\features\feature.py:612: UserWarning: The SpatialDataFrame has been deprecated. `df` property will be removed as a future release. Use `sdf` instead.   warnings.warn(("The SpatialDataFrame has been deprecated. "

Re: Overwrite not working, wrong number of records returned

AshleyHayes2 — Thu, 01 Oct 2020 21:54:08 GMT

For what it is worth, I am experiencing the same issue. Drew described it pretty much perfectly, "the overwrite method essentially restores the Feature Service to its state when initially published, or last overwritten via desktop tools."