ArcGIS Pro 2.5 Fails to Overwrite Web Layer - Staging Failed
It is also happening with oracle but not all the time. We have 122 Open data layers that we export daily through Pro/Python script run through a windows batch file. All but a handful of them work and previous to a week ago all have worked. We have run in to this before but could manually run overwrite the webservice out of ArcPro but now we get the fairly useless ERROR 999999: message even when manually trying to update the hosted features. The other 118 still work both manually and through the script. The log gives no extra information.
We are using:
Windows server 2012 R2
ArcPro 2.5
Oracle 12C
ArcGIS 10.7 geodatabase
We have done all the suggestions from all posts I could find (see below). Most suggestions also assume that it hasn't been working for months before suddenly getting this error.
- Works fine on roughly 118 or 122 hosted services that are updated through same method/script
- Has worked for months
- all arcpro documents are in same folder location on the local machine
- data all from same geodatabase, same db owner
- Connected as database owner
- same AGOL user and hosted folder, share setting etc
- tried to a new hosted layer - no luck
- have pro pointing to local directories for it's processing
- rebooted machine
- Lots of room on local comuter
- tried coping layers to new map > no luck
- deleted temp files
- file path is not too long, working ones have longer names plus it worked previously
- No analyze errors
- Also checked geometry
- checked symbology
- No new domains
- No relationship classes
- feature class size, one
- Display field in Pro is valid
- using default python environment in Pro
- Used fiddler while trying to publish. Nothing pops out
- SDDraft is created in: C:\Users\<username>\AppData\Local\ESRI\ArcGISPro\Staging\My Hosted Services (NAME)
- Possible problem with creating index (no log.txt in Maps>index>LAYER folder) > rebuilt indexes > no change
- Missing publishingResults.json in C:\Users\<username>\AppData\Local\ESRI\ArcGISPro\Staging\SharingProcesses\<Job ID>\ and found missing the publishingResults.json Is it actually failing on Consolidate data?
vs 
Staging is set to E:\ArcGISPro\Staging\SharingProcess but it is putting it in C:\Users\adminsde\AppData\Local\ESRI\ArcGISPro\Staging\SharingProcesses
It would be nice if Esri would add all of these checks and what ever else is making it fail to the analyze tool so we can understand what the issue is or give better error messages when things don't work.
Any other suggestions of what to try are welcome.