I have a script that calculates values for AGOL hosted feature layers, and come across the 504 error frequently. In fact, I pretty much expect it to fail most days if you are calculating very many records.
So, I createa list of the unique id's for the features I want to update, and an empty list called doneList.
Every iteration that succeeds appends the ID for that feature to the doneList.
Then, I have the call to the function that does the updates in a try: within a try: and while true statement similar to :
try:
CreateIDlist() # runs function to populate the list of features I want to process
while True:
try:
DotheCalcs()
break # stop the loop if the function completes sucessfully
except Exception as e:
print("Function errored out!", e)
print("Retrying ... ")
print("Done with inner try")
So, the try function creates the list of ID's to process, then enters the While True: try: block.
that sends it to the function that does the calculations, and if it succeeds without error, it will "break" and end the whle/try loop and we are done. If it errors, it prints the Function error out/Retrying message and sends it back to the DotheCalcs() function again.
In beginning of the DotheCalcs() function,
for ID in toUpdateList:
if ID not in donelist:
(fl.calculate(where=sqlclause, calc_expression={"field": "Description", "value" : DescrDict[mc]})) # Do the Calculation
donelist.append(mc)
So, if it fails, it will try to run again, but, already has a list of what has been done already.
If the ID is not in the list, then the calculation has not succeeded on that feature, so it tries it again.
Some days it will process all 11,000 records without fail, others, it will restart itself one to many times until the list is completed.
R_
