Assuming you're working from the Data tab of an Item page in AGOL, the SQL coalesce function might do what you're looking for. It accepts multiple arguments and returns the first non-null argument. For example, if you have a field named Label where some records have labels (and you want to keep those) but you want to use 'Feature (objectid)' for those with null values, you could do something like this:
coalesce(LABEL, CONCAT('Feature ', OBJECTID))
Anything with a label will get the first value (the existing value) and anything that's null will get "Feature #".
I would recommend testing this on some data that you don't mind messing up first however, like a temporary field added for this purpose.
Robert, instead of using the data tab, like mentioned above (though, that might be easier), you can bring in your ArcGIS Online data into Pro without having to export and then re-publish. All you need to do is either add data from path from the add data button:
Or, just go to your portal in your catalog pane and find the data that way. Then you can edit the data just as you would in pro with a file geodatabase feature class (and the data in AGOL will update as you edit it).