Currently, attachments cannot be renamed until after they have been added. To rename an attachment, you can follow these steps: How to Rename Attachments in ArcGIS Field Maps.
Due to this limitation, attachments are not being renamed as often and conveniently as I need them to. I would like to suggest implementing a renaming workflow similar to the one found in ArcGIS Survey123.