Through troubleshooting another issue, I've noticed issues with the results view layer that Survey123 creates when you share the results via the Collaborate option on the Survey123 website.
For this idea, it focuses around the fact that the new fields are not automatically added to this view which means users cannot see them when viewing the data in the Survey123 website. This is something that the publishing process should do, or at least, present you with the option to do.