Ah, that makes sense. This is still a "limitation" then*.
I actually prefer this set-up though, as it creates a centralized location for publishing. I do all publishing via a dedicated service account. Independently of me, my colleague can use Connect to download a survey and complete edits, but ultimately the XLSX is sent back to me for publishing. I find this creates a more uniform experience for the end user, and helps with quality control.
*However, it is worth noting that your colleague(s) could log into the service account via Connect and publish as that user. In this respect, the above limitation can be bypassed. I am by no means advocating for account sharing, as that isn't permitted, but so long as all users have a dedicated account then this could be done.