We have a test portal setup that I can connect to via Survey123 Connect and can publish surveys. When i try to add the portal URL, i get 'Connection refused (1)' error.
Can you confirm that the ArcGIS Enterprise server has a valid SSL certificate (not self-signed)? You should be able to test by going to the Portal's homepage in IE/Edge/Chrome.
