I'm using ArcGIS Desktop 10.7.1 and AGS 10.9.1. This is a federated server.
I have recently installed enterprise using the builder and messed up when putting in the web adaptor so after it installed fully, I unregistered the adaptor with Server and reconfigured a new one. I restarted the AGS at this point. On the new web adaptor installation I chose to disable administrative access, thus I know I need to use a URL with the port number to connect from ArcMap. I have HTTPS enabled on the server and the web adaptor was published to a site with binding 443 (maybe I should have picked the 80 binding version, I don't know). I have entered my fully qualified domain name, plus the port number when trying to create an administrator connection to the GIS Server in ArcMap, but keep getting either error 504 (Proxy server got bad address from remote server) or 500 (generic internal server error). This is the URL I'm using to connect:
https://fullyqualified.domain.com:6443/arcgis
I then enter the primary site administrator account credentials and try to connect with no luck. I have also tried adding /admin onto the end of the above URL; no dice. I have tried every variation I can think of, including using http, 6080, IP address, and the CNAME of the server, but it can't connect. Any suggestions? I wonder if this could just be as simple as a port problem; we opened 7443 for portal and thought that would be enough, but do we need to open 6443 too? I suppose that could make some sense.
I don't think this is relevant, but I can connect to our rest services using our website domain name, so the web adaptor is working properly in that regard. When logged onto the server machine, I can reach manager, admin panel, rest services, etc. using the FQDN + 6443 too.