Yes, you can federate both, assuming they're not active/active siloed environments, but unique sites hosting different services. If they're active/active siloed environments, you'll need to set up a multi-machine site instead.
And yes, you don't need the Web Adaptors, you can use F5 instead of the Web Adaptors.