Pretty sure we are doing this right and meet all system requirements (Collector etc work just fine). From an Android device.
Confirmed we can get to our AGOL data.
Keith - if your Enterprise portal is pre-10.8.1, you will need to register the ArcGIS Field Maps app id as mentioned above. Here are the documented steps:
Requirements—ArcGIS Field Maps | Documentation