Hi Russ,
After changing the setting to disabled I can login with the admin account in both Collector and Portal for ArcGIS.
After that, Portal for ArcGIS displays the Web Maps appropriately in the My Content area but Collector does not show any Web Map.
If I enable the setting again Collector starts working normally and displays the Web Maps.
Cheers,
Jose Sousa