Create a web map (using ArcGIS.com) containing two layers, then switch one of them on, with the other one off.
Create an app in the Web App Builder based on this web map, and switch both layers on, then save the app.
Launch the app - the second layer's visibility hasn't been saved. It seems that the Web App Builder isn't persisting the layer visibility.
Cheers,
Steve