Hi Erin,
Try enabling Disable layer visbility management parameter in Analysis tab. When this option is enabled, the layer visibility will not be altered when the widget is turned on and you should be able to see the layers.
As Brian mentioned it is as designed and once you draw you area of interest on the map, it should work regardless when the layer is visible or not.