Labels are controlled by the web map's definition and are limited to whatever's supported by the "classic" map viewer, if they display there they should display in WAB. IF that doesn't work, you may have a widget that's inhibiting the labels, try making a new app from scratch to see if they appear. If all of that fails I'd take it up with support.