Yes, you should be able to control only working with a group layer using Selected in Contents and highlighting just that group layer.
In the example above, drawing a box around a feature in Cities, Countries, and Contours, only returns the Cities and Countries features and not the contour because the group layer is Selected in Contents and only contains Cities and Countries.