When there is a Layer Locator and an Address Locator configured in the Search Widget in Experience Builder, and the user searches for an address, all the layers that are configured in the Layer Locator are removed from the map. I can see how this would be helpful when the user is searching for a specific layer, but if the chosen search is an Address, then no layers should be filtered.
