Updating a layer in the visualization pane sets the default for when a layer is added to a new map. I haven't seen it update a layer that is in an existing map. I have to go to all the maps, remove the layer, and re-add the layer with the updated changes, or I have to customize the layer again, but in the map.
My Idea is that once you click save in the visualization pane, a pop-up appears with a list of maps the layer is in. You may go in and select/deselect maps that you don't want the layer updates to push out to.