Are you using the compiled version or the source code of the Flex Viewer?
If you are using the compiled version of Flex Viewer, then that exact behavior is not possible. However, you could change the behavior of your <layer>'s so that the editable features are only included in the layer of type="feature" but not in layer="dynamic".
Or you could use the source code to create your own version of the Edit Widget...