Have you ever found out how to delete all markups?
I am having an issue with ArcReader markups as well.
When using them a client gets an error message that shuts down the project. When it is opened again, the markups are still there, it is like they cannot be deleted.
Also the Reader project is a shortcut on their desktop, not sure if this would be causing the problem?