You can add attribute to the secondary symbol graphic, like graphic.attributes["MySelection"] = "True". And when you need to delete the graphic, find the graphic with having attribute "MySelection" from graphics layer before making another selection and remove the graphic. Its just a way of setting the flag for your graphic that needs to be deleted.