I normally delete a featureclass by casting it to IDataset and calling the Delete().
However, an AnnotationFeatureClass does NOT implement IDataset, so I do not know how to delete it.