RD,
So it sounds like you are using App Builder, right? You can not add an annotation layer of a map service as an individual layer in App Builder as individual layers of a map service get added as feature type layers and an annotation would appear as a polygon on the map that makes up the bounds of the annotation. Your only option is to add the whole map service that contains your annotation and not try and drill down to layer 3 of the map service.