Travis,
The time it takes for your layers to draw in ArcMap will directly effect the time it takes to draw from your web service. Does your layer take a long time to draw when displayed in ArcMap, if it does try setting scale thresholds or definition queries to speed up the drawing. If this does not help it may be just that your machine is struggling.
Please don't forget to mark the original question as answered.
Regards
Anthony