I'm trying to use leaders to label pipe elevations where they connect to the manhole. The red is what I currently have; blue is where I'd like them to be. I have it set up where there is a label class for upstream elevation and one for downstream elevation (both on the same line feature layer).

Here are the options I have set for each one:

How do I get the leader lines to consistently point to where I want them? Thanks in advance for any help!