Oops, didn't see you needed it to be justified (seems odd though - this ensures your labels and patches are as far apart as possible. I'm sure you've got your reasons, though, or following some archaic oil & gas protocol). As far as I know, converting to graphics is probably the only way to do it. Also, and not ideal by any means, if you could get away with leaving the labels at a static place on the left and the patches at a static place on the right, you could create two separate legends and just leave them there (one for labels, one for patches).