Hi Josh,
Label priorities are used when deciding which of two conflicting labels to delete - the label with lower priority will be deleted. Unfortunately, there are many other reasons for a label not to be placed. It may be too large for the feature, there could be conflict with other features, etc.
You could also try Never Remove on the 'Priority 1' label class, although you may get some overlapping labels. They should all be placed, though.