Further investigation has revealed this to be something to do with Group Layers. All of my images with transparency were contained in a Group Layer, and the background image was in a seperate group layer. When I remove put all the images in one single group layer transparency works as expected.