What are you using to clip the data frame shape? Is it a feature class, specified extents, or something else? I used another feature class to clip and it does not have the background.
Weird, I believe I am doing the same thing but it looks to be working for me. I'm at 10.1...
What version including service packs are you at?