For those who might run into the same problem, we still haven't found a workaround for this in version 2.1 of the Silverlight API, but we cannot replicate the problem above using version 2.2 of the API so it seems to be a bug that has been solved there.