Do you know if this only happens with your map service or can you reproduce it using Esri's map services hosted on arcgis.com?
Do notice anything different about how the application loads when the problem occurs?
- Does it load slower?
- What browser are you using?