So I served out some data today and added it to my content on ArcGIS online. Everything seemed to work fine, I could view the data and added it to a map with few problems. However, as soon as I started sending it out to others to test it we all started getting messages that said the "layer is not responding".
Not only that, but previously I could open the service in ArcMap10 but now I get an error message as well. My server is still up and working as I can still view web applications I have created.