I am glad to know that Anonymous is enabled by default. However, I can see my test application from outside the machine but still not from outside the network. The individual services have been set to public. I did also set folder permissions for the Server Account for data folders, the argisserver folders, and the wwwroot application folder.
I had a similar problem in 10.0 which was resolved by specifying the arcgis server connection URL in ArcCatalog to include the domain path as well as the machine name. I did the same in 10.1 but no resolution yet.
The rest services directory is also not visible from outside the network.
I must still be missing something.