I spoke too soon - I found it. The geodatabase, msd, and mxd file is located in the arcgis server directory: arcgisserver\directories\arcgissystem\arcgisinput\FolderName\ServiceName.MapServer\extracted\v101. If I delete the server, the data is deleted too.