Solved! Go to Solution.
Copy the materials from old Server to new Server:
\arcgisserver\config-store\services
\arcgisserver\directories\arcgiscache
\arcgisserver\directories\arcgisoutput
\arcgisserver\directories\arcgissystem\arcgisinput
Retain the name of the folders, including the folder name of cache folder(if the Map Service is cached).
Open the mxd, and repair/set broken layer data sources if any.