It will help you to save some memory on the server, but as Jayanta said you can use it for rarely used services, otherwise it will cause performance issue since the user have to wait till the server creates the instance then the request will be processed!
If you are using a web mapping application such as geocortex or web app builder, the service should be invisible by default when the user loads the app.
-Ahmad