Each users request will wait for a free instance if one isn't available. It's important to know how much time it takes for the request to go through, (drastically different for GP than map services, for example), and then make sure you monitor the instances in use property within Server Manager and increase it if you see all instances being used. It may be good to look into load testing using JMeter or similar software.
