Solved! Go to Solution.
Most likely there is a high cost street in that area. Bring up the properties of the service area layer and turn on the Lines and have it split lines at breaks, re-solve. Now examine the lines in the area of interest to see what is the cost assigned to the edges (from/to cummulative costs). That should point to the underlying network costs causing a distortion in the polygon.