I would like to calculate a Modified Soil-Adjusted Vegetation Index 2 on the basis of Landsat 8 OLI imagery, bands 5 (NIR) and 4 (RED), using the Raster Calculator. The formula should be:

I have tried to convert this using the following map algebra expression in the Raster Calculator:
MSAVI2 = (2 * "NIR layer" + 1 - SquareRoot((2 * "NIR layer" + 1) ^ 2 - 8 * ("NIR layer" - "RED layer"))) / 2
The returned values are between 0.5 and 58113.5. They should be between -1 and 1 though, so something is not right.
Any ideas about what is going wrong here?
Thanks!