Try going to the folder location of the jpg file, and delete all of the files with the same name, but different extentions (ie: if your file is terrain.jpg, delete terrain.aux.xml and terrain.ovr and terrain.jgw etc.) then when you add it back in to the map for georeferencing, it should behave as expected.
Regards,
Jim