Augmented Reality: OrientationSensor to camara's transformation matrix

sandiegomonedero

Hi

I am trying to update the SceneView Camera using Androids OrientationSensor in Xamarin to do an AR app with no success. I get the quaternions (x,y,z,w) from the sensor and use them to create the transformation matrix but the resulting orientation does not correspond to the mobile's orientation. I have tried different combination of axes (changing order and sign in the quaternion components) assuming it was a problem with the axes definition but still with no success.

 
 Anybody knows how to use Android's OrientationSensor to create the correct transformation matrix?

Thanks

PD: I know I can use the magnetomer and accelerometer to obtain the AR effect  but prefer to use the OrientationSensor as I think it will lead to a better solution.

sandiegomonedero

Thank you both.

Yes I am also considering using the ARKit but wanted to have a simple solution using the orientation sensor. I was doing basically the same as your code. Anyway I just found out the problem so I write it here in case anybody is facing the same issue.  To update the camera viewpoint do not set the rotation and translation at the same time, but rather 1) Use quaternions with NO translation to create the transformation matrix and a new rotated camera  2) translate the resulting camera and update viewpoint

The thing is that I assumed that translation would not affect the quaternions but apparently it does as you can see executing the snippet in the attached image.

Thanks again.