I have been stuck on this issue for a week.
Currently, I'm able to control it with gesture using Matrix4.setLookAt() function. I'm able to control it by moving around the device.
However, I tried to combined both gesture and device movement together. When I swipe up/down, the gesture will start to move the screen at an angle (down and left, up and right). Here is the video demonstration: youtube link
I'm new to camera matrix. Can anyone give me advice on this?
Thanks