How to perform near interaction using hand gesture in Perception Simulation?

207 Views Asked by At

I need to enter the username and password for one of the hololense application. I am able to perform the air tap for the far interaction using hand gestures. But, I couldn't perform the near interaction to enter value from the keyboard.

Keyboard Simulation

How can I simulate the keyboard action in the virtual keyboard? I tried to use Point Pose, but it is not working.

1

There are 1 best solutions below

2
On

The system keyboard should be able to enter values through near interaction.

After testing, we found that you can hold the left or right Alt keys(in your physical keyboard) to move the hand, and make the hand mesh tap the system keyboard. Specifically, once the hand touches the keyboard, the button color will become white. And at this time, the key is to minimize the touch time to avoid triggering other input events. If you make it, the value will be displayed in the input field.