CPC G06F 3/0346 (2013.01) [G06F 3/017 (2013.01); G06F 3/0482 (2013.01); G06F 3/04847 (2013.01)] | 36 Claims |
1. A method for controlling interactions with a smart device using a pointing controller, the method comprising:
obtaining sensor data from a state sensing device of the pointing controller;
tracking movement of a pointing vector through a three-dimensional space based on the sensor data and a stored arm model by:
responsive to determining that coordinates in the three-dimensional space associated with the smart device are greater than a threshold distance from the pointing controller, generating parameters of the stored arm model corresponding to an arm as being in an outstretched position;
responsive to determining that the coordinates in the three-dimensional space associated with the smart device are less than a threshold distance from the pointing controller, generating parameters of the stored arm model corresponding to the arm as being in a relaxed position near a body; and
tracking the movement based on the parameters of the stored arm model;
detecting an intersection of the pointing vector with the coordinates in the three-dimensional space associated with the smart device to place the smart device in a selected state;
causing an augmented reality display device to display a virtual menu associated with the smart device;
detecting a control interaction with the pointing controller associated with the virtual menu when the smart device is in the selected state; and
generating a command to control an operation of the smart device based on the control interaction.
|