US 11,989,355 B2
Interacting with a smart device using a pointing controller
Nathaniel James Martin, London (GB); Charles James Bruce, London (GB); and Lewis Antony Jones, London (GB)
Assigned to ARKH Litho Holdings, LLC, Dallas, TX (US)
Appl. No. 17/432,028
Filed by ARKH Litho Holdings, LLC, Dallas, TX (US)
PCT Filed Feb. 15, 2020, PCT No. PCT/IB2020/051292
§ 371(c)(1), (2) Date Aug. 18, 2021,
PCT Pub. No. WO2020/170105, PCT Pub. Date Aug. 27, 2020.
Claims priority of provisional application 62/807,094, filed on Feb. 18, 2019.
Prior Publication US 2022/0155880 A1, May 19, 2022
Int. Cl. G06F 3/0346 (2013.01); G06F 3/01 (2006.01); G06F 3/0482 (2013.01); G06F 3/04847 (2022.01)
CPC G06F 3/0346 (2013.01) [G06F 3/017 (2013.01); G06F 3/0482 (2013.01); G06F 3/04847 (2013.01)] 36 Claims
OG exemplary drawing
 
1. A method for controlling interactions with a smart device using a pointing controller, the method comprising:
obtaining sensor data from a state sensing device of the pointing controller;
tracking movement of a pointing vector through a three-dimensional space based on the sensor data and a stored arm model by:
responsive to determining that coordinates in the three-dimensional space associated with the smart device are greater than a threshold distance from the pointing controller, generating parameters of the stored arm model corresponding to an arm as being in an outstretched position;
responsive to determining that the coordinates in the three-dimensional space associated with the smart device are less than a threshold distance from the pointing controller, generating parameters of the stored arm model corresponding to the arm as being in a relaxed position near a body; and
tracking the movement based on the parameters of the stored arm model;
detecting an intersection of the pointing vector with the coordinates in the three-dimensional space associated with the smart device to place the smart device in a selected state;
causing an augmented reality display device to display a virtual menu associated with the smart device;
detecting a control interaction with the pointing controller associated with the virtual menu when the smart device is in the selected state; and
generating a command to control an operation of the smart device based on the control interaction.