US 11,836,295 B2
Method and apparatus for applying free space input for surface constrained control
Shashwat Kandadai, Cupertino, CA (US); Nathan Abercrombie, Oakland, CA (US); Yu-Hsiang Chen, Cupertino, CA (US); and Sleiman Itani, East Palo Alto, CA (US)
Assigned to West Texas Technology Partners, LLC, Washington, DC (US)
Filed by WEST TEXAS TECHNOLOGY PARTNERS, LLC, Waco, TX (US)
Filed on Feb. 14, 2023, as Appl. No. 18/168,755.
Application 18/168,755 is a continuation of application No. 17/686,964, filed on Mar. 4, 2022, granted, now 11,579,706, issued on Feb. 14, 2023.
Application 17/686,964 is a continuation of application No. 17/175,671, filed on Feb. 14, 2021, granted, now 11,269,421, issued on Mar. 8, 2022.
Application 17/175,671 is a continuation of application No. 16/458,470, filed on Jul. 1, 2019, granted, now 10,955,930, issued on Mar. 23, 2021.
Application 16/458,470 is a continuation of application No. 14/713,954, filed on May 15, 2015, granted, now 10,401,966, issued on Sep. 3, 2019.
Prior Publication US 2023/0297173 A1, Sep. 21, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01)
CPC G06F 3/017 (2013.01) [G02B 27/017 (2013.01)] 25 Claims
OG exemplary drawing
 
1. A method, comprising:
determining, by a processor, a surface constrained input standard for a surface constrained input, wherein the surface constrained input is an input generated proximate to a physical surface along a two dimensional physical plane;
sensing, by a sensor, the surface constrained input generated in a three-dimensional space proximate to the physical surface by a first digit of a hand of an individual, wherein the sensor is integrated into a head-mounted device and the surface constrained input is sensed by the sensor relative to a head of the individual;
defining, by the processor, a height, a width, and a depth of a volumetric three dimensional virtual boundary proximate to and removed from the physical surface based on the surface constrained input; and
determining, by the processor, a free space input standard for a free space input, the free space input being received within an augmented reality construct defined by the same approximate height, width, and depth of the volumetric three dimensional virtual boundary, wherein a portion of the volumetric three dimensional virtual boundary abuts a virtual object in the augmented reality construct;
associating, by the processor, the free space input with the surface constrained input;
sensing, by a sensor, a first movement of the first digit of the hand of the individual within the volumetric space, wherein the first movement comprises the first digit moving from a first plane in the volumetric space to a second plane in the volumetric space;
sensing, by the sensor, a second movement of the first digit within the volumetric space, wherein the second movement comprises the first digit moving horizontally along the second plane;
sensing, by the sensor, a third movement of the first digit within the volumetric space, wherein the third movement comprises the first digit moving from the first plane in the volumetric space;
sensing, by the sensor, a fourth movement of a second digit of the hand within the volumetric space;
determining that the free space input standard includes the first movement of the first digit, the second movement of the first digit, and the third movement of the first digit, and excludes the fourth movement of the second digit;
generating the free space input that includes the first movement of the first digit, the second movement of the first digit, and the third movement of the first digit, and excludes the fourth movement of the second digit;
determining, by the processor, that the free space input satisfies the free space input standard;
in response to the free space input satisfying the free space input standard, generating a virtual surface constrained input that satisfies the surface constrained input standard associated with the surface constrained input; and
executing, by the processor, a surface constrained input response, wherein the surface constrained input response associated with the virtual surface constrained input is the same response as a response executed for the surface constrained input.