US 12,229,342 B2
Gesture control on an eyewear device
Kyle Goodrich, Venice, CA (US); Andrew James McPhee, Culver City, CA (US); and Daniel Moreno, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Aug. 24, 2021, as Appl. No. 17/410,787.
Claims priority of provisional application 63/129,323, filed on Dec. 22, 2020.
Prior Publication US 2022/0197393 A1, Jun. 23, 2022
Int. Cl. G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06F 3/0482 (2013.01); G06F 3/04845 (2022.01); G06F 3/04855 (2022.01)
CPC G06F 3/017 (2013.01) [G06F 3/011 (2013.01); G06F 3/04815 (2013.01); G06F 3/0482 (2013.01); G06F 3/04845 (2013.01); G06F 3/04855 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method comprising:
displaying, by one or more processors of an eyewear device, a scroll bar that extends along an x-axis and one or more virtual objects on the eyewear device including a first plurality of media assets associated with a first collection of media content;
detecting, by a camera of the eyewear device, a hand within view of the eyewear device;
generating a first virtual line representing an orientation of the one or more virtual objects;
generating a second virtual line connecting two points of a first finger of the hand that represents an orientation of the first finger, the first finger comprising an index finger;
measuring an angle formed between the first virtual line representing the orientation of the one or more virtual objects and the second virtual line representing the orientation of the first finger;
determining that the first finger of the hand is oriented along a same direction as the one or more virtual objects that are displayed in response to determining that the angle, formed between the first virtual line representing the orientation of the one or more virtual objects and the second virtual line representing the orientation of the first finger, is less than a threshold value;
detecting movement of a second finger of the hand relative to the first finger, the second finger comprising a thumb;
establishing a relationship between distance of movement of the thumb and a number of pixels to scroll the one or more virtual objects;
controlling the display of the one or more virtual objects in response to determining that the first finger is oriented along the same direction as the one or more virtual objects and in response to detecting movement of the second finger to the first finger;
detecting input corresponding to dragging of the thumb along the orientation of the index finger to scroll the one or more virtual objects in a direction in which the thumb is being dragged;
determining that the thumb has been dragged a first distance along the orientation of the index finger;
determining, based on the relationship, a quantity of pixels associated with the first distance that the thumb has been dragged;
scrolling the one or more virtual objects by the quantity of pixels in the direction in which the thumb has been dragged the first distance;
after identifying a given virtual object of interest based on scrolling the one or more virtual objects, activating the given virtual object in response to determining that the index finger has been tapped by the thumb;
determining that the second finger moves in a first direction along the x-axis; and
advancing the scroll bar towards the first direction and rotating the one or more virtual objects in the first direction, in response to determining that the second finger moves in the first direction along the x-axis.