US 11,861,070 B2
Hand gestures for animating and controlling virtual and graphical elements
Viktoria Hwang, Los Angeles, CA (US); and Karen Stolzenberg, Venice, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Apr. 13, 2022, as Appl. No. 17/719,654.
Claims priority of provisional application 63/176,644, filed on Apr. 19, 2021.
Prior Publication US 2022/0334649 A1, Oct. 20, 2022
Int. Cl. G06F 3/04815 (2022.01); G06F 3/01 (2006.01); G06V 40/10 (2022.01); G06V 20/40 (2022.01); G06V 40/20 (2022.01); G02B 27/01 (2006.01); G06F 3/04817 (2022.01); G06F 3/0482 (2013.01)
CPC G06F 3/017 (2013.01) [G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G06F 3/011 (2013.01); G06F 3/0482 (2013.01); G06F 3/04815 (2013.01); G06F 3/04817 (2013.01); G06V 20/46 (2022.01); G06V 40/113 (2022.01); G06V 40/28 (2022.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0178 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A method of controlling a graphical element in response to hand gestures detected with an eyewear device, the eyewear device comprising a camera system, an image processing system, and a display, the method comprising:
capturing frames of video data with the camera system;
detecting a hand at a current hand location relative to the display in the captured frames of video data with the image processing system;
presenting on the display a menu icon at a current icon position, in accordance with the detected current hand location;
detecting a first series of hand shapes in the captured frames of video data with the image processing system;
determining, with the image processing system, whether the detected first series of hand shapes matches a first predefined hand gesture among a plurality of predefined hand gestures;
presenting on the display one or more graphical elements adjacent the current icon position in accordance with the matching first predefined hand gesture, wherein the presenting comprises animating a progression of a first graphical element along a first path extending away from the current icon position, such that the first graphical element appears to emerge from the menu icon, wherein an apparent progression speed of the animated progression is correlated with the detected first series of hand shapes;
detecting a second series of hand shapes in the captured frames of video data with the image processing system;
determining, with the image processing system, whether the detected second series of hand shapes matches a second predefined hand gesture among a plurality of predefined hand gestures; and
removing from the display the one or more graphical elements in accordance with the matching second predefined hand gesture, wherein the removing comprises animating a regression of the first graphical element along the first path extending toward the current icon position, such that the first graphical element appears to withdraw into the menu icon, wherein an apparent regression speed of the animated regression is correlated with the detected second series of hand shapes.