US 12,141,367 B2
Hand gestures for animating and controlling virtual and graphical elements
Viktoria Hwang, Los Angeles, CA (US); and Karen Stolzenberg, Venice, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Nov. 3, 2023, as Appl. No. 18/386,868.
Application 18/386,868 is a continuation of application No. 17/719,654, filed on Apr. 13, 2022, granted, now 11,861,070.
Claims priority of provisional application 63/176,644, filed on Apr. 19, 2021.
Prior Publication US 2024/0061515 A1, Feb. 22, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/0482 (2013.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06F 3/04817 (2022.01); G06V 20/40 (2022.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01)
CPC G06F 3/017 (2013.01) [G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G06F 3/011 (2013.01); G06F 3/04815 (2013.01); G06F 3/04817 (2013.01); G06F 3/0482 (2013.01); G06V 20/46 (2022.01); G06V 40/113 (2022.01); G06V 40/28 (2022.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0178 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method of controlling virtual elements in response to hand gestures detected with an eyewear device, the eyewear device comprising a camera system, an image processing system, and a display, the method comprising:
capturing frames of video data with the camera system;
detecting a hand at a current hand location relative to the display in the captured frames of video data using the image processing system, wherein detecting the hand comprises detecting a palm location and at least a first finger location relative to the palm location;
presenting on the display a virtual menu icon at a current icon position, in accordance with the detected current hand location, wherein the virtual menu icon is associated with at least a first virtual graphical menu element;
associating the first virtual graphical menu element with the first finger location; and
presenting on the display the first virtual graphical menu element along a first path relative to the current icon position based on the first finger location, such that the first virtual graphical menu element appears persistently correlated with the first finger location relative to the palm location, wherein presenting the first virtual graphical menu element comprises:
animating a progression of the first virtual graphical menu element along the first path extending away from the current icon position, such that the first virtual graphical menu element appears to emerge from the virtual menu icon, and
animating the progression of the first virtual graphical menu element along the first path at an apparent progression speed based on the first finger location relative to the palm location.