US 12,357,911 B2
Tracking hand gestures for interactive game control in augmented reality
Ilteris Canberk, Marina Del Rey, CA (US); Dmytro Kucher, Odessa (UA); Dmytro Hovorov, Luhansk (UA); and Artur Sydoran, Uzhhorod (UA)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jan. 8, 2024, as Appl. No. 18/407,308.
Application 18/407,308 is a continuation of application No. 17/024,800, filed on Sep. 18, 2020, granted, now 11,925,863.
Prior Publication US 2024/0157235 A1, May 16, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. A63F 13/428 (2014.01); A63F 13/213 (2014.01); A63F 13/26 (2014.01); A63F 13/537 (2014.01); G06F 3/01 (2006.01); G06F 3/042 (2006.01); G06F 3/04817 (2022.01); G06T 11/60 (2006.01)
CPC A63F 13/428 (2014.09) [A63F 13/213 (2014.09); A63F 13/26 (2014.09); A63F 13/537 (2014.09); G06F 3/017 (2013.01); G06F 3/0425 (2013.01); G06F 3/04817 (2013.01); G06T 11/60 (2013.01); A63F 2300/8082 (2013.01); G06T 2210/12 (2013.01); G06T 2210/21 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of presenting an interactive game in augmented reality, the method comprising:
capturing frames of video data with a camera coupled to an eyewear device comprising a processor, a memory, a hand tracking utility, and a display;
presenting on the display a virtual field of play comprising a distal location and a scoring location, wherein the virtual field of play is persistently viewable as an overlay relative to a physical environment, independent of movement of the eyewear device relative to the physical environment,
presenting on the display a first icon in apparent motion from the distal location toward the scoring location on the virtual field of play;
detecting in the frames of video data, with the hand tracking utility, a final hand shape;
selecting a final virtual game piece from a set of virtual game pieces based on the final hand shape;
presenting on the display the final virtual game piece as an overlay relative to the final hand shape;
detecting a final hand location associated with the final hand shape relative to the scoring location; and
incrementing a game score on the display if the final virtual game piece matches the first icon and the final hand location matches the scoring location.