US 11,747,912 B1
Steerable camera for AR hand tracking
Daniel Colascione, Seattle, WA (US); Patrick Timothy McSweeney Simons, Downey, CA (US); Weston Welge, Boulder, CO (US); and Ramzi Zahreddine, Denver, CO (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Sep. 22, 2022, as Appl. No. 17/950,825.
Int. Cl. G06F 3/01 (2006.01); G06T 19/00 (2011.01); G02B 27/01 (2006.01)
CPC G06F 3/017 (2013.01) [G02B 27/017 (2013.01); G06F 3/011 (2013.01); G06T 19/006 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0178 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
capturing, by one or more processors, using a first camera of an Augmented Reality (AR) system, tracking video frame data of a hand of a user of the AR system;
generating, by the one or more processors, a skeletal model based on the tracking video frame data;
determining, by the one or more processors, a location of the hand of the user based on the skeletal model;
generating, by the one or more processors, camera steering command data based on the location of the hand of the user; and
focusing, by the one or more processors, a steerable camera of the AR system on the hand of the user.