US 12,105,891 B2
Steerable camera for AR hand tracking
Daniel Colascione, Melbourne Beach, FL (US); Patrick Timothy McSweeney Simons, Downey, CA (US); Weston Welge, Boulder, CO (US); and Ramzi Zahreddine, Denver, CO (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jul. 24, 2023, as Appl. No. 18/357,607.
Application 18/357,607 is a continuation of application No. 17/950,825, filed on Sep. 22, 2022, granted, now 11,747,912.
Prior Publication US 2024/0103631 A1, Mar. 28, 2024
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01); G06T 19/00 (2011.01)
CPC G06F 3/017 (2013.01) [G02B 27/017 (2013.01); G06F 3/011 (2013.01); G06T 19/006 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0178 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
capturing, by one or more processors, using a first camera of an Augmented Reality (AR) system, tracking video frame data of a hand of a user of the AR system;
determining, by the one or more processors, a location of the hand of the user using the tracking video frame data; and
focusing, by the one or more processors, a steerable camera of the AR system on the hand of the user using the location;
wherein the first camera is the steerable camera, the method further comprising:
scanning, by the one or more processors, using the steerable camera, an AR Field Of View (FOV) of the AR system to initially locate the hand of the user;
using, by the one or more processors, a look-ahead process to predict a next location of the hand of the user based on a current location of the hand; and
focusing, by the one or more processors, the steerable camera on the next location.