US 12,423,910 B2
3D wrist tracking
Roman Furko, Marina del Rey, CA (US); Vladyslav Horbatiuk, Kyiv (UA); Amir Iagudin, Moscow (RU); and James Supancic, III, Irvine, CA (US)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Dec. 5, 2022, as Appl. No. 18/061,752.
Prior Publication US 2024/0185512 A1, Jun. 6, 2024
Int. Cl. G06T 15/20 (2011.01); G06T 7/246 (2017.01); G06T 19/00 (2011.01); G06V 20/20 (2022.01); G06V 20/40 (2022.01); G06V 40/10 (2022.01)
CPC G06T 15/205 (2013.01) [G06T 7/246 (2017.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); G06V 20/46 (2022.01); G06V 40/107 (2022.01); G06T 2207/10016 (2013.01); G06T 2207/30196 (2013.01); G06T 2215/16 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A computing system comprising:
one or more processors;
one or more cameras; and
a memory storing instructions that, when executed by the one or more processors, cause the computing system to perform operations comprising:
capturing, using the one or more cameras, video frame tracking data of a wrist of a user;
generating 3D parameter data describing a 3D model of the wrist of the user based on the video frame tracking data;
correcting the 3D parameter data of the wrist of the user based on 2D loss data generated using a 2D projection of the 3D parameter data describing the 3D model of the wrist of the user onto an image of the wrist of the user;
generating 3D render data of a virtual item based on the 3D parameter data of the wrist of the user and 3D model data of a physical item represented by the virtual item;
generating Augmented Reality (AR) user interface video frame data based on the 3D render data and the video frame tracking data; and
providing an AR user interface based on the AR user interface video frame data.