US 12,260,567 B2
3D space carving using hands for object capture
Branislav Micusik, St. Andrae-Woerdern (AT); Georgios Evangelidis, Vienna (AT); and Daniel Wolf, Mödling (AT)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Oct. 25, 2022, as Appl. No. 17/973,167.
Claims priority of application No. 20220100720 (GR), filed on Sep. 1, 2022.
Prior Publication US 2024/0135555 A1, Apr. 25, 2024
Prior Publication US 2024/0233144 A9, Jul. 11, 2024
Int. Cl. G06T 7/292 (2017.01); G06F 3/01 (2006.01); G06T 7/564 (2017.01); G06T 19/00 (2011.01); G06V 20/64 (2022.01)
CPC G06T 7/292 (2017.01) [G06F 3/011 (2013.01); G06T 7/564 (2017.01); G06T 19/006 (2013.01); G06V 20/64 (2022.01); G06T 2207/10012 (2013.01); G06T 2207/10028 (2013.01); G06T 2210/56 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
accessing a first frame from a camera of a display device;
tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame;
detecting, using a sensor of the display device, depths of the hand pixels;
tracking a motion of a left hand and a right hand of a user of the display device;
carving a 3D region that includes a 3D hull of a physical object based on the motion of the left hand and the right hand relative to the physical object;
identifying the 3D region based on the depths of the hand pixels; and
applying a 3D reconstruction engine to the 3D region.