CPC G06T 7/292 (2017.01) [G06F 3/011 (2013.01); G06T 7/564 (2017.01); G06T 19/006 (2013.01); G06V 20/64 (2022.01); G06T 2207/10012 (2013.01); G06T 2207/10028 (2013.01); G06T 2210/56 (2013.01)] | 20 Claims |
1. A method comprising:
accessing a first frame from a camera of a display device;
tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame;
detecting, using a sensor of the display device, depths of the hand pixels;
tracking a motion of a left hand and a right hand of a user of the display device;
carving a 3D region that includes a 3D hull of a physical object based on the motion of the left hand and the right hand relative to the physical object;
identifying the 3D region based on the depths of the hand pixels; and
applying a 3D reconstruction engine to the 3D region.
|