US 11,734,894 B2
Real-time motion transfer for prosthetic limbs
Avihay Assouline, Tel Aviv (IL); Itamar Berger, Hod Hasharon (IL); Gal Dudovitch, Tel Aviv (IL); and Matan Zohar, Rishon LeZion (IL)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Nov. 18, 2020, as Appl. No. 16/951,939.
Prior Publication US 2022/0157025 A1, May 19, 2022
Int. Cl. G06T 19/00 (2011.01); G06T 7/20 (2017.01); G06T 7/246 (2017.01); G06V 40/10 (2022.01); G06T 17/20 (2006.01)
CPC G06T 19/006 (2013.01) [G06T 7/251 (2017.01); G06T 17/20 (2013.01); G06V 40/10 (2022.01); G06T 2207/10016 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20212 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by one or more processors, a video that depicts a person;
identifying a set of skeletal joints corresponding to limbs of the person;
tracking three-dimensional (3D) movement of the set of skeletal joints corresponding to the limbs of the person in the video without using depth sensor information;
causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video;
mapping a first set of the plurality of limbs of the 3D virtual object to a first subset of the set of skeletal joints, movement of the first set of the plurality of limbs tracking movement of the first subset of the set of skeletal joints; and
moving the one or more extra limbs of the 3D virtual object that are not included in the first set of the plurality of limbs of the 3D virtual object based on movement of the first subset of the set of skeletal joints.