US 12,307,006 B2
Egocentric human body pose tracking
Riku Arakawa, New York, NY (US); Gurunandan Krishnan Gorumkonda, Kirkland, WA (US); Shree K. Nayar, New York, NY (US); and Bing Zhou, Rye, NY (US)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Sep. 14, 2023, as Appl. No. 18/368,427.
Claims priority of provisional application 63/375,811, filed on Sep. 15, 2022.
Prior Publication US 2024/0103610 A1, Mar. 28, 2024
Int. Cl. G06F 3/01 (2006.01); G06F 3/0346 (2013.01); G06T 17/00 (2006.01)
CPC G06F 3/012 (2013.01) [G06F 3/0346 (2013.01); G06T 17/00 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
determining, by one or more processors, using a first Electromagnetic Field (EMF) tracking sensor, first EMF tracking data of a first wrist of a user;
determining, by the one or more processors, using a second EMF tracking sensor, second EMF tracking data of a second wrist of the user;
determining, by the one or more processors, using a Visual Inertial Odometry (VIO) tracking system, VIO tracking data of a head of the user;
determining, by the one or more processors, head pose data of the head of the user based on the VIO tracking data;
determining, by the one or more processors, first wrist pose data of the first wrist using the first EMF tracking data;
determining, by the one or more processors, second wrist pose data of the second wrist using the second EMF tracking data;
mapping, by the one or more processors, the head pose data to a first joint in a 3D body model, the first wrist pose data to a second joint of the 3D body model, and the second wrist pose data to a third joint of the 3D body model;
generating, by the one or more processors, full 3D body model data of the user based on the first joint, the second joint, the third joint, and an Inverse Kinematic (IK) model, the full 3D body model data including a full body pose of the user; and
communicating, by the one or more processors, the 3D body model data to an extended Reality (XR) application for use in an XR user interface for the user.