US 12,141,340 B2
Muscle group movement tracking using RF sensors
Jouya Jadidian, Los Gatos, CA (US); and Gabriele D'Amone, Mountain View, CA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Feb. 16, 2023, as Appl. No. 18/170,055.
Prior Publication US 2024/0281056 A1, Aug. 22, 2024
Int. Cl. G06T 19/00 (2011.01); G02B 3/00 (2006.01); G02B 30/40 (2020.01); G06F 3/01 (2006.01); G06F 3/0488 (2022.01); G06F 3/14 (2006.01); G06F 3/147 (2006.01); G06T 11/00 (2006.01); G06T 13/40 (2011.01); G09G 3/32 (2016.01)
CPC G06F 3/012 (2013.01) [G02B 3/005 (2013.01); G02B 30/40 (2020.01); G06F 3/1423 (2013.01); G06F 3/147 (2013.01); G06T 11/00 (2013.01); G06T 13/40 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A head-mounted mixed-reality (MR) device that is wearable by a user, said MR device comprising:
a user-facing display that displays user-directed content, wherein the user-directed content is visible from a first position of a user who is wearing the MR device;
a radio frequency (RF) sensor that obtains scattering parameter data, wherein the RF sensor generates a set of scattering parameters that reflect a movement of conductive matter of the user; and
an outward-facing display that displays outward-directed content, wherein:
the outward-directed content is visible from a second position that is external relative to the position of the user who is wearing the MR device,
the outward-directed content is based on an image file that represents a face of the user,
the image file includes a set of coefficients that, if modified, changes an appearance of the user's face as represented by the image file,
the scattering parameters are used to update the set of coefficients, resulting in the changes to the appearance of the user's face as represented by the image file, and updating the set of coefficients is further based on the movement of the conductive matter of the user, the conductive matter corresponding to the user's face, and
after the set of coefficients are updated, at least a portion of the image file is displayed on the outward-facing display.