US 12,002,179 B2
Augmented image adjustment of user based on possible actions or non-actions
Jorge Arroyo Palacios, San Mateo, CA (US); and Todd Tokubo, San Mateo, CA (US)
Assigned to Sony Interactive Entertainment Inc., Tokyo (JP)
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Oct. 8, 2021, as Appl. No. 17/497,712.
Prior Publication US 2023/0115716 A1, Apr. 13, 2023
Int. Cl. G06T 19/20 (2011.01); A63B 24/00 (2006.01); A63B 71/06 (2006.01); G06T 17/20 (2006.01); G06T 19/00 (2011.01); G06V 20/20 (2022.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01)
CPC G06T 19/20 (2013.01) [A63B 24/0006 (2013.01); A63B 71/0622 (2013.01); G06T 17/20 (2013.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); G06V 40/103 (2022.01); G06V 40/23 (2022.01); A63B 2071/0636 (2013.01); G06T 2219/2021 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method for augmenting image content presented on a mirror display, comprising:
detecting images of a user in an activity volume in front of the mirror display, the detecting includes identifying a body of the user and tracking movements by the user while in the activity volume;
receiving a request to predict a change in physique of the body of the user, the request includes input parameters that identify a physical exercise and an amount of said physical exercise;
generating an augmented image of the body of the user, the augmented image of the body has said change in physique, the change in physique of the body is assembled from one or more three-dimensional (3D) models of one or more body parts of the body that have been adjusted in shape; and
presenting, on the mirror display, the augmented image of the body of the user as a video overlay over images of the user captured when the user is in the activity volume, the presenting is responsive to processing said request to predict the change in physique of the body of the user;
wherein the assembling of the change in physique of the body blends together the one or more 3D models causing adjoining 3D models to appear dynamically integrated along a boundary between the adjoining 3D models.