US 12,136,178 B2
Validation of modeling and simulation of virtual try-on of wearable device
Idris Syed Aleem, Kitchener (CA); and Rees Anwyl Samuel Simmons, Waterloo (CA)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Feb. 9, 2022, as Appl. No. 17/650,470.
Prior Publication US 2023/0252745 A1, Aug. 10, 2023
Int. Cl. G06T 19/20 (2011.01); G06N 20/00 (2019.01)
CPC G06T 19/20 (2013.01) [G06N 20/00 (2019.01); G06T 2219/2004 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A method, comprising:
capturing, by an image capture assembly of a computing system, a base image, the base image including a body portion of a user on which a wearable device is to be worn;
capturing, by the image capture assembly, a reference image;
detecting, in the reference image:
the wearable device worn by the user; and
at least one measurement associated with the wearable device and at least one facial landmark or optical landmark detected in the reference image;
generating, by a simulation module of the computing system, a rendered image, the rendered image including a virtual rendering of the wearable device detected in the reference image positioned on the base image, a placement position of the virtual rendering of the wearable device on the body portion of the user in the base image being determined by a machine learning model associated with the simulation module;
comparing the at least one measurement associated with the wearable device and the at least one facial landmark or optical landmark detected in the reference image to a corresponding measurement associated with the virtual rendering of the wearable device in the rendered image; and
in response to a determination that a difference between the at least one measurement associated with the wearable device detected in the reference image and the corresponding measurement in the rendered image is greater than or equal to a threshold value, triggering training of the machine learning model to adjust the placement position of the virtual rendering of the wearable device on the body portion of the user in the base image.