US 11,657,553 B2
Digital makeup artist
Mindy Christine Troutman, New York, NY (US); Sandrine Gadol, New York, NY (US); and Francesca D. Cruz, Sleepy Hollow, NY (US)
Assigned to L'OREAL, Paris (FR)
Filed by L'OREAL, Paris (FR)
Filed on Dec. 30, 2020, as Appl. No. 17/138,078.
Prior Publication US 2022/0207801 A1, Jun. 30, 2022
Int. Cl. G06T 11/60 (2006.01); G06T 11/00 (2006.01); G06N 20/00 (2019.01); G10L 15/22 (2006.01); G06V 40/16 (2022.01)
CPC G06T 11/60 (2013.01) [G06N 20/00 (2019.01); G06T 11/001 (2013.01); G06V 40/165 (2022.01); G06V 40/166 (2022.01); G06V 40/171 (2022.01); G10L 15/22 (2013.01); G10L 2015/223 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A digital makeup artist system, comprising:
a mobile device having a display device, computation circuitry, and a memory;
a database system storing cosmetic routine information, common makeup looks, cosmetic products for skin types and ethnicity, and user look preferences of a user;
a machine learning system for analyzing an image of a face; and
the mobile device includes a user interface for interacting with a digital video makeup artist, wherein the digital video makeup artist performs an interactive dialog with the user in order to capture needs of the user, including one or more of facial problem areas, favorite facial features;
the computation circuitry is configured to:
input a face image of the user,
analyze, via the machine learning system, the user's face image to identify face parts,
and
generate image frames for a video to be displayed on the display device in synchronization with the interaction with the digital video makeup artist,
wherein the image frames are generated based on the analyzed face image of the user, the needs of the user obtained through the interactions with the user, one or more of the stored cosmetic routine information, common makeup looks, cosmetic products for skin types and ethnicity, and the user look preferences,
wherein the computation circuitry is configured to play the video by displaying the generated image frames at a predetermined playback rate,
wherein the video includes chapters, where each chapter is a step in a makeup routine, and
wherein the input includes a video control command to control playing of the video.