US 12,136,173 B2
Digital makeup palette
Mindy Christine Troutman, New York, NY (US); Sandrine Gadol, New York, NY (US); and Francesca D. Cruz, Sleepy Hollow, NY (US)
Assigned to L'Oreal, Paris (FR)
Filed by L'OREAL, Paris (FR)
Filed on Dec. 30, 2020, as Appl. No. 17/138,031.
Prior Publication US 2022/0202168 A1, Jun. 30, 2022
Int. Cl. G06T 19/00 (2011.01); A45D 44/00 (2006.01); G06V 10/44 (2022.01); G06V 40/16 (2022.01); G06N 3/08 (2023.01)
CPC G06T 19/006 (2013.01) [A45D 44/005 (2013.01); G06V 10/449 (2022.01); G06V 40/171 (2022.01); G06N 3/08 (2013.01); G06T 2207/30201 (2013.01)] 18 Claims
OG exemplary drawing
 
1. An augmented reality system for makeup, comprising:
a makeup objective unit including computation circuitry operably coupled to a graphical user interface configured to generate one or more instances of user selectable makeup objectives and to receive user-selected makeup objective information that includes a user experience level in applying makeup;
a makeup palette unit operably coupled to the makeup objective unit, the makeup palette unit including computation circuitry configured to generate at least one digital makeup palette for a digital makeup product;
a virtual makeup try-on unit including computation circuitry configured to track and record face application areas on a user's face image, analyze makeup swipes during the tracking to estimate problem areas and emphasized facial features in the user's face, and store the estimated problem areas and the emphasized facial features in a database, wherein while tracking face application areas, the computation circuitry is configured to analyze swipes based on the level of experience of the user to determine whether a swipe is applied in error, and in a case where the swipe is applied in error, allow redoing the makeup swipes;
a makeup objective visualization unit including computation circuitry configured to analyze a user's face to determine one or more of face shape, facial landmarks, skin tone, hair color, eye color, lip shape, eyelid shape, hair style and lighting, and automatically create one or more instances of a custom virtual try-on for a user in accordance with the user-selected makeup objective information including the user experience level, and the at least one digital makeup palette generated based on the analysis of the user's face; and
the computation circuitry further configured to select at least one makeup filter from the database based on the at least one digital makeup palette, and create the custom virtual try-on for the user using the at least one makeup filter,
wherein at least one makeup filter is formed using the previously recorded estimated problem areas and emphasized facial features.