US 12,136,153 B2
Messaging system with augmented reality makeup
Jean Luo, Seattle, WA (US); and Celia Nicole Mourkogiannis, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jan. 19, 2023, as Appl. No. 18/099,148.
Application 18/099,148 is a continuation of application No. 17/304,978, filed on Jun. 29, 2021, granted, now 11,580,682.
Claims priority of provisional application 63/046,236, filed on Jun. 30, 2020.
Prior Publication US 2023/0154084 A1, May 18, 2023
Int. Cl. G06T 11/00 (2006.01); G06F 18/20 (2023.01); G06F 18/214 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2023.01); G06T 11/60 (2006.01); G06V 40/10 (2022.01); H04L 51/18 (2022.01); G06F 3/0482 (2013.01)
CPC G06T 11/60 (2013.01) [G06F 18/214 (2023.01); G06F 18/285 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06V 40/10 (2022.01); H04L 51/18 (2013.01); G06F 3/0482 (2013.01); G06T 2200/24 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A system comprising:
at least one processor; and
a memory including instructions that, when executed by the processor, cause the at least one processor to perform operations comprising:
processing, using a first neural network, a first image of a first person with makeup to extract a makeup portion of the first image, the makeup portion representing the makeup applied to the first person of the first image, wherein the first neural network is trained to segment images into makeup portions and not makeup portions using training data of pairs of images of a person with makeup and a same person without makeup;
receiving input that indicates a selection to add the extracted makeup to a second image of a second person; and
processing the second image with a second neural network to add the extracted makeup to the second person in the second image, wherein the makeup portion of the first image is input to the second neural network.