US 12,477,079 B2
Facial synthesis in overlaid augmented reality content
Nikita Demidov, London (GB); Roman Golobokov, London (GB); Alina Melnyk, Kyiv (UA); Jeremy Baker Voss, Los Angeles, CA (US); and Aleksei Bromot, London (GB)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Apr. 19, 2024, as Appl. No. 18/640,447.
Application 18/640,447 is a continuation of application No. 17/706,035, filed on Mar. 28, 2022, granted, now 12,003,883.
Claims priority of provisional application 63/168,989, filed on Mar. 31, 2021.
Prior Publication US 2024/0267485 A1, Aug. 8, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 5/00 (2011.01); G06T 11/60 (2006.01); G06T 19/00 (2011.01); G06V 10/82 (2022.01); G06V 40/16 (2022.01); H04L 51/21 (2022.01); H04L 51/52 (2022.01); H04N 5/272 (2006.01)
CPC H04N 5/272 (2013.01) [G06T 11/60 (2013.01); G06T 19/006 (2013.01); G06V 10/82 (2022.01); G06V 40/166 (2022.01); H04L 51/21 (2022.05); H04L 51/52 (2022.05); H04N 2005/2726 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method, comprising:
generating, by one or more hardware processors, a digital sticker, the digital sticker including graphical content indicating information based at least in part based on at least one signal and media content including an image of a target face, the image of the target face being modified based on at least one of sets of source pose parameters to mimic at least one of positions of a head of a source actor and at least one of facial expressions of the source actor, the generating comprising:
performing a lookup in an augmented reality (AR) image database based at least in part on the at least one signal from a computing device, wherein the AR image database comprises a database storing a set of images for including in AR content;
determining that first metadata associated with a particular image from the set of images matches second metadata associated with the at least one signal, the first metadata comprising information indicating a type of signal corresponding to a current time, battery power, sensor information, or location information, the second metadata comprising information indicating that the particular image is related to the current time, battery power, sensor information, or location information; and
selecting the particular image for generating, in part, the digital sticker;
providing, by the one or more hardware processors, augmented reality content for display on a computing device, the augmented reality content including the digital sticker as an overlay on at least a portion of the augmented reality content; and
sending the augmented reality content, including the digital sticker, as a message to a user in a messaging system.