US 11,900,545 B2
Creating effects based on facial features
Nathanael Schager, Los Angeles, CA (US); Zhe Huang, Los Angeles, CA (US); Kewei Chen, Beijing (CN); Nite Luo, Los Angeles, CA (US); and Clement Boissiere, Los Angeles, CA (US)
Assigned to Lemon Inc., Grand Cayman (KY)
Filed by Lemon Inc., Grand Cayman (KY)
Filed on Jan. 6, 2022, as Appl. No. 17/570,304.
Prior Publication US 2023/0215099 A1, Jul. 6, 2023
Int. Cl. G06T 19/00 (2011.01); G06T 7/11 (2017.01); G06T 15/04 (2011.01); G06T 17/20 (2006.01)
CPC G06T 19/00 (2013.01) [G06T 7/11 (2017.01); G06T 15/04 (2013.01); G06T 17/20 (2013.01); G06T 2207/10016 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method, comprising:
generating a mesh comprising a set of vertices based on detecting key points of at least one facial part, wherein the at least one facial part is to be mapped to images depicting other things than the at least one facial part;
creating a mask based on rendering the mesh by inputting the mesh into a first pass of a multi-pass shader;
creating, by at least one of a second pass or a third pass of the multi-pass shader, a filter by applying a function to a texture based on the mask, wherein the at least one of the second pass or the third pass is configured to apply the function to the texture output from the first pass or the second pass;
performing an alpha cutout on an input texture by a fourth pass of the multi-pass shader, a result of the alpha cutout corresponding to the at least one facial part; and
creating an effect based on an extracted portion resulted from the alpha cutout, wherein the effect enables to map the at least one facial part to the images depicting other things than the at least one facial part.