US 11,875,439 B2
Augmented expression system
Chen Cao, Los Angeles, CA (US); Yang Gao, Toronto (CA); and Zehao Xue, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Apr. 15, 2020, as Appl. No. 16/849,397.
Application 16/849,397 is a continuation of application No. 16/387,092, filed on Apr. 17, 2019, granted, now 10,719,968.
Claims priority of provisional application 62/659,337, filed on Apr. 18, 2018.
Prior Publication US 2020/0242826 A1, Jul. 30, 2020
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 13/20 (2011.01); G06K 9/00 (2022.01); G06T 7/73 (2017.01); G06T 9/00 (2006.01); G06T 19/20 (2011.01); G06T 13/40 (2011.01); G06T 7/246 (2017.01); G06T 19/00 (2011.01); G06V 40/16 (2022.01)
CPC G06T 13/20 (2013.01) [G06T 7/73 (2017.01); G06T 13/40 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); G06V 40/174 (2022.01); G06T 2207/30201 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A method comprising:
receiving an input that assigns a graphical element from among a plurality of graphical elements to an expression within a data repository associated with a client device;
causing display of a presentation of image data at the client device, the image data depicting a set of facial landmarks of a user;
determining attributes of the set of facial landmarks, the attributes including at least a size and a shape of each facial landmark among the set of facial landmarks;
generating a 3D model comprises characteristics that corresponds with the attributes of the set of facial landmarks, and user profile data associated with the user;
receiving a facial tracking input that comprises a movement of a facial landmark from among the set of facial landmarks of the user;
detecting the expression assigned to the graphical element within the presentation of the image data based on the movement of the facial landmark from among the set of facial landmarks;
accessing the graphical element that corresponds with the expression from within the data repository based on the input that assigns the graphical element to the expression within the data repository responsive to the detecting the expression within the presentation of the image data;
applying the graphical element to a position upon the 3D model at the client device; and
generating a message that includes a presentation of the 3D model that includes the graphical element.