US 12,367,616 B2
Controlling interactive fashion based on facial expressions
Itamar Berger, Hod Hasharon (IL); Gal Dudovitch, Tel Aviv (IL); Gal Sasson, Kibbutz Ayyelet Hashahar (IL); Ma'ayan Mishin Shuvi, Givatayim (IL); and Matan Zohar, Rishon LeZion (IL)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Oct. 3, 2023, as Appl. No. 18/376,161.
Application 18/376,161 is a continuation of application No. 17/470,231, filed on Sep. 9, 2021, granted, now 11,900,506.
Prior Publication US 2024/0029322 A1, Jan. 25, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 11/00 (2006.01); G06Q 30/0601 (2023.01); G06V 40/16 (2022.01)
CPC G06T 11/00 (2013.01) [G06Q 30/0643 (2013.01); G06V 40/168 (2022.01); G06V 40/174 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
activating an augmented reality makeup experience;
applying augmented reality makeup to a body part of a person depicted in an image of a video;
determining a style of the augmented reality makeup applied to the body part of the person;
selecting, as one or more augmented reality elements, a fashion item pattern, type or style corresponding to the style of the augmented reality makeup applied to the body part of the person, the style of the augmented reality makeup being associated with an animal and comprising one or more characteristics of the animal associated with the augmented reality makeup applied to the body part of the person;
determining a type of fashion item worn by the person depicted in the image based on a distance between a position of a skeletal point and an edge of a border of a segmentation of the fashion item; and
applying, based on the type of fashion item, the one or more augmented reality elements to the video concurrently with the augmented reality makeup in response to determining the style of the augmented reality makeup applied to the body part of the person in the image of the video.