US 12,456,224 B2
Augmented reality experiences of color palettes in a messaging system
Jean Luo, Seattle, WA (US); and Celia Nicole Mourkogiannis, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Feb. 12, 2024, as Appl. No. 18/439,350.
Application 18/439,350 is a continuation of application No. 18/056,060, filed on Nov. 16, 2022, granted, now 11,922,661.
Application 18/056,060 is a continuation of application No. 17/205,891, filed on Mar. 18, 2021, granted, now 11,521,334.
Claims priority of provisional application 63/003,464, filed on Apr. 1, 2020.
Prior Publication US 2024/0185460 A1, Jun. 6, 2024
Int. Cl. G06T 7/80 (2017.01); G06T 7/40 (2017.01); G06T 11/00 (2006.01); G06T 11/60 (2006.01); G06V 10/56 (2022.01); G06V 20/20 (2022.01); G06V 40/16 (2022.01); G06V 40/20 (2022.01); G09G 5/02 (2006.01); H04L 51/10 (2022.01); H04N 1/60 (2006.01)
CPC G06T 7/80 (2017.01) [G06T 7/40 (2013.01); G06T 11/001 (2013.01); G06T 11/60 (2013.01); G06V 10/56 (2022.01); G06V 20/20 (2022.01); G06V 40/165 (2022.01); G06V 40/28 (2022.01); H04L 51/10 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
analyzing first image data to determine an object corresponding to a beauty product, the analyzing based at least in part on a recognition process performed on the first image data wherein the recognition process further comprises:
classifying, using a first image classifier, the first image data to determine that the object includes a physical identification indicator, and
classifying, using a second image classifier, the first image data to perform object classification of the object based on a set of 3D models or images;
identifying a set of colors corresponding to the beauty product, and the identified set of colors corresponds to a second set of colors included in a portion of the first image data including a set of regions of the object, and wherein each region of the set of regions is associated with a particular color;
identifying a body part of a user based on second image data; and
generating augmented reality content based at least in part on the identified set of colors and the identified body part of the user.