US 11,900,504 B2
Augmented reality experiences for physical products in a messaging system
Erika Michele Kehrwald, Venice, CA (US); Oleksii Kholovchuk, Marina Del Rey, CA (US); Gabriel Lupin, Marina del Rey, CA (US); Trevor Stephenson, Camarillo, CA (US); Artem Yerofieiev, Marina del Rey, CA (US); and Jialu Zhao, Santa Monica, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Mar. 24, 2021, as Appl. No. 17/301,087.
Claims priority of provisional application 63/002,956, filed on Mar. 31, 2020.
Prior Publication US 2021/0304453 A1, Sep. 30, 2021
Int. Cl. G06T 11/00 (2006.01); G06F 3/04883 (2022.01); H04L 51/046 (2022.01); G06F 3/0482 (2013.01)
CPC G06T 11/00 (2013.01) [G06F 3/0482 (2013.01); G06F 3/04883 (2013.01); H04L 51/046 (2013.01); G06T 2200/24 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method, comprising:
selecting a set of augmented reality content generators from a plurality of available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for providing augmented reality content based on a product, wherein selecting the set of augmented reality content generators comprises:
receiving, by a product catalog system, an indicator of a selected augmented reality content generator, and
performing, by the product catalog system, a lookup operation on a product table to retrieve product metadata, the product metadata comprising a product identifier, a product augmented reality experience identifier, and information related to a particular product corresponding to the product identifier, wherein the product metadata corresponding to the product is provided by a product catalog service system, the product catalog system and the product catalog service system are different systems, and further comprising:
sending, by the product catalog system, a request message to the product catalog service system for obtaining metadata related to a respective physical item, the request message including the product identifier,
performing, by the product catalog service system, a query based on the product identifier in the request message for information related to the respective physical item,
in response to the request message, providing, by the product catalog service system, a response message to the product catalog system, the response message including the information related to the respective physical item, the information related to the respective physical item comprising particular information indicating a price, a product description, a return policy, and vendor, and
storing, by the product catalog system, the information related to the respective physical item into the product table;
causing display of a particular interface, the particular interface including a tabbed menu, the tabbed menu including a selectable graphical element corresponding to a particular option to display an arrangement of a particular set of products based on the product metadata from the product table;
receiving a selection of the particular option from the tabbed menu;
causing, in response to receiving the selection of the particular option, display, in the particular interface, of the arrangement of the particular set of products based on the product metadata from the product table;
selecting, using the particular set of products displayed in the particular interface, a set of corresponding augmented reality content generators for inclusion in a carousel interface;
causing display of the carousel interface comprising a plurality of selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator of the selected set of corresponding augmented reality content generators;
receiving, at a client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator for applying first augmented reality content based on the product;
applying, to first image data, the first augmented reality content generator corresponding to the selected first selectable graphical item, the first image data being captured with a camera; and
causing a display of second image data, the second image data including the applied first augmented reality content generator to the first image data.