US 12,475,621 B2
Product image generation based on diffusion model
Avihay Assouline, Tel Aviv (IL); Itamar Berger, Hod Hasharon (IL); and Jonathan Heimann, Herzliya (IL)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Apr. 20, 2023, as Appl. No. 18/304,181.
Prior Publication US 2024/0355019 A1, Oct. 24, 2024
Int. Cl. G06T 11/60 (2006.01); G06F 40/20 (2020.01); G06F 40/40 (2020.01); G06T 7/10 (2017.01); G06T 7/60 (2017.01); G06T 11/00 (2006.01); G06V 10/776 (2022.01); G06V 20/20 (2022.01)
CPC G06T 11/60 (2013.01) [G06F 40/20 (2020.01); G06F 40/40 (2020.01); G06T 7/10 (2017.01); G06T 7/60 (2013.01); G06T 11/001 (2013.01); G06V 10/776 (2022.01); G06V 20/20 (2022.01); G06T 2200/24 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20092 (2013.01); G06T 2207/20132 (2013.01); G06T 2207/30201 (2013.01); G06T 2210/16 (2013.01); G06T 2210/22 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving an image depicting a real-world object;
generating a prompt comprising a textual description of a fashion item;
analyzing the image and the textual description of the fashion item using a generative machine learning model to generate an artificial image that depicts an artificial object that resembles the real-world object wearing an artificial fashion item having visual attributes specified by the textual description of the fashion item;
searching a database of images of real-world products based on the prompt;
comparing visual attributes of extracted pixels of the artificial fashion item with visual attributes of the images of the real-world products stored in the database;
identifying an object comprising an individual image depicting an individual real-world product of the images of the real-world products for which a difference between a set of visual attributes of the individual image of the individual real-world product and the visual attributes of the artificial fashion item is smaller than a reference value; and
replacing the artificial fashion item in the artificial image with the object comprising the individual image of the individual real-world product to generate an output image.