US 12,437,367 B2
Real-time try-on using body landmarks
Avihay Assouline, Tel Aviv (IL); Nir Malbin, Shoham (IL); Iason Kokkinos, London (GB); Riza Alp Guler, London (GB); Himmy Tam, London (GB); and Mohammad Rami Koujan, London (GB)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Dec. 19, 2022, as Appl. No. 18/068,383.
Claims priority of application No. 20220100947 (GR), filed on Nov. 16, 2022.
Prior Publication US 2024/0161242 A1, May 16, 2024
Int. Cl. G06T 5/50 (2006.01); G06T 7/70 (2017.01); G06V 10/74 (2022.01); G06V 10/82 (2022.01)
CPC G06T 5/50 (2013.01) [G06T 7/70 (2017.01); G06V 10/761 (2022.01); G06V 10/82 (2022.01); G06T 2207/20221 (2013.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by one or more processors, a first image that includes a depiction of a first person wearing a fashion item in a first pose;
obtaining a second image that includes a depiction of a second person in a second pose;
generating a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person in the second pose;
computing a deviation between the first set of body landmarks and the second set of body landmarks;
determining, based on the first set of body landmarks and the second set of body landmarks, one or more adjustments to the first pose of the first person, depicted in the first image that has been captured by an image capture device, that correspond to the second pose of the second person and modifications to one or more visual parameters of the fashion item depicted in the first image as being worn by the first person that correspond to the second pose of the second person to enable placement of the fashion item worn by the first person on the second person; and
generating a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks and the determined one or more adjustments and modifications.