US 12,299,775 B2
Augmented reality experience with lighting adjustment
Hanna Davidovich, Ramat Gan (IL); Nir Malbin, Shoham (IL); and Avihay Assouline, Tel Aviv (IL)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Feb. 20, 2023, as Appl. No. 18/111,632.
Prior Publication US 2024/0282015 A1, Aug. 22, 2024
Int. Cl. G06T 11/00 (2006.01); G06T 5/50 (2006.01)
CPC G06T 11/00 (2013.01) [G06T 5/50 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30196 (2013.01); G06T 2210/16 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
accessing, by a user system, an image that depicts a real-world person;
retrieving, by the user system, an augmented reality (AR) fashion item;
estimating a lighting adjustment for the AR fashion item by applying a machine learning model to the image and the AR fashion item using lighting properties of the real-world person depicted in the image, the machine learning model trained to match lighting properties of AR objects to lighting properties of images depicting real-world objects, the machine learning model receiving both the image that depicts the real-world person and the AR fashion item, and the machine learning model predicting the lighting adjustment for the AR fashion item based on receiving both the image that depicts the real-world person and the AR fashion item; and
generating a modified image by combining the AR fashion item with the image that depicts the real-world person using the estimated lighting adjustment.