US 11,657,546 B2
End-to-end relighting of a foreground object technical
Xin Sun, Sunnyvale, CA (US); Ruben Villegas, Ann Arbor, MI (US); Manuel Lagunas Arto, San Jose, CA (US); Jimei Yang, Merced, CA (US); and Jianming Zhang, Campbell, CA (US)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on May 24, 2022, as Appl. No. 17/664,800.
Application 17/664,800 is a continuation of application No. 16/823,092, filed on Mar. 18, 2020, granted, now 11,380,023.
Prior Publication US 2022/0284640 A1, Sep. 8, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 7/11 (2017.01); G06T 7/194 (2017.01); G06T 7/90 (2017.01); G06T 11/00 (2006.01)
CPC G06T 11/001 (2013.01) [G06T 7/11 (2017.01); G06T 7/194 (2017.01); G06T 7/90 (2017.01); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
1. A computer-implemented method comprising:
receiving an image including a foreground object and a background;
segmenting the foreground object relative to the background to produce a segmented image;
processing the segmented image with an encoder to convert the segmented image into a feature vector;
concatenating the feature vector with spherical harmonic coefficients of a target illumination for the image;
generating an albedo map influenced by the target illumination from the feature vector concatenated with the spherical harmonic coefficients of the target illumination utilizing an albedo decoder; and
generating a relight image of the image based on the albedo map influenced by the target illumination.