US 11,915,398 B2
Relighting system for single images
Alexandros Neofytou, London (GB); Eric Chris Wolfgang Sommerlade, Oxford (GB); Sunando Sengupta, Reading (GB); and Yang Liu, Reading (GB)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Mar. 1, 2023, as Appl. No. 18/116,052.
Application 18/116,052 is a continuation of application No. 17/189,478, filed on Mar. 2, 2021, granted, now 11,615,512.
Prior Publication US 2023/0206406 A1, Jun. 29, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 5/00 (2006.01); G06F 18/214 (2023.01); G06N 3/08 (2023.01)
CPC G06T 5/005 (2013.01) [G06F 18/214 (2023.01); G06N 3/08 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method of relighting an input image, the method comprising:
receiving a single input image having an illuminated subject; and
relighting the single input image by inputting the single input image and a target spherical harmonic illumination embedding to an autoencoder of a neural network to generate a relighted image having the illuminated subject of the single input image illuminated based on the target spherical harmonic illumination embedding, the autoencoder having an encoder and a decoder that are trained using a spherical harmonic loss function;
wherein relighting the single input image comprises:
generating, by the encoder, an input content embedding that represents the subject of the input image;
generating, by the decoder, the relighted image using the input content embedding and the target spherical harmonic illumination embedding as inputs to the decoder.