US 11,776,200 B2
Image relighting
Xianling Zhang, San Jose, CA (US); Nathan Tseng, Canton, MI (US); Nikita Jaipuria, Union City, CA (US); and Rohan Bhasin, Santa Clara, CA (US)
Assigned to Ford Global Technologies, LLC, Dearborn, MI (US)
Filed by Ford Global Technologies, LLC, Dearborn, MI (US)
Filed on Nov. 10, 2021, as Appl. No. 17/523,210.
Prior Publication US 2023/0143816 A1, May 11, 2023
Int. Cl. G06T 15/50 (2011.01); G06T 15/20 (2011.01); G06T 15/00 (2011.01); G06V 10/75 (2022.01)
CPC G06T 15/50 (2013.01) [G06T 15/005 (2013.01); G06T 15/205 (2013.01); G06V 10/758 (2022.01)] 16 Claims
OG exemplary drawing
 
1. A computer comprising a processor and a memory storing instructions executable by the processor to:
receive a plurality of first images of an environment in a first lighting condition;
classify pixels of the first images into categories;
mask the pixels belonging to at least one of the categories from the first images;
generate a three-dimensional representation of the environment based on the masked first images;
generate a first shadow mask of the first one of the first images, wherein generating the first shadow mask includes executing a second machine-learning algorithm, and the first images are inputs to the second machine-learning algorithm;
generate a second shadow mask of the environment in the second lighting condition from a perspective of the first one of the first images, wherein generating the second shadow mask includes executing a third machine-learning algorithm, and the first images are inputs to the third machine-learning algorithm; and
generate a second image of the environment in a second lighting condition based on the three-dimensional representation, on a first one of the first images, on the first shadow mask, and on the second shadow mask, wherein generating the second image includes executing a first machine-learning algorithm; and the first one of the first images, the first shadow mask, and the second shadow mask are inputs to the first machine-learning algorithm.