US 12,293,497 B2
Electronic device for estimating camera illuminant and method of the same
Abdelrahman Abdelhamed, Toronto (CA); Abhijith Punnappurath, Mountain View (CA); and Michael Scott Brown, Mountain View (CA)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Feb. 3, 2023, as Appl. No. 18/105,660.
Application 18/105,660 is a continuation of application No. PCT/KR2021/016244, filed on Nov. 9, 2021.
Application PCT/KR2021/016244 is a continuation in part of application No. 17/377,656, filed on Jul. 16, 2021, abandoned.
Claims priority of provisional application 63/186,346, filed on May 10, 2021.
Claims priority of provisional application 63/114,079, filed on Nov. 16, 2020.
Prior Publication US 2023/0188690 A1, Jun. 15, 2023
Int. Cl. G06T 5/92 (2024.01); G06T 3/40 (2024.01); G06T 7/11 (2017.01); G06T 7/30 (2017.01); G06T 7/90 (2017.01); G06V 10/141 (2022.01); G06V 10/24 (2022.01); G06V 10/56 (2022.01); G06V 10/82 (2022.01); H04N 9/73 (2023.01); H04N 23/85 (2023.01); H04N 23/90 (2023.01); H04N 25/17 (2023.01)
CPC G06T 5/92 (2024.01) [G06T 3/40 (2013.01); G06T 7/11 (2017.01); G06T 7/30 (2017.01); G06T 7/90 (2017.01); G06V 10/141 (2022.01); G06V 10/24 (2022.01); G06V 10/56 (2022.01); G06V 10/82 (2022.01); H04N 9/73 (2013.01); H04N 23/90 (2023.01); G06T 2207/10024 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20132 (2013.01); H04N 25/17 (2023.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus for processing image data, the apparatus comprising:
a memory storing instructions; and
a processor configured to execute the instructions to:
obtain a first image and a second image that capture a same scene in different views, from a first camera and a second camera, respectively;
spatially align the first image with the second image;
obtain a color transformation matrix that maps the first image to the second image based on color values of the first image and the second image;
obtain an estimated illuminant color from an output of a neural network by inputting the color transformation matrix to the neural network, wherein the neural network is trained based on a pair of reference images of a same reference scene with a color rendition chart that are captured by different cameras having different spectral sensitivities; and
perform a white balance correction on the first image based on the estimated illuminant color to output a corrected first image.