US 12,356,083 B2
Techniques for correcting images in flash photography
Bosheng Zhang, Sunnyvale, CA (US); Tobias Baldauf, Newmarket (GB); Ilya Romanenko, Foxton (GB); Nicolas P. Bonnier, Mountain View, CA (US); Noah D. Bedard, Los Gatos, CA (US); Alexandra S. Ludlow, Cambridge (GB); Graham D. Finlayson, Norwich (GB); Jason P. de Villiers, Cambridge (GB); Claus Moelgaard, Los Gatos, CA (US); Hau Ling Hung, San Jose, CA (US); and Paul M. Hubel, Mountain View, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 22, 2022, as Appl. No. 17/950,859.
Prior Publication US 2024/0107177 A1, Mar. 28, 2024
Int. Cl. H04N 5/243 (2006.01); G06T 5/50 (2006.01); G06T 7/50 (2017.01); H04N 9/73 (2023.01); H04N 23/76 (2023.01)
CPC H04N 23/76 (2023.01) [G06T 5/50 (2013.01); G06T 7/50 (2017.01); H04N 9/73 (2013.01); G06T 2207/20221 (2013.01)] 22 Claims
OG exemplary drawing
 
12. A device comprising:
a set of cameras;
a flash module;
a memory; and
one or more processors operatively coupled to the memory, wherein the one or more processors are configured to execute instructions causing the one or more processors to:
obtain a set of images from the set of cameras, the set of images comprising a set of flash images;
obtain a depth map;
select or generate a reference image from the set of images;
select or generate an input image from the set of flash images;
decompose the input image using the reference image to generate a flash contribution image and an ambient contribution image;
perform a spatially-varying brightness adjustment to the flash contribution image using the depth map; and
recombine the brightness-adjusted flash contribution image and the ambient contribution image to generate a corrected flash image.