US 11,721,001 B2
Multiple point spread function based image reconstruction for a camera behind a display
Changgeng Liu, San Jose, CA (US); Ernest Rehmatulla Post, San Francisco, CA (US); Ziwen Jiang, Santa Clara, CA (US); Ye Zhao, Mountain View, CA (US); and Gustavo A. Guayaquil Sosa, Sunnyvale, CA (US)
Assigned to Samsung Electronics Co., Ltd., Suwon si (KR)
Filed by Samsung Electronics Company, Ltd., Gyeonggi-Do (KR)
Filed on Feb. 16, 2021, as Appl. No. 17/176,535.
Prior Publication US 2022/0261966 A1, Aug. 18, 2022
Int. Cl. G06T 5/00 (2006.01); G06T 7/571 (2017.01); G06T 5/20 (2006.01); G06T 5/50 (2006.01); H04N 9/73 (2023.01); H04N 23/57 (2023.01); H04N 23/80 (2023.01)
CPC G06T 5/003 (2013.01) [G06T 5/20 (2013.01); G06T 5/50 (2013.01); G06T 7/571 (2017.01); H04N 9/73 (2013.01); H04N 23/57 (2023.01); H04N 23/80 (2023.01); G06T 2207/10024 (2013.01); G06T 2207/20221 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising, by an electronic device:
capturing, by a camera disposed behind a display panel of the electronic device, an original image through a semi-transparent pixel region of the display panel;
determining a depth position with respect to at least one object identified within the original image;
accessing, based on the depth position, a plurality of N point spread functions (PSFs), each PSF corresponding to a different, specific lateral position of a plurality of lateral positions at the depth position;
generating from the original image, a set of N overlapping image patches of the original image based on the plurality of N PSFs, wherein:
each image patch of the set of N overlapping image patches is generated based on a different one of the plurality of N PSFs;
and a size and a location of each image patch is determined based on a location of the specific lateral position of the PSF used to generate that image patch and based on the number N of PSFs in the plurality of N PSFs; and
generating a reconstructed image corresponding to the original image based on the set of N overlapping image patches of the original image.