US 11,657,523 B2
Microlens amplitude masks for flying pixel removal in time-of-flight imaging
Ilya Chugunov, Princeton, NJ (US); Seung-Hwan Baek, Princeton, NJ (US); Qiang Fu, Thuwal (SA); Wolfgang Heidrich, Thuwal (SA); and Felix Heide, Princeton, NJ (US)
Assigned to The Trustees of Princeton University, Princeton, NJ (US); and King Abdullah University of Science and Technology, Thuwal (SA)
Appl. No. 17/915,536
Filed by THE TRUSTEES OF PRINCETON UNIVERSITY, Princeton, NJ (US); and KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY, Thuwal (SA)
PCT Filed Mar. 17, 2022, PCT No. PCT/IB2022/052448
§ 371(c)(1), (2) Date Sep. 29, 2022,
PCT Pub. No. WO2022/195537, PCT Pub. Date Sep. 22, 2022.
Claims priority of provisional application 63/162,336, filed on Mar. 17, 2021.
Prior Publication US 2023/0118593 A1, Apr. 20, 2023
Int. Cl. G06K 9/00 (2022.01); G06T 7/50 (2017.01); G01S 17/894 (2020.01); G01S 7/4912 (2020.01); G01S 7/481 (2006.01)
CPC G06T 7/50 (2017.01) [G01S 7/4816 (2013.01); G01S 7/4912 (2013.01); G01S 17/894 (2020.01); G06T 2207/10028 (2013.01)] 11 Claims
OG exemplary drawing
 
1. A computer-implemented method for image depth determination, the computer-implemented method comprising:
receiving an image;
adding noise to the image;
for the image, determining a set of correlation images, each correlation image having a varying phase offset
for each pixel of the image, generating a masked pixel by applying a mask array; and
for each masked pixel, determining the depth of the masked pixel to generate a depth map for the image on a per pixel basis, wherein neighboring pixels have different apertures, wherein a first neighboring pixel has a different signal-to-noise ratio than a second neighboring pixel.