US 12,462,418 B2
Monocular camera defocus face measuring
Gurunandan Krishnan Gorumkonda, Kirkland, WA (US); Shree K. Nayar, New York, NY (US); and Yicheng Wu, Boston, MA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on May 6, 2023, as Appl. No. 18/144,187.
Claims priority of provisional application 63/339,248, filed on May 6, 2022.
Prior Publication US 2023/0360251 A1, Nov. 9, 2023
Int. Cl. G06T 7/70 (2017.01); G06V 40/16 (2022.01)
CPC G06T 7/70 (2017.01) [G06V 40/161 (2022.01); G06T 2207/30201 (2013.01)] 9 Claims
OG exemplary drawing
 
1. A device, comprising:
a monocular camera configured to capture images of a face, the captured images comprising a plurality of face features;
a processor configured to determine a distance between the monocular camera and the face, the processor configured to:
determine the plurality of face features in the captured images;
determine a scale of the face as a function of the determined plurality of face features by using a manual focus feature of the device to process a focal stack of the captured images based on the captured images, wherein each said captured image of the focal stack has a focal plane and the processor is configured to process the focal planes to determine the scale of the face;
apply a two-dimensional (2D) facial landmark detection algorithm to an in-focus one of said captured images to detect 2D facial landmarks and determine a focus distance between the camera and the face; and
estimate a three-dimensional (3D) mesh of the face of a unit size corresponding to the detected 2D facial landmarks.