US 12,242,667 B2
Eye and hand tracking utilizing lensless camera and machine learning
Curtis Alan Tesdahl, Fort Collins, CO (US); Benjamin Eliot Lundell, Seattle, WA (US); David Rohn, Fort Collins, CO (US); Dmitry Reshidko, Sammamish, WA (US); Dmitriy Churin, Redmond, WA (US); Kevin James Matherson, Fort Collins, CO (US); and Sayyed Jaffar Ali Raza, Fort Collins, CO (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Oct. 3, 2023, as Appl. No. 18/480,181.
Application 18/480,181 is a division of application No. 17/832,424, filed on Jun. 3, 2022, granted, now 11,803,238.
Prior Publication US 2024/0028117 A1, Jan. 25, 2024
Int. Cl. G06F 3/01 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06N 3/084 (2023.01); G06V 10/82 (2022.01); G06V 40/10 (2022.01); G06V 40/18 (2022.01)
CPC G06F 3/013 (2013.01) [G02B 27/0093 (2013.01); G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G06N 3/084 (2013.01); G06V 10/82 (2022.01); G06V 40/11 (2022.01); G06V 40/193 (2022.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01)] 8 Claims
OG exemplary drawing
 
1. A body feature tracking system in a head-mounted display (HMD) device usable by a user, comprising:
an optical mask having a point spread function (PSF), the optical mask configured to convolve the PSF with reflected body features;
a sensor configured to record a convolution of the reflected body features and the PSF of the optical mask as a body feature map; and
a machine learning system configured to extract body features directly from the body feature map using a neural network while limiting performance of deconvolution to reconstruct an image of the reflected body features.