US 12,254,882 B2
Speech detection from facial skin movements
Aviad Maizels, Ramat Hasharon (IL); Avi Barliya, Tel Aviv (IL); and Yonatan Wexler, Jerusalem (IL)
Assigned to Q (Cue) Ltd., Ramat Gan (IL)
Filed by Q (CUE) LTD., Ramat Gan (IL)
Filed on Feb. 2, 2024, as Appl. No. 18/431,563.
Application 18/431,563 is a continuation of application No. 18/181,787, filed on Mar. 10, 2023, granted, now 11,922,946.
Application 18/181,787 is a continuation of application No. PCT/IB2022/056418, filed on Jul. 12, 2022.
Application PCT/IB2022/056418 is a continuation in part of application No. PCT/US2022/054527, filed on May 16, 2022.
Claims priority of provisional application 63/229,091, filed on Aug. 4, 2021.
Prior Publication US 2024/0177713 A1, May 30, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G10L 15/22 (2006.01); G02B 27/00 (2006.01); G06F 40/58 (2020.01); G06V 10/141 (2022.01); G06V 10/60 (2022.01); G06V 10/82 (2022.01); G06V 40/16 (2022.01); G10L 13/02 (2013.01); G10L 13/027 (2013.01); G10L 13/04 (2013.01); G10L 15/16 (2006.01); G10L 15/25 (2013.01); G10L 15/26 (2006.01); G06F 3/01 (2006.01)
CPC G10L 15/26 (2013.01) [G02B 27/0093 (2013.01); G06F 40/58 (2020.01); G06V 10/141 (2022.01); G06V 10/60 (2022.01); G06V 10/82 (2022.01); G06V 40/171 (2022.01); G06V 40/174 (2022.01); G06V 40/176 (2022.01); G10L 13/02 (2013.01); G10L 13/027 (2013.01); G10L 13/04 (2013.01); G10L 15/16 (2013.01); G10L 15/25 (2013.01); G06F 3/015 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A light sensing system for determining textual transcription from minute facial skin movements, the system comprising:
at least one light source;
at least one sensor configured to receive light reflections from the at least one light source;
at least one processor configured to:
control the at least one light source to illuminate a region of a face of a user;
receive from the at least one sensor, reflection signals indicative of light reflected from the face in a time interval;
analyze the reflection signals to determine minute facial skin movements in the time interval;
based on the determined minute facial skin movements in the time interval, determine a sequence of words associated with the minute facial skin movements, wherein determining the sequence of words includes using an artificial neural network and a motion-to-language analysis; and
output a textual transcription corresponding with the determined sequence of words.