US 11,809,535 B2
Systems and methods for multi-modal user device authentication
Aleksander Magi, Portland, OR (US); Barnes Cooper, Hillsboro, OR (US); Arvind Kumar, Beaverton, OR (US); Julio Zamora Esquivel, Zapopan (MX); Vivek Paranjape, Hillsboro, OR (US); William Lewis, North Plains, OR (US); Marko Bartscherer, Chula Vista, CA (US); and Giuseppe Raffa, Portland, OR (US)
Assigned to Intel Corporation, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Dec. 23, 2019, as Appl. No. 16/725,467.
Prior Publication US 2020/0134151 A1, Apr. 30, 2020
Int. Cl. G06F 21/00 (2013.01); G06F 21/32 (2013.01); G10L 17/06 (2013.01); G10L 17/00 (2013.01); G06V 40/16 (2022.01)
CPC G06F 21/32 (2013.01) [G06V 40/168 (2022.01); G06V 40/172 (2022.01); G10L 17/00 (2013.01); G10L 17/06 (2013.01)] 21 Claims
OG exemplary drawing
 
1. An electronic device comprising:
a first sensor;
a microphone;
a first camera;
an ambient light sensor;
computer-readable instructions; and
processor circuitry to execute the computer-readable instructions to:
analyze first sensor data generated by the first sensor to detect a presence of a subject proximate to the electronic device;
analyze audio data generated by the microphone to detect a voice of an authorized user of the electronic device in the audio data;
authenticate the subject as the authorized user if (a) the presence of the subject is detected and (b) the voice of the authorized user is detected with a confidence level that satisfies a first confidence threshold for audio data authentication;
analyze image data generated by the first camera to detect a feature of the authorized user in the image data if the voice of the authorized user fails to satisfy the first confidence threshold;
analyze third sensor data generated by the ambient light sensor to determine a lighting condition of an environment including the electronic device;
determine that a confidence level associated with the detection of the feature in the image data satisfies a second confidence threshold for image data authentication based on the lighting condition;
authenticate the subject as the authorized user if (a) the presence of the subject is detected, (b) the voice of the authorized user is detected with the confidence level that satisfies a third confidence threshold for audio data authentication, the third confidence threshold different than the first confidence threshold, and (c) the feature of the authorized user is detected in the image data with the confidence level that satisfies the second confidence threshold for image data authentication based on the lighting condition;
cause the electronic device to move from a first power state to a second power state in response to authentication of the subject as the authorized user, the electronic device to consume a greater amount of power in the second power state than the first power state; and
maintain the first power state in response to the confidence level failing to satisfy the first confidence threshold and failing to satisfy the second confidence threshold.