US 12,144,610 B2
Method for user recognition and emotion monitoring based on smart headset
Yongpan Zou, Shenzhen (CN); Haibo Lei, Shenzhen (CN); and Kaishun Wu, Shenzhen (CN)
Assigned to SHENZHEN UNIVERSITY, Shenzhen (CN)
Appl. No. 17/283,966
Filed by SHENZHEN UNIVERSITY, Shenzhen (CN)
PCT Filed Mar. 4, 2021, PCT No. PCT/CN2021/079115
§ 371(c)(1), (2) Date Apr. 9, 2021,
PCT Pub. No. WO2021/248942, PCT Pub. Date Dec. 16, 2021.
Claims priority of application No. 202010535561.7 (CN), filed on Jun. 12, 2020.
Prior Publication US 2022/0188392 A1, Jun. 16, 2022
Int. Cl. A61B 5/117 (2016.01); A61B 5/00 (2006.01); A61B 5/16 (2006.01); A61B 7/04 (2006.01); H04R 1/08 (2006.01); H04R 1/10 (2006.01); G06F 21/32 (2013.01)
CPC A61B 5/117 (2013.01) [A61B 5/165 (2013.01); A61B 5/6803 (2013.01); A61B 5/6843 (2013.01); A61B 5/7203 (2013.01); A61B 5/725 (2013.01); A61B 5/7267 (2013.01); A61B 7/04 (2013.01); H04R 1/083 (2013.01); H04R 1/1016 (2013.01); H04R 1/1041 (2013.01); H04R 1/1075 (2013.01); H04R 1/1091 (2013.01); G06F 21/32 (2013.01); H04R 2201/10 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method for a user recognition and an emotion monitoring based on a smart headset, wherein the smart headset comprising an earplug part and a main body, the earplug part is provided with a first microphone and a wearing detection sensor, and a housing of the main body is internally provided with a signal amplification circuit, a communication module, and a microcontroller, wherein the method comprises
detecting whether the user wears the smart headset properly by the wearing detection sensor,
obtaining a sound signal in an ear canal by the first microphone,
amplifying the sound signal by the signal amplification circuit to obtain an amplified sound signal,
outputting the amplified sound signal is outputted to the microcontroller,
transmitting the amplified sound signal by the microcontroller via the communication module to a smart terminal paired with the smart headset to extract a heart sound signal characteristic,
validating a legality of an identity of the user and
inferring a current emotional state of the user according to the heart sound signal characteristic;
wherein the step of validating the legality of the identity of the user and inferring the current emotional state of the user according to the heart sound signal characteristic comprises steps of:
collecting an original sound signal in the ear canal by using the first microphone arranged in the earplug part;
amplifying the original sound signal to obtain the amplified sound signal in the ear canal;
processing the amplified sound signal in the ear canal and extracting the heart sound signal characteristic, inputting the heart sound signal characteristic into a pre-trained identity recognition model for an identity authentication, and inputting the heart sound signal characteristic into a pre-trained emotion recognition model for an emotional categorization; and
determining whether to unlock the smart headset and whether to unlock the smart terminal paired with the smart headset according to an identity authentication result, and determining the user's current emotional state of the user according to an emotional categorization result to generate an emotion monitoring report.