US 12,156,727 B2
Deep learning-based cough recognition method and device
Yong Hwa Park, Daejeon (KR); Gyeong Tae Lee, Daejeon (KR); Hyeonuk Nam, Daejeon (KR); Seonghu Kim, Daejeon (KR); Young Key Kim, Daejeon (KR); In Kwon Kim, Daejeon (KR); Kwang Hyun Lee, Daejeon (KR); Jae Sun Lee, Daejeon (KR); and Sung Hyo Park, Daejeon (KR)
Assigned to KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY, Daejeon (KR); and SM INSTRUMENTS CO., LTD., Daejeon (KR)
Filed by Korea Advanced Institute of Science and Technology, Daejeon (KR); and SM Instruments Co., Ltd., Daejeon (KR)
Filed on Oct. 31, 2022, as Appl. No. 18/051,137.
Application 18/051,137 is a continuation of application No. PCT/KR2021/008592, filed on Jul. 6, 2021.
Claims priority of application No. 10-2020-0084770 (KR), filed on Jul. 9, 2020; and application No. 10-2020-0163070 (KR), filed on Nov. 27, 2020.
Prior Publication US 2023/0078404 A1, Mar. 16, 2023
Int. Cl. A61B 5/08 (2006.01); A61B 5/00 (2006.01); A61B 5/11 (2006.01)
CPC A61B 5/0823 (2013.01) [A61B 5/1128 (2013.01); A61B 5/6889 (2013.01); A61B 2562/0204 (2013.01)] 6 Claims
OG exemplary drawing
 
1. A cough recognition device comprising:
a plurality of microphone arrays configured to receive audio signals;
a camera module configured to generate a camera image; and
at least one processor,
wherein the at least one processor is configured to,
collect the audio signals through the plurality of microphone arrays and display a location of a sound source on the camera image,
determine whether the audio signals include cough sound using a deep learning model, and
when the audio signals include the cough sound, further display a cough indication in association with the location of the sound source displayed on the camera image,
wherein the deep learning model includes a binary classification model configured to receive and learn learning data including data augmented cough sound with background noise and to output whether the input audio signals include the cough sound,
wherein the at least one processor is further configured to, when the input audio signals is classified as including the cough sound, displaying a location where the cough sound is generated by displaying the cough label indicating the cough mark along with the location of the sound source on the camera image.