US 12,245,851 B2
System and method for non-face-to-face health status measurement through camera-based vital sign data extraction and electronic questionnaire
Dae Yeol Kim, Seoul (KR); and Jin Soo Kim, Guri-si (KR)
Assigned to TVSTORM CO., LTD., (KR)
Filed by TVSTORM CO., LTD., Seoul (KR)
Filed on Apr. 22, 2022, as Appl. No. 17/727,697.
Claims priority of application No. 10-2021-0053285 (KR), filed on Apr. 23, 2021.
Prior Publication US 2022/0338757 A1, Oct. 27, 2022
Int. Cl. A61B 5/103 (2006.01); A61B 5/00 (2006.01); A61B 5/0205 (2006.01); A61B 5/024 (2006.01); A61B 5/08 (2006.01); A61B 5/1455 (2006.01); G16H 10/20 (2018.01); G16H 40/67 (2018.01); G16H 50/30 (2018.01)
CPC A61B 5/1032 (2013.01) [A61B 5/0205 (2013.01); A61B 5/02444 (2013.01); A61B 5/0816 (2013.01); A61B 5/14552 (2013.01); A61B 5/7264 (2013.01); A61B 5/7275 (2013.01); G16H 10/20 (2018.01); G16H 40/67 (2018.01); G16H 50/30 (2018.01)] 10 Claims
OG exemplary drawing
 
1. A system for non-face-to-face health status measurement through a camera-based vital sign data extraction and an electronic questionnaire, comprising:
a vital sign data extraction unit configured to extract a vital sign data from color information of a face image received from a user terminal, wherein the vital sign data extraction unit comprises:
a face image analysis engine configured to extract feature points for each of parts including eyes, nose, mouth, and ears from the face image received from the user terminal, and extract regions of interest comprising a forehead, cheeks, or a combination thereof from the extracted feature points for each of the parts; and
a vital sign data extraction engine configured to identify a pattern for time-series changes of average values regarding R, G, and B values of each of the extracted regions of interest, and extract a vital sign data as the vital sign data of the user,
wherein the vital sign data comprises oxygen saturation corresponding to a pattern with the highest degree of similarity among patterns for an identified time series change and patterns of a previously constructed mapping table; and
an electronic questionnaire unit configured to transmit preset questionnaire items to the user terminal and receive response data for the questionnaire items from the user terminal,
wherein the health status of the user is measured non-face-to-face based on the extracted vital sign data and the received response data.