US 12,148,230 B2
System and method for non-invasive operator health monitoring
Prajitha Kunhiraman, Bengaluru (IN); Carlo L. Tiana, Goldendale, WA (US); and Amrit Chatterjee, Hyderabad (IN)
Assigned to Rockwell Collins, Inc., Cedar Rapids, IA (US)
Filed by Rockwell Collins, Inc., Cedar Rapids, IA (US)
Filed on Nov. 29, 2022, as Appl. No. 18/070,910.
Claims priority of application No. 202211048227 (IN), filed on Aug. 24, 2022.
Prior Publication US 2024/0071107 A1, Feb. 29, 2024
Int. Cl. G06V 40/16 (2022.01); A61B 5/0205 (2006.01); G06F 3/01 (2006.01); G06V 20/59 (2022.01)
CPC G06V 20/597 (2022.01) [A61B 5/0205 (2013.01); G06F 3/013 (2013.01); G06V 40/171 (2022.01); G06V 40/176 (2022.01)] 12 Claims
OG exemplary drawing
 
1. A system, the system comprising:
one or more pilot monitoring devices configured to track one or more facial features of a pilot, the one or more tracked facial features including at least one of a pilot's eyes, a pilot's mouth, a pilot's head posture, a pilot's forehead, or a pilot's cheek, the one or more pilot monitoring devices configured to generate at least one of one or more images or one or videos of the tracked one or more facial features of the pilot; and
one or more controllers communicatively coupled to the one or more imaging devices, the one or more controllers including one or more processors configured to execute a set of program instructions stored in memory, the set of program instructions configured to cause the one or more processors to:
receive the at least one of the one or more images or the one or more videos from the one or more pilot monitoring devices;
determine at least one of one or more eye tracking parameters, one or more mouth tracking parameters, one or more head tracking parameters, or an emotion of the pilot based on the received one or more images or one or more videos;
determine a color skin intensity value of at least one of the pilot's forehead or the pilot's cheek;
determine at least one of a pulse rate, a blood pressure, or a respiratory rate based on the determined skin intensity value by deriving a power spectrum of one or more pixel values computed from at least one of the pilot's forehead or the pilot's cheek; and
determine a pilot health monitoring value based on at least one of the determined one or more eye tracking parameters, the determined one or more mouth tracking parameters, the one or more head tracking parameters, or the determined emotion of the pilot, wherein the pilot health monitoring value includes a stress score.