US 11,887,486 B2
Context driven alerting
Arjun Harsha Rao, Marion, IA (US); Peggy Wu, Ellicott City, MD (US); Christopher L George, Winchester, VA (US); Timothy J. Wittkop, Marion, IA (US); Michael P. Matessa, Ben Lomond, CA (US); and Wade T. Johnson, Cedar Rapids, IA (US)
Assigned to Rockwell Collins, Inc., Cedar Rapids, IA (US)
Filed by Rockwell Collins, Inc., Cedar Rapids, IA (US)
Filed on May 13, 2022, as Appl. No. 17/744,357.
Claims priority of provisional application 63/196,906, filed on Jun. 4, 2021.
Prior Publication US 2022/0392354 A1, Dec. 8, 2022
Int. Cl. G08G 5/00 (2006.01); G06V 40/16 (2022.01); G06V 40/10 (2022.01); G06V 40/18 (2022.01); G06V 40/70 (2022.01); G10L 25/66 (2013.01)
CPC G08G 5/0021 (2013.01) [G06V 40/15 (2022.01); G06V 40/174 (2022.01); G06V 40/18 (2022.01); G06V 40/70 (2022.01); G10L 25/66 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A system comprising:
one or more biometric sensors configured to capture biometric data of a pilot within a flight deck of an aircraft, wherein the biometric data is time variant and indicates a state of the pilot, wherein the biometric data includes at least one of video-based biometric data, audio-based biometric data, or wearables-based biometric data;
a non-transitory memory maintaining program instructions; and
one or more processors configured to execute the program instructions maintained on the memory, the program instructions causing the one or more processors to:
receive the biometric data, aircraft state data, and mission profile data; wherein the aircraft state data includes at least one of a geographic location, a flight parameter, or an aircraft systems status; wherein the mission profile data includes at least one of a filed flight plan and current route, a weather condition, or a phase of flight;
perform data fusion on the biometric data, the aircraft state data, and the mission profile data to generate fused information with a common timestamp; wherein the data fusion includes timestamping the video-based biometric data, the audio-based biometric data, the wearables-based biometric data, the filed flight plan and the current route, the weather condition, the phase of flight, the geographic location, the flight parameter, and the aircraft systems status;
apply an alerting algorithm to the fused information to determine an alert, the alert including at least one of an alert priority, an alert intensity, an alert frequency, or an alert modality which is based on the fused information; and
provide the alert to an aircraft avionics system for alerting the pilot.