US 12,430,022 B2
System and method for monitoring touch events in a cockpit display
Clyde A Spidell, Cedar Rapids, IA (US); and Tracy J. Barnidge, Marion, IA (US)
Assigned to Rockwell Collins, Inc., Cedar Rapids, IA (US)
Filed by Rockwell Collins, Inc., Cedar Rapids, IA (US)
Filed on Nov. 29, 2023, as Appl. No. 18/523,089.
Prior Publication US 2025/0173058 A1, May 29, 2025
Int. Cl. G06F 3/0488 (2022.01); G06F 3/01 (2006.01); G06F 3/041 (2006.01)
CPC G06F 3/0488 (2013.01) [G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/0412 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A system, the system comprising:
one or more user interface devices including a display and a user input device, the user input device including a touchscreen interface configured to receive a user touch input from a user, the display including one or more display touch sensors configured to detect spatial-temporal touch event data associated with the user touch input received;
one or more user monitoring devices, the one or more user monitoring devices including one or more eye tracking sensors configured to detect an eye gaze of the user viewing the display, the one or more user monitoring devices including one or more body tracking sensors configured to detect body movement of the user viewing the display; and
one or more controllers communicatively coupled to the one or more user monitoring devices and the one or more user interface devices, the one or more controllers including one or more processors configured to execute a set of program instructions stored in memory, the memory including a touch event algorithm configured to detect an inadvertent touch event after the spatial-temporal touch event data is detected by the one or more display touch sensors, the set of program instructions configured to cause the one or more processors to:
receive eye gaze data of the user viewing the display from the one or more eye tracking sensors;
receive body movement data of the user viewing the display from the one or more body tracking sensors;
receive the spatial-temporal touch event data of the user viewing the display from the one or more display touch sensors of the display;
compare the spatial-temporal touch event data with touch event signature data in a touch event signature database;
determine, after the spatial-temporal touch event data is detected by the one or more display touch sensors, whether the received user touch input is the inadvertent touch event based on the compared spatial-temporal touch event data and at least one of the eye gaze data or the body movement data;
upon determining the received user touch input is the inadvertent touch event, perform a first set of one or more avionic system actions; and
upon determining the received user touch input is an intentional touch event, perform a second set of one or more avionic system actions,
wherein the second set of one or more avionic system actions are different than the first set of one or more avionic system actions.