US 12,437,653 B2
System and method for speech-enabled adaptive training for human pilot verbal data capture and reporting for flight operations quality assurance
Lewis A. Whaley, Charleston, WV (US); and Mark R. Jean, Palmdale, CA (US)
Assigned to OnStation LLC, Los Angeles, CA (US)
Filed by OnStation LLC, Los Angeles, CA (US)
Filed on Dec. 3, 2024, as Appl. No. 18/967,472.
Claims priority of provisional application 63/605,674, filed on Dec. 4, 2023.
Prior Publication US 2025/0182627 A1, Jun. 5, 2025
Int. Cl. G08G 5/24 (2025.01); B64C 13/18 (2006.01); G06F 40/279 (2020.01); G10L 15/22 (2006.01)
CPC G08G 5/24 (2025.01) [B64C 13/18 (2013.01); G06F 40/279 (2020.01); G10L 15/22 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A real-time, speech-enabled flight operations quality assurance (RTS-FOQA) system comprising:
one or more processors;
at least one microphone;
at least one video camera;
a speaker;
exceedance alert display; and
an artificial intelligence/machine learning (AI/ML) model implemented by the one or more processors configured to encode a plurality of safety procedures, wherein the AI/ML model is configured to:
a) receive:
i) cockpit voice data via the at least one microphone; and
ii) cockpit video from the at least one video camera;
b) identify a plurality of flight operations executed by a pilot based on the cockpit voice data and cockpit video;
c) identify one of the plurality of safety procedures based on the one or more identified operations, wherein the identified safety procedure comprises a plurality of operational steps represented as n-grams, wherein each element of the n-gram is associated with an action to be executed by the pilot, and the AI/ML model automatically chooses a minimum size of the n-gram based on a maximum number of matching sequence between the plurality of flight operations and the plurality of operational steps of the plurality of safety procedures;
d) determine if the pilot fails to execute any of the plurality of operational steps prescribed by the identified safety procedure;
e) alert the pilot via the speaker or exceedance alert display if and when the pilot fails to execute any of the plurality of operational steps prescribed by the identified safety procedure.