| CPC G09B 9/54 (2013.01) [G06T 13/80 (2013.01); G09B 9/006 (2013.01); G09B 19/165 (2013.01); G09G 5/37 (2013.01); G10L 15/22 (2013.01); G10L 15/26 (2013.01); G06F 3/147 (2013.01); G09B 5/06 (2013.01); G09G 2354/00 (2013.01); G09G 2380/12 (2013.01)] | 17 Claims |
|
1. A computer-implemented method, the method comprising:
at an electronic device comprising a display, a microphone, one or more processors, a memory, and one or more computer programs stored in the memory and configured to be executed by the one or more processors:
generating a sequence of tests, wherein each test is associated with a ground-based facility type, and wherein generating each test comprises:
(a) generating, with the display of the electronic device, a graphic representation of an aircraft for display;
(b) rendering, based on the ground-based facility type associated with the respective test, with the display of the electronic device, a predetermined shape comprising one or more boundaries for the aircraft to avoid while moving to a target destination within the one or more boundaries, wherein the predetermined shape is one of a plurality of predetermined shapes, and wherein each of the plurality of predetermined shapes is associated with the ground-based facility type;
(c) providing, with the display of the electronic device, an instruction for controlling the aircraft;
(d) receiving, with the microphone of the electronic device, an audio input from a user indicative of a label for the aircraft, an action for the aircraft to perform, a direction at which to perform the action, a degree to which the action is performed in the direction, or any combination thereof;
(e) performing, by the one or more processors, a speech-to-text analysis to the audio input to obtain a corresponding text string and a speech recognition confidence score associated with the corresponding text string, wherein the speech recognition confidence score indicates confidence of the electronic device in recognizing the audio input;
(f) performing, by the one or more processors, semantic parsing of the corresponding text string to identify vectoring clearance associated with the corresponding text string;
(g) determining, by the one or more processors, a new location of the aircraft based on the vectoring clearance;
(h) generating, with the display of the electronic device, an animation of the aircraft moving to the new location according to the vectoring clearance for display; and
(i) repeating steps (d)-(h) until a termination condition is reached, wherein the termination condition comprises the aircraft making contact with the one or more boundaries of the predetermined shape or the aircraft arriving at the target destination in the one or more boundaries;
collecting, for each test of the sequence of tests, by the one or more processors, a plurality of metrics based at least partially on step (i), wherein the plurality of metrics comprises a plurality of time metrics associated with one or more audio inputs received from the user, a quantity of vectoring clearances received from the user, one or more results of the aircraft from issuing one or more vectoring clearances, and the speech recognition confidence score; and
calculating, by the one or more processors, a plurality of facility-specific aptitude scores of the user based on the plurality of metrics collected for each test of the sequence of tests, wherein each facility-specific aptitude score is associated with an evaluation of a phraseology and a confidence of the user providing the audio input, and wherein each facility-specific aptitude score is based at least partially on the speech recognition confidence score.
|