| CPC G09B 19/06 (2013.01) [G06F 40/263 (2020.01); G09B 5/06 (2013.01); G10L 13/08 (2013.01); G10L 15/005 (2013.01); G10L 15/22 (2013.01); G10L 15/26 (2013.01); G10L 2015/223 (2013.01)] | 28 Claims |
|
1. A conversation-based foreign language learning method using a speech recognition function and a TTS function of a terminal through interactive conversation between a learner and the terminal based on video or audio foreign language content containing a plurality of foreign language learning target expressions, the method comprising:
a process of repeating an operation that the terminal informs the learner of a speech waiting state through a sound signal and/or a screen thereof with an image indicating the speech waiting state of the terminal and, when the learner inputs speech to the terminal in the speech waiting state, the terminal responds according to the speech input by the learner and enters the speech waiting state again, followed by informing the learner of the speech waiting state through the sound signal and/or the screen to allow the learner to input new speech to the terminal, whereby the learner can perform foreign language learning through interactive conversation with the terminal via speech transmission without touch of, if any, the screen;
a process in which the terminal previously stores voice commands to be delivered from the learner to the terminal in a storage device; when the learner inputs speech in the speech waiting state of the terminal, the terminal executes a corresponding command, enters the speech waiting state again and informs the learner of the speech waiting state upon determining that the speech input by the learner matches a specific command stored in the storage device through comparison of the speech with the commands stored in the storage device using a speech recognition function; the terminal determines whether the speech input by the learner is the same as a current learning target sentence in the foreign language content or belongs to the same category as the current learning target sentence upon determining that the speech input by the learner does not match any command stored in the storage device; the terminal reads the next learning target sentence of the current learning target sentence in the foreign language content with a TTS sound or a corresponding content sound of the foreign language content, enters the speech waiting state again and informs the learner of the speech waiting state upon determining that the speech input by the learner is the same as the current learning target sentence or belongs to the same category as the current learning target sentence; and the terminal reads the current learning target sentence with a TTS sound or a corresponding content sound of the foreign language content, enters the speech waiting state again and informs the learner of the speech waiting state to allow the learner to speak the current learning target sentence again upon determining that the speech input by the learner is not the same as the current learning target sentence or does not belong to the same category as the current learning target sentence; and
a process in which, upon determining through comparison of the speech with the commands stored in the storage device that the speech input by the learner does not match any command stored in the storage device, the terminal determines whether the speech input by the learner is the same as the next learning target sentence of the current learning target sentence or belongs to the same category as the next learning target sentence; and the terminal proceeds to the next sentence of the corresponding sentence, that is, a sentence after the next learning target sentence of the current learning target sentence, reads the next sentence to the learner with a TTS sound or a corresponding content sound of the foreign language content, enters the speech waiting state again and informs the learner of the speech waiting state to allow the learner to input speech with respect to the next sentence of the corresponding sentence, that is, a sentence after the next learning target sentence of the current learning target sentence, upon determining that the speech input by the learner is the same as the next learning target sentence or belongs to the same category as the next learning target sentence.
|