US 11,941,345 B2
Voice instructed machine authoring of electronic documents
Timo Mertens, San Francisco, CA (US); Vipul Raheja, San Francisco, CA (US); Chad Mills, Georgetown, TX (US); Ihor Skliarevskyi, Vancouver (CA); Ignat Blazhko, San Francisco, CA (US); Robyn Perry, San Mateo, CA (US); Nicholas Bern, San Francisco, CA (US); Dhruv Kumar, Vancouver (CA); and Melissa Lopez, Ewing, NJ (US)
Assigned to Grammarly, Inc., San Francisco, CA (US)
Filed by Grammarly, Inc., San Francisco, CA (US)
Filed on Oct. 26, 2021, as Appl. No. 17/510,994.
Prior Publication US 2023/0125194 A1, Apr. 27, 2023
Int. Cl. G06F 40/166 (2020.01); G06F 3/0481 (2022.01); G06F 40/103 (2020.01); G06F 40/20 (2020.01); G06F 40/30 (2020.01); G10L 15/22 (2006.01); G10L 15/26 (2006.01)
CPC G06F 40/166 (2020.01) [G06F 3/0481 (2013.01); G06F 40/103 (2020.01); G06F 40/20 (2020.01); G10L 15/22 (2013.01); G10L 15/26 (2013.01); G06F 40/30 (2020.01); G10L 2015/223 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising, executed by one or more of a computer system and a text processor that is coupled to the one or more computer system via a network:
receiving, at a user interface of the one or more computer systems, a first input to initiate a dictation process;
receiving, in response to an initiation of the dictation process, an audio input from the one or more computer systems;
converting, using an automatic speech recognition model, the audio input to digitally stored electronic text;
generating, using a normalization model, one or more digitally stored sentence structures based on the digitally stored electronic text;
identifying, using a comprehension model, one or more instructions represented in the one or more digitally stored sentence structures;
generating, using the comprehension model, one or more sentences based on the one or more instructions and the one or more sentence structures;
identifying, using an enhancement model to analyze the one or more sentences, one or more enhancements to apply to the one or more sentences that alters the one or more sentences; and
presenting, at a display of the one or more computer systems, the one or more enhancements near the one or more sentences in the user interface of the one or more computer systems, each particular enhancement of the one or more enhancements being selectable via a second input from the one or more computer systems to apply the particular enhancement to the one or more sentences.