US 12,475,170 B2
Voice-based auto-completions and auto-responses for assistant systems
Fadi Botros, Mountain View, CA (US); Nanshu Wang, Sunnyvale, CA (US); Fan Wang, Sunnyvale, CA (US); Meryem Pinar Donmez Ediz, Mountain View, CA (US); Omer Muzaffar, Bothell, WA (US); Kshitiz Malik, Palo Alto, CA (US); Vikas Seshagiri Rao Bhardwaj, Kirkland, WA (US); Anuj Kumar, Santa Clara, CA (US); and Shreyan Bakshi, Pittsburgh, PA (US)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on Dec. 11, 2020, as Appl. No. 17/120,013.
Prior Publication US 2022/0188361 A1, Jun. 16, 2022
Int. Cl. G02B 27/01 (2006.01); G06F 16/9032 (2019.01); G10L 15/06 (2013.01); G10L 15/16 (2006.01); H04L 51/52 (2022.01)
CPC G06F 16/90324 (2019.01) [G02B 27/01 (2013.01); G10L 15/063 (2013.01); G10L 15/16 (2013.01); H04L 51/52 (2022.05); G02B 2027/0178 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method comprising, by one or more computing systems:
receiving, from a client system associated with a user, a first input by the user, wherein the first input is in a voice modality;
analyzing the first input to generate one or more candidate hypotheses based on predictions of one or more long utterances the user is likely to speak given the first input;
determining, based on context information associated with the user, one or more modalities for presenting, to the user at the client system, output generated by the one or more computing systems; and
sending, to the client system, instructions for presenting one or more suggested auto-completions corresponding to one or more of the candidate hypotheses, respectively, wherein each suggested auto-completion comprises the corresponding candidate hypothesis, and wherein the one or more suggested auto-completions are presented in the one or more determined modalities,
wherein analyzing the first input to generate the one or more candidate hypotheses is further based on the context information associated with the user.