US 12,131,733 B2
Active listening for assistant systems
Leif Haven Martinson, Oakland, CA (US); David Levison, Sebastopol, CA (US); Heath William Black, Alameda, CA (US); Ryan Frederick Stewart, Sammamish, WA (US); Tara Ramanan, Redmond, WA (US); and Samuel Steele Noertker, Redmond, WA (US)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on Nov. 8, 2021, as Appl. No. 17/521,623.
Claims priority of provisional application 63/177,812, filed on Apr. 21, 2021.
Prior Publication US 2022/0366904 A1, Nov. 17, 2022
Int. Cl. G10L 15/22 (2006.01); G10L 15/08 (2006.01); G10L 15/30 (2013.01)
CPC G10L 15/22 (2013.01) [G10L 15/08 (2013.01); G10L 15/30 (2013.01); G10L 2015/088 (2013.01); G10L 2015/225 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method comprising, by a computing system, the computing system comprising a client system and a companion device paired to the client system:
receiving, at the companion device from the client system, a first user input comprising a wake word associated with an assistant xbot;
setting the assistant xbot into a listening mode, wherein a continuous non-visual feedback is provided via the client system while the assistant xbot is in the listening mode;
receiving, at the companion device from the client system, a second user input comprising a user utterance while the assistant xbot is in the listening mode;
determining the second user input has ended based on a completion of the user utterance;
setting the assistant xbot into an inactive mode, wherein the non-visual feedback is discontinued via the client system while the assistant xbot is in the inactive mode; and
providing, via the companion device, a continuous visual feedback while the assistant xbot is in the listening mode.