US 11,862,155 B2
Group hotwords
Matthew Sharifi, Kilchberg (CH); and Victor Carbune, Zürich (CH)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Dec. 11, 2020, as Appl. No. 17/118,687.
Prior Publication US 2022/0189470 A1, Jun. 16, 2022
Int. Cl. G10L 15/22 (2006.01); G06F 3/16 (2006.01); G10L 15/02 (2006.01); G10L 15/08 (2006.01); G10L 17/24 (2013.01)
CPC G10L 15/22 (2013.01) [G06F 3/167 (2013.01); G10L 15/02 (2013.01); G10L 15/08 (2013.01); G10L 17/24 (2013.01); G10L 2015/088 (2013.01); G10L 2015/223 (2013.01)] 32 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, at data processing hardware of a first assistant-enabled device (AED), an assignment instruction assigning a group hotword to a selected group of AEDs associated with a user, the selected group of AEDs comprising the first AED and one or more other AEDs, each AED in the selected group of AEDs configured to run a hotword detection model trained to detect a presence of the group hotword in streaming audio without performing speech recognition and wake-up from a low-power state when the group hotword is detected in streaming audio by at least one of the AEDs in the selected group of AEDs, wherein other AEDs associated with the user that are not in the selected group of AEDs are configured to not wake-up from a low-power state when the group hotword is detected in the streaming audio by the at least one of the AEDs in the selected group of AEDs;
receiving, at the data processing hardware, audio data corresponding to an utterance spoken by the user, the audio data comprising the group hotword and a query specifying an operation to perform;
detecting, by the data processing hardware, using the hotword detection model running on the first AED, the group hotword in the audio data without performing speech recognition processing on the audio data; and
in response to detecting the group hotword in the audio data:
triggering, by the data processing hardware, the first AED to wake-up from the low-power state;
without performing speech recognition processing on the audio data, invoking, by the data processing hardware, each other AED in the selected group of AEDs that did not detect the group hotword in the audio data to wake-up from the low power state and collaborate with all the AEDs in the selected group of AEDs to fulfill performance of the operation specified by the query; and
executing, by the data processing hardware, a collaboration routine to cause the first AED and each other AED in the selected group of AEDs to collaborate with one another to fulfill performance of the operation specified by the query.