US 11,948,565 B2
Combining device or assistant-specific hotwords in a single utterance
Matthew Sharifi, Kilchberg (CH); and Victor Carbune, Zürich (CH)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Dec. 11, 2020, as Appl. No. 17/118,783.
Prior Publication US 2022/0189471 A1, Jun. 16, 2022
Int. Cl. G10L 15/22 (2006.01); G10L 15/08 (2006.01)
CPC G10L 15/22 (2013.01) [G10L 15/08 (2013.01); G10L 2015/088 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, at data processing hardware of a first assistant-enabled device (AED), audio data corresponding to an utterance spoken by the user and directed toward the first AED and a second AED among two or more AEDs associated with the user, the audio data comprising a single query directed to both the first AED and the second AED that specifies an operation for both the first AED and the second AED to perform at the same time;
detecting, by the data processing hardware, using a hotword detection model running on the first AED, a first hotword in the audio data that proceeds the single query without hotword detection model detecting a second hotword in the audio data, the first hotword assigned to the first AED and different than the second hotword assigned to the second AED;
in response to detecting the first hotword assigned to the first AED in the audio data, initiating, by the data processing hardware, processing on the audio data to determine that the audio data comprises one or more terms preceding the single query that at least partially match the second hotword assigned to the second AED; and
based on detecting the first hotword in the audio data that precedes the single query and the determination that the audio data comprises the one or more terms preceding the single query that at least partially match the second hotword, executing, by the data processing hardware, a collaboration routine to cause the first AED and the second AED to collaborate with one another to fulfill performance of the operation specified by the single query directed to both the first AED and the second AED.