US 12,248,659 B2
Providing composite graphical assistant interfaces for controlling various connected devices
Yuzhao Ni, Sunnyvale, CA (US); and David Roy Schairer, San Jose, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on May 23, 2023, as Appl. No. 18/200,979.
Application 18/200,979 is a continuation of application No. 17/676,624, filed on Feb. 21, 2022.
Application 17/676,624 is a continuation of application No. 16/480,523, granted, now 11,256,390, issued on Feb. 22, 2022, previously published as PCT/US2019/016371, filed on Feb. 1, 2019.
Claims priority of provisional application 62/668,131, filed on May 7, 2018.
Prior Publication US 2023/0297214 A1, Sep. 21, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/0484 (2022.01); G06F 3/04812 (2022.01); G06F 3/0482 (2013.01); G10L 15/22 (2006.01); H04L 12/28 (2006.01); H04L 67/12 (2022.01)
CPC G06F 3/0482 (2013.01) [G06F 3/04812 (2013.01); G06F 3/0484 (2013.01); G10L 15/22 (2013.01); H04L 12/282 (2013.01); H04L 67/12 (2013.01); G10L 2015/223 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
determining that a spoken utterance, detected via an automated assistant interface of a client device, includes a request for an automated assistant to cause a first connected device, that is linked to the client device, to perform a first function, wherein the spoken utterance is provided by a user;
identifying, in response to determining the request was provided by the user, the first function that corresponds to the request provided by the user;
causing, based on identifying the first function, the first connected device to perform the first function that corresponds to the request provided by the user;
determining, based on a label assigned to the first connected device that performs the first function, a location assigned to the first connected device;
identifying a second connected device that is linked to the client device, wherein identifying the second connected device is based on the second connected device being assigned to the location that is assigned to the first connected device and wherein identifying the second connected device is further based on a historical inclination of one or more users to cause the second connected device to perform a second function;
determining a graphical control element for causing the second connected device to perform the second function; and
causing, in response to determining the request was received, a display panel associated with the client device to provide a graphical assistant interface for controlling the second connected device, wherein the display panel includes the graphical control element.