US 12,333,084 B2
Assistant device arbitration using wearable device data
Alexander Chu, Berkeley, CA (US); and Jarlan Perez, Norwalk, CT (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Apr. 22, 2024, as Appl. No. 18/642,099.
Application 18/642,099 is a continuation of application No. 17/947,458, filed on Sep. 19, 2022, granted, now 11,966,518.
Application 17/947,458 is a continuation of application No. 17/166,763, filed on Feb. 3, 2021, granted, now 11,449,149, issued on Sep. 20, 2022.
Prior Publication US 2024/0272725 A1, Aug. 15, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01); G06T 19/00 (2011.01)
CPC G06F 3/017 (2013.01) [G02B 27/017 (2013.01); G06F 3/013 (2013.01); G06T 19/006 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0178 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
determining that a user located in an environment has directed an assistant input to an automated assistant that interacts with multiple computing devices that are connected to a network and that are also located in the environment,
wherein the user is wearing computerized glasses of the multiple computing devices, and wherein the computerized glasses include one or more cameras and a display interface;
determining, based on processing the assistant input:
an action specified by the assistant input, and
a first computing device via which the action can be performed, the first computing device being one of the multiple computing devices and being separate from the computerized glasses;
in response to the assistant input, and in response to determining the action and the first computing device:
causing an icon, that indicates the action, to be rendered, at the display interface of the computerized glasses using augmented reality, above the first computing device; and
in response to determining occurrence of a user selection that is directed to rendering of the icon at the display interface using augmented reality:
causing the first computing device to perform the action associated with the assistant input.