US 12,105,874 B2
Device control using gaze information
Sean B. Kelly, San Francisco, CA (US); Felipe Bacim De Araujo E Silva, San Jose, CA (US); and Karlin Y. Bark, San Carlos, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Feb. 2, 2023, as Appl. No. 18/105,191.
Application 18/105,191 is a continuation of application No. 17/087,855, filed on Nov. 3, 2020, granted, now 11,619,991.
Application 17/087,855 is a continuation of application No. 16/553,622, filed on Aug. 28, 2019, granted, now 10,860,096, issued on Dec. 8, 2020.
Claims priority of provisional application 62/739,087, filed on Sep. 28, 2018.
Prior Publication US 2023/0185373 A1, Jun. 15, 2023
Int. Cl. G06F 3/01 (2006.01); G06F 3/16 (2006.01); G10L 15/22 (2006.01)
CPC G06F 3/013 (2013.01) [G06F 3/165 (2013.01); G06F 3/167 (2013.01); G10L 15/22 (2013.01); G10L 2015/223 (2013.01)] 51 Claims
OG exemplary drawing
 
1. An electronic device, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
while a first external device is in a first state:
receiving, from a user, a first portion of a first command, wherein the first portion of the first command specifies a first action to be performed; and
after receiving the first portion of the first command:
obtaining, using one or more camera sensors, first gaze information; and
while obtaining the first gaze information, receiving, from the user, a second portion of the first command, wherein:
 the second portion of the first command specifies a respective device for the first command to be directed towards; and
 the first portion of the first command and the second portion of the first command complete an instruction to transition the first external device from the first state to a second state; and
in accordance with a determination, using the first gaze information, that a set of one or more gaze criteria is met for the first external device:
transmitting, based on the first command that includes the first portion of the first command and the second portion of the first command, the instruction to transition the first external device from the first state to the second state, wherein the instruction is determined based on at least the first portion of the first command.