US 12,260,144 B2
Controlling external devices using reality interfaces
Justin D. Stoyles, San Francisco, CA (US); and Michael Kuhn, Baierbrunn, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Aug. 18, 2023, as Appl. No. 18/235,693.
Application 18/235,693 is a continuation of application No. 17/394,114, filed on Aug. 4, 2021, granted, now 11,762,619.
Application 17/394,114 is a continuation of application No. 16/802,320, filed on Feb. 26, 2020, granted, now 11,086,581, issued on Aug. 10, 2021.
Application 16/802,320 is a continuation of application No. PCT/US2018/053422, filed on Sep. 28, 2018.
Claims priority of provisional application 62/734,678, filed on Sep. 21, 2018.
Claims priority of provisional application 62/566,206, filed on Sep. 29, 2017.
Claims priority of provisional application 62/566,080, filed on Sep. 29, 2017.
Claims priority of provisional application 62/566,073, filed on Sep. 29, 2017.
Prior Publication US 2023/0393796 A1, Dec. 7, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/14 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06F 3/0346 (2013.01); G06F 3/04815 (2022.01); G06F 3/04842 (2022.01); G06T 7/73 (2017.01); G06T 19/00 (2011.01); G06V 20/20 (2022.01); G06V 40/20 (2022.01); H04B 5/70 (2024.01)
CPC G06F 3/1423 (2013.01) [G02B 27/0093 (2013.01); G02B 27/017 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/0346 (2013.01); G06F 3/04815 (2013.01); G06F 3/04842 (2013.01); G06T 7/74 (2017.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); G06V 40/20 (2022.01); H04B 5/70 (2024.01); G02B 2027/0187 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
a display;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
providing, through the display, a view of a physical environment that includes an external device, wherein at least a portion of the external device is visible through a first position of the display;
receiving, from the external device, information specifying a function of the external device; and
while providing the view of the physical environment, displaying, on the display, an affordance corresponding to the function at the first position overlaying at least the portion of the external device, wherein detecting user activation of the affordance causes the external device to perform an action corresponding to the function.