US 12,260,061 B2
Interface for engaging IoT devices with AR camera
Shin Hwun Kang, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Oct. 23, 2023, as Appl. No. 18/382,872.
Application 18/382,872 is a continuation of application No. 17/565,656, filed on Dec. 30, 2021, granted, now 11,809,680, issued on Nov. 7, 2023.
Prior Publication US 2024/0053858 A1, Feb. 15, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/04815 (2022.01); G06F 3/01 (2006.01); G06F 3/04886 (2022.01); G06T 11/00 (2006.01); G06V 20/20 (2022.01); G16Y 40/30 (2020.01); H04N 23/63 (2023.01); G06F 3/04842 (2022.01)
CPC G06F 3/04815 (2013.01) [G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06F 3/04886 (2013.01); G06T 11/00 (2013.01); G06V 20/20 (2022.01); G16Y 40/30 (2020.01); H04N 23/63 (2023.01); G06F 3/04842 (2013.01); G06T 2200/24 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A universal visual remote control system that controls at least one Internet of Things (IoT) device, comprising:
an eyewear device that includes a display and an augmented reality (AR) camera device;
a memory including an interactable overlay and control information associated with the at least one IoT device;
a processor; and
at least one non-transitory computer readable medium having stored thereon first instructions, wherein execution of the first instructions by the processor causes the processor to register the interactable overlay with the at least one IoT device and present the interactable overlay to the display of the eyewear device when the at least one IoT device is in a field of view of the AR camera device of the eyewear device, and second instructions, wherein execution of the second instructions by the processor causes the processor to receive an indication that a user has pointed the eyewear device at the interactable overlay associated with the at least one IoT device on the display of the eyewear device whereby the AR camera device points at the interactable overlay and to generate and send a control signal based on the control information associated with the interactable overlay pointed at by the AR camera device to the at least one IoT device that is associated with the interactable overlay pointed at by the AR camera device.