US 12,175,746 B2
Controlling IoT devices through AR object interaction
Yu Jiang Tham, Seattle, WA (US); Rajan Vaish, Beverly Hills, CA (US); Andrés Monroy-Hernández, Seattle, WA (US); Sven Kratz, Mercer Island, WA (US); and Ana Maria Cardenas Gasca, Pasadena, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Yu Jiang Tham, Seattle, WA (US); Rajan Vaish, Beverly Hills, CA (US); Andrés Monroy-Hernández, Seattle, WA (US); Sven Kratz, Mercer Island, WA (US); and Ana Maria Cardenas Gasca, Pasadena, CA (US)
Filed on Aug. 29, 2021, as Appl. No. 17/460,230.
Prior Publication US 2023/0063194 A1, Mar. 2, 2023
Int. Cl. G06V 20/20 (2022.01); A63F 13/216 (2014.01); A63F 13/217 (2014.01); G06F 3/04847 (2022.01); G06T 19/00 (2011.01); G16Y 40/30 (2020.01); H04L 67/12 (2022.01)
CPC G06V 20/20 (2022.01) [A63F 13/216 (2014.09); A63F 13/217 (2014.09); G06F 3/04847 (2013.01); G06T 19/006 (2013.01); G16Y 40/30 (2020.01); H04L 67/12 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method of controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) object, comprising:
receiving from a first AR camera device at least one AR object and particular world coordinates associated with the at least one AR object;
pairing the at least one AR object with at least one IoT device;
receiving a request from the first AR camera device to present the at least one AR object to a display of a second AR camera device specified by the first AR camera device only once the second AR camera device has arrived at the particular world coordinates;
tracking a position of the second AR camera device in world coordinates;
receiving an indication that the second AR camera device has arrived at the particular world coordinates;
presenting the at least one AR object on the display of the second AR camera device upon receipt of the indication that the second AR camera device has arrived at the particular world coordinates;
receiving an interaction signal indicating that the at least one AR object on the display of the second AR camera device has been interacted with; and
sending a control signal to the at least one IoT device paired with the at least one AR object in response to the interaction signal.