| CPC H04L 67/12 (2013.01) [G06F 3/16 (2013.01); G06V 10/758 (2022.01); G06V 10/98 (2022.01); G06V 20/80 (2022.01); G16Y 10/75 (2020.01); G16Y 40/35 (2020.01); G16Y 40/60 (2020.01); H04N 23/66 (2023.01); G06V 2201/02 (2022.01)] | 40 Claims |

|
1. An extended reality (XR) headset for localizing one or more devices, the XR headset comprising:
at least one memory; and
at least one processor coupled to the at least one memory, the at least one processor being configured to:
send, to a connected device coupled to the XR headset, a signal configured to trigger an identification output from the connected device, wherein the connected device is located in a physical environment;
receive the identification output from the connected device in response to the signal, the identification output comprising at least one of an audio pattern, a display pattern, or a light pattern;
based on the identification output from the connected device, determine a location of the connected device in the physical environment;
map the location of the connected device in the physical environment to a location in a coordinate system of the XR headset;
update a device map to include the connected device at the location in the coordinate system of the XR headset, the device map including a mapping of connected devices localized relative to the XR headset in the coordinate system of the XR headset;
detect a user input directed at the location in the physical environment; and
generate one or more commands to control the connected device in response to the user input and a determination, from the device map based on the detected user input, that the connected device is mapped to the location in the coordinate system of the XR headset.
|