CPC G06F 3/04815 (2013.01) [G06F 3/017 (2013.01); G06N 3/02 (2013.01); G06N 20/00 (2019.01); G06T 19/006 (2013.01); G06V 10/464 (2022.01); G06V 20/20 (2022.01); G06V 40/107 (2022.01)] | 18 Claims |
1. A wearable system for providing a virtual remote control in a mixed reality environment, the wearable system comprising:
a mixed reality display for presenting a virtual image to a user;
an outward-facing imaging system configured to image an environment of the user; and
a hardware processor programmed to:
identify a physical remote associated with a parent device;
generate a virtual remote based at least partly on specifications of the physical remote, the virtual remote comprises a virtual button associated with an active volume of space;
cause the display to render the virtual remote;
cause the display to render a focus indicator, the focus indicator connecting the virtual remote with the parent device, such that the focus indicator identifies that the virtual remote is associated with the parent device by visually connecting the virtual remote rendered by the mixed reality display with at least one of (i) a real-world view of the parent device as seen by the user through the wearable system, or (ii) a real-world view of the physical remote as seen by the user through the wearable system:
identify an actuation of the virtual remote indicating an interaction with the parent device:
transmit an instruction to the parent device causing the parent device to perform a function as if the physical remote is actuated; and
cause the mixed reality display to generate a second focus indicator for the virtual button when movement of the virtual button passes a threshold condition comprising at least one of a threshold position, a threshold duration, or a threshold velocity.
|