| CPC G06F 3/011 (2013.01) [G06F 3/017 (2013.01); G06F 3/0334 (2013.01); G06V 10/255 (2022.01); G06V 40/20 (2022.01); G16Y 20/40 (2020.01); H04N 13/111 (2018.05)] | 20 Claims |

|
1. A method of controlling an Internet of Things (IoT) product using an electronic eyewear device comprising a camera and a display, the method comprising:
capturing frames of video data using the camera;
detecting the IoT product at an IoT product location in a physical environment based on the frames of video data;
estimating a current eyewear device location relative to the IoT product location;
detecting a foot shape at a foot location relative to the physical environment based on the frames of video data;
establishing a virtual plane relative to the display based on the foot location and the current eyewear device location;
presenting on the display a virtual control interface along the virtual plane according to the IoT product location;
detecting the foot shape performing a foot action relative to the virtual control interface; and
sending a control signal to the IoT product in accordance with the foot action, wherein the control signal comprises instructions associated with an IoT action.
|