| CPC G06T 19/006 (2013.01) [G06F 3/0484 (2013.01); G06F 3/0488 (2013.01); G06T 13/40 (2013.01); G06V 20/70 (2022.01); G10L 15/22 (2013.01); G10L 2015/223 (2013.01)] | 16 Claims |
|
1. A method of presenting a virtual tour experience with an eyewear device, the eyewear device comprising a camera, a microphone, a loudspeaker, a guided tour application, an image processing system, and a display, the method comprising:
capturing frames of video data within a field of view of the camera;
detecting, in the captured frames of video data, with the image processing system, a container at a current container position relative to the display;
retrieving data associated with the detected container;
presenting, based on the retrieved data, a contextual overlay adjacent the current container position on the display;
presenting an avatar at an avatar position relative to the display; and
playing, through the avatar, a start message based on the retrieved data;
detecting, in the captured frames of video data, a first action associated with the container and a second container:
determining whether the detected first action matches a first predefined activity from among a plurality of predefined activities stored in an activity library;
presenting on the display a virtual tour experience in accordance with the first predefined activity, comprising presenting a video on the display adjacent the avatar position and in correlation with a lecture presented through the avatar;
detecting a subsequent action;
determining whether the detected subsequent action matches a subsequent predefined activity from among a plurality of predefined activities; and
presenting on the display a subsequent virtual tour experience in accordance with the subsequent predefined activity.
|