CPC G06T 11/00 (2013.01) [G02B 27/0172 (2013.01); G02C 11/10 (2013.01); G10L 25/51 (2013.01); H04R 1/028 (2013.01); H04R 1/08 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0141 (2013.01); G02B 2027/0178 (2013.01); H04R 2499/15 (2013.01)] | 20 Claims |
1. An eyewear device, including:
a frame;
a temple extending from a lateral side of the frame;
a see-through optical assembly supported by the frame, the see-through optical assembly having a viewing area for viewing a scene and configured to present audio-based visual overlays to a user over the scene in the viewing area;
a camera connected to the frame or the temple to capture images of the scene;
a processor connected to the camera;
a memory accessible to the processor; and
programming in the memory, wherein execution of the programming by the processor configures the eyewear device to perform functions, including functions to:
capture, via the camera, the images of the scene and a pre-recorded or live audio signal;
identify at least one feature within the captured images;
receive at least one of prerecorded lyrics or words, a single static image, a video clip, or a series of images that is at least one of related to or synchronized to the prerecorded or live audio signal;
register the at least one of prerecorded lyrics or words, a single static image, a video clip, or a series of images to the at least one identified feature within the captured images;
create the audio-based visual overlays, the audio-based visual overlays including the at least one of prerecorded lyrics or words, a single static image, a video clip, or a series of images that has been registered to the at least one identified feature within the captured images;
display, via the see-through optical assembly, the audio-based visual overlays over the scene in the viewing area; and
present the prerecorded or live audio signal synchronized to the audio-based visual overlays.
|