US 11,721,045 B2
Audio-triggered augmented reality eyewear device
David Meisenholder, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Nov. 29, 2021, as Appl. No. 17/536,944.
Application 17/536,944 is a continuation of application No. 16/730,689, filed on Dec. 30, 2019, granted, now 11,232,601, issued on Jan. 25, 2022.
Prior Publication US 2022/0084259 A1, Mar. 17, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G09G 5/00 (2006.01); G06T 11/00 (2006.01); H04R 1/02 (2006.01); H04R 1/08 (2006.01); G10L 25/51 (2013.01); G02B 27/01 (2006.01); G02C 11/00 (2006.01)
CPC G06T 11/00 (2013.01) [G02B 27/0172 (2013.01); G02C 11/10 (2013.01); G10L 25/51 (2013.01); H04R 1/028 (2013.01); H04R 1/08 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0141 (2013.01); G02B 2027/0178 (2013.01); H04R 2499/15 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An eyewear device, including:
a frame;
a temple extending from a lateral side of the frame;
a see-through optical assembly supported by the frame, the see-through optical assembly having a viewing area for viewing a scene and configured to present audio-based visual overlays to a user over the scene in the viewing area;
a camera connected to the frame or the temple to capture images of the scene;
a processor connected to the camera;
a memory accessible to the processor; and
programming in the memory, wherein execution of the programming by the processor configures the eyewear device to perform functions, including functions to:
capture, via the camera, the images of the scene and a pre-recorded or live audio signal;
identify at least one feature within the captured images;
receive at least one of prerecorded lyrics or words, a single static image, a video clip, or a series of images that is at least one of related to or synchronized to the prerecorded or live audio signal;
register the at least one of prerecorded lyrics or words, a single static image, a video clip, or a series of images to the at least one identified feature within the captured images;
create the audio-based visual overlays, the audio-based visual overlays including the at least one of prerecorded lyrics or words, a single static image, a video clip, or a series of images that has been registered to the at least one identified feature within the captured images;
display, via the see-through optical assembly, the audio-based visual overlays over the scene in the viewing area; and
present the prerecorded or live audio signal synchronized to the audio-based visual overlays.