US 12,267,585 B2
Ultra low power camera pipeline for CV in AR systems
Bo Ding, Los Angeles, CA (US); Chintan Doshi, Marina Del Rey, CA (US); Alexander Kane, Vienna (AT); Anton Kondratenko, San Ramon, CA (US); Gerald Nilles, Culver City, CA (US); John James Robertson, Los Angeles, CA (US); Dmitry Ryuma, Sherman Oaks, CA (US); and Matthias Kalkgruber, Vienna (AT)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Sep. 27, 2021, as Appl. No. 17/485,761.
Claims priority of provisional application 63/085,257, filed on Sep. 30, 2020.
Prior Publication US 2022/0103752 A1, Mar. 31, 2022
Int. Cl. H04N 23/45 (2023.01); G02C 11/00 (2006.01); H04N 23/57 (2023.01); H04N 23/65 (2023.01); H04N 23/667 (2023.01); H04N 23/80 (2023.01); H04N 23/88 (2023.01)
CPC H04N 23/667 (2023.01) [G02C 11/10 (2013.01); H04N 23/57 (2023.01); H04N 23/651 (2023.01); H04N 23/80 (2023.01); H04N 23/88 (2023.01)] 16 Claims
OG exemplary drawing
 
1. An eyewear, comprising:
a frame;
a display supported by the frame;
a plurality of cameras coupled to the frame and configured to generate images, wherein the plurality of cameras is configured to provide images having a first resolution in a high power augmented reality (AR) mode, and to provide images having a second resolution in a low power computer vision (CV) mode;
a camera pipeline;
an ambient light sensor (ALS);
a processor configured to:
selectively control the plurality of cameras to provide the images, wherein each of the plurality of cameras is configured to provide the images having the first resolution in the AR mode;
selectively control the plurality of cameras such that only one of the plurality of cameras is configured to provide the images having a second resolution in the CV mode, wherein the first resolution is higher than the second resolution, and wherein the plurality of cameras consume less power in the CV mode than the AR mode;
control the camera pipeline to perform an auto white balance (AWB) process on the first resolution images from each of the plurality of cameras, without using data from the ALS; and
control the camera pipeline to perform an AWB process on the second resolution images from the one of the plurality of cameras, using data from the ALS.