US 12,243,190 B2
Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
Dan Lelescu, Morgan Hill, CA (US); Gabriel Molina, Grass Valley, CA (US); and Kartik Venkataraman, San Jose, CA (US)
Assigned to Adeia Imaging LLC, San Jose, CA (US)
Filed by Adeia Imaging LLC, San Jose, CA (US)
Filed on Nov. 8, 2023, as Appl. No. 18/504,684.
Application 18/504,684 is a continuation of application No. 17/821,258, filed on Aug. 22, 2022, granted, now 11,875,475.
Application 17/821,258 is a continuation of application No. 17/098,432, filed on Nov. 15, 2020, granted, now 11,423,513, issued on Aug. 23, 2022.
Application 17/098,432 is a continuation of application No. 16/521,365, filed on Jul. 24, 2019, granted, now 10,839,485, issued on Nov. 17, 2020.
Application 16/521,365 is a continuation of application No. 15/170,788, filed on Jun. 1, 2016, granted, now 10,366,472, issued on Jul. 30, 2019.
Application 15/170,788 is a continuation of application No. 14/519,659, filed on Oct. 21, 2014, granted, now 9,361,662, issued on Jun. 7, 2016.
Application 14/519,659 is a continuation of application No. 12/967,807, filed on Dec. 14, 2010, granted, now 8,878,950, issued on Nov. 4, 2014.
Prior Publication US 2024/0169483 A1, May 23, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 23/951 (2023.01); G06T 3/4007 (2024.01); G06T 3/4053 (2024.01); G06T 3/4076 (2024.01); G06T 5/00 (2006.01); G06T 5/50 (2006.01); G06T 5/80 (2024.01); H04N 13/106 (2018.01); H04N 13/111 (2018.01); H04N 13/128 (2018.01); H04N 13/139 (2018.01); H04N 13/156 (2018.01); H04N 23/62 (2023.01); G06T 5/20 (2006.01); G06T 5/70 (2024.01); H04N 13/204 (2018.01); H04N 13/246 (2018.01); H04N 13/271 (2018.01)
CPC G06T 3/4053 (2013.01) [G06T 3/4007 (2013.01); G06T 3/4076 (2013.01); G06T 5/00 (2013.01); G06T 5/50 (2013.01); G06T 5/80 (2024.01); H04N 13/106 (2018.05); H04N 13/111 (2018.05); H04N 13/128 (2018.05); H04N 13/139 (2018.05); H04N 23/62 (2023.01); H04N 23/951 (2023.01); G06T 5/20 (2013.01); G06T 5/70 (2024.01); G06T 2207/10004 (2013.01); G06T 2207/10012 (2013.01); G06T 2207/20182 (2013.01); G06T 2207/20192 (2013.01); G06T 2207/20221 (2013.01); H04N 13/156 (2018.05); H04N 13/204 (2018.05); H04N 13/246 (2018.05); H04N 13/271 (2018.05)] 20 Claims
OG exemplary drawing
 
1. A method for synthesizing high resolution (HR) images, comprising:
acquiring a plurality of low resolution (LR) images from different viewpoints, where the plurality of LR images capture a scene in which depths of points in the scene vary and each of the plurality of LR images differs from other LR images due to scene dependent geometric displacements due to parallax;
determining scene dependent parallax information with respect to the LR images based upon disparity relative to a reference point of view resulting from the depths of points in the captured scene; and
fusing at least portions of the LR images to form a HR image by:
populating a high resolution (HR) grid corresponding to pixel locations of the HR image with LR image samples from the LR images using the scene dependent parallax information; and
interpolating samples at grid position of the HR grid using neighboring available samples from the LR image samples placed on the HR grid;
storing the HR image.