US 12,081,880 B2
Image super-resolution with reference images from one or more cameras
Jing Zhu, Jackson Heights, NY (US); Wenbo Li, Santa Clara, CA (US); and Hongxia Jin, San Jose, CA (US)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Oct. 4, 2021, as Appl. No. 17/493,268.
Claims priority of provisional application 63/187,301, filed on May 11, 2021.
Prior Publication US 2022/0368829 A1, Nov. 17, 2022
Int. Cl. H04N 23/951 (2023.01); G06T 5/20 (2006.01); G06T 5/50 (2006.01); G06T 5/75 (2024.01)
CPC H04N 23/951 (2023.01) [G06T 5/20 (2013.01); G06T 5/50 (2013.01); G06T 5/75 (2024.01); G06T 2207/20016 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method of forming a super resolution image, the method comprising:
generating a plurality of auxiliary images from a plurality of original images, wherein the plurality of original images includes a low resolution image, a first medium resolution image and a high resolution image, and the high resolution image covers a portion of a content of the low resolution image but with higher resolution, and wherein the plurality of auxiliary images includes a second medium resolution image made blurry by a downsample operation and an upsample operation applied to the first medium resolution image;
obtaining a plurality of feature vectors from the plurality of original images and from the plurality of auxiliary images;
combining, based on a plurality of indices, a higher resolution feature vector with a lower resolution feature vector, and
generating the super resolution image based on the combined feature vectors.