US 11,900,561 B2
Deep learning-based image stitching method and apparatus
Gi Mun Um, Daejeon (KR); Hee Kyung Lee, Daejeon (KR); Dae-Young Song, Daejeon (KR); and Donghyeon Cho, Daejeon (KR)
Assigned to ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, Daejeon (KR); and THE INDUSTRY & ACADEMIC COOPERATION IN CHUNGNAM NATIONAL UNIVERSITY, Daejeon (KR)
Filed by ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, Daejeon (KR); and THE INDUSTRY & ACADEMIC COOPERATION IN CHUNGNAM NATIONAL UNIVERSITY (IAC), Daejeon (KR)
Filed on Nov. 22, 2021, as Appl. No. 17/532,880.
Claims priority of application No. 10-2020-0160113 (KR), filed on Nov. 25, 2020; and application No. 10-2021-0105961 (KR), filed on Aug. 11, 2021.
Prior Publication US 2022/0164922 A1, May 26, 2022
Int. Cl. G06T 3/40 (2006.01); G06T 3/00 (2006.01); G06F 18/22 (2023.01); G06F 18/213 (2023.01)
CPC G06T 3/4038 (2013.01) [G06F 18/213 (2023.01); G06F 18/22 (2023.01); G06T 3/0093 (2013.01); G06T 3/4046 (2013.01)] 13 Claims
OG exemplary drawing
 
1. A deep learning-based image stitching method, the method comprising:
receiving a plurality of images comprising a first image and a second image to be stitched to the first image;
extracting a feature map of the plurality of images;
generating a plurality of flow maps indicating movement information of pixels of the plurality of images, based on the feature map;
generating a plurality of warping images in which the pixels of the plurality of images are moved, by applying the plurality of flow maps to the plurality of images, respectively;
generating a plurality of weight maps for blending the plurality of warping images, based on the feature map, and
generating a stitch image in which the first image and the second image are stitched, by blending the plurality of warping images based on the plurality of weight maps,
wherein the generating of the plurality of flow maps comprises:
generating a first flow map indicating movement information of pixels of the first image; and
generating a second flow map indicating movement information of pixels of the second image.