US 12,154,278 B2
Scale image resolution for motion estimation
Nitin Bandwar, San Diego, CA (US); Pia Zobel, Hinanit (IL); Roee Hardoon, Zichron Yaakov (IL); Sungwon Lee, Huntington Beach, CA (US); Tauseef Kazi, San Diego, CA (US); and Bing Han, San Diego, CA (US)
Assigned to QUALCOMM Incorporated, San Diego, CA (US)
Filed by QUALCOMM Incorporated, San Diego, CA (US)
Filed on Jun. 29, 2022, as Appl. No. 17/853,422.
Prior Publication US 2024/0005518 A1, Jan. 4, 2024
Int. Cl. G06T 7/207 (2017.01); G06T 7/215 (2017.01)
CPC G06T 7/207 (2017.01) [G06T 7/215 (2017.01)] 30 Claims
OG exemplary drawing
 
1. An apparatus for processing image data, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory, the at least one processor configured to:
determine, using a higher-power motion estimation pipeline, a dense motion map between a first input image and a first reference image, the dense motion map indicating local motion between pixels in the first input image and pixels in the first reference image;
determine that the local motion indicated by the dense motion map is below a first threshold;
in response to a determination that the local motion indicated by the motion vectors dense motion map is below the first threshold, switch from the higher-power motion estimation pipeline to a lower-power motion estimation pipeline for a second input image and a second reference image, wherein, using the lower-power motion estimation pipeline, the at least one processor is configured to:
determine, using descriptor matching estimation, motion vectors indicating global motion between the second input image and the second reference image;
refrain from determining a dense motion map between the second input image and the second reference image;
refrain from performing image alignment between the second input image and the second reference image; and
warp the motion vectors using a global stabilization matrix to generate a transform matrix without using the dense motion map between the second input image and the second reference image; and
perform image stabilization for the second input image using the transform matrix.