US 11,968,449 B2
Camera lens smoothing method and portable terminal
Cong Chen, Shenzhen (CN); Zhuo Guo, Shenzhen (CN); and Jingkang Liu, Shenzhen (CN)
Assigned to ARASHI VISION INC., Shenzhen (CN)
Filed by ARASHI VISION INC., Shenzhen (CN)
Filed on Jan. 20, 2022, as Appl. No. 17/579,670.
Application 17/579,670 is a continuation of application No. PCT/CN2020/101987, filed on Jul. 15, 2020.
Claims priority of application No. 201910664290.2 (CN), filed on Jul. 23, 2019.
Prior Publication US 2022/0141387 A1, May 5, 2022
Int. Cl. H04N 23/68 (2023.01); G06T 3/60 (2006.01); G06T 5/70 (2024.01)
CPC H04N 23/683 (2023.01) [G06T 3/60 (2013.01); G06T 5/70 (2024.01); H04N 23/6812 (2023.01)] 17 Claims
OG exemplary drawing
 
1. A camera lens smoothing method, comprising the steps of:
obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a first rotation matrix of a current pose of the camera;
conducting smoothing on the first rotation matrix, and calculating a third rotation matrix;
conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix;
conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video;
wherein the conducting smoothing on the first rotation matrix, and calculating a third rotation matrix specifically comprises:
conducting first smoothing on the first rotation matrix to obtain a second rotation matrix; and
calculating the third rotation matrix of the camera by limiting smoothing maximum amplitude value;
wherein a method of conducting first smoothing on the first rotation matrix to obtain the second rotation matrix specifically comprises: conducting first smoothing on a quaternion of the first rotation matrix with constrained least squares by employing N+1 windows, and calculating the second rotation matrix.