US 12,293,494 B2
Methods and systems for video stabilization
Tingniao Wang, Hangzhou (CN); and Xiaomu Liu, Hangzhou (CN)
Assigned to ZHEJIANG DAHUA TECHNOLOGY CO., LTD., Hangzhou (CN)
Filed by ZHEJIANG DAHUA TECHNOLOGY CO., LTD., Zhejiang (CN)
Filed on Dec. 31, 2021, as Appl. No. 17/646,684.
Application 17/646,684 is a continuation of application No. PCT/CN2019/130391, filed on Dec. 31, 2019.
Claims priority of application No. 201910605353.7 (CN), filed on Jul. 5, 2019.
Prior Publication US 2022/0122230 A1, Apr. 21, 2022
Int. Cl. G06K 9/00 (2022.01); G06T 5/73 (2024.01); G06T 7/246 (2017.01)
CPC G06T 5/73 (2024.01) [G06T 7/246 (2017.01); G06T 2207/10016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for video stabilization, comprising:
at least one storage device storing a set of instructions; and
at least one processor in communication with the at least one storage device, wherein when executing the set of instructions, the at least one processor is configured to stabilize a video frame-by-frame from a second frame of the video by repeating operations including:
obtaining a target frame of the video, the target frame being a current frame to be stabilized in the video;
obtaining a plurality of feature points to be tracked in the target frame;
determining whether the plurality of feature points to be tracked in the target frame include at least one feature point relating to a moving object in the video;
in response to a determination that the plurality of feature points to be tracked in the target frame include at least one feature point relating to the moving object in the video, removing the at least one feature point relating to the moving object;
estimating one or more first motion parameters based on the remaining feature points of the plurality of feature points to be tracked in the target frame, the one or more first motion parameters including a homography matrix;
performing video stabilization to the target frame based on the one or more first motion parameters;
determining whether the target frame is a last frame of the video;
in response to determining that the target frame is the last frame of the video, terminating the video stabilization;
in response to determining that the target frame is not the last frame of the video,
identifying, in the target frame after the video stabilization, at least one supplement feature point that is different from the remaining feature points of the plurality of feature points to be tracked in the target frame;
designating the at least one supplement feature point and the remaining feature points as a plurality of feature points to be tracked in a frame immediately following the target frame in the video, a count of the at least one supplement feature point being equal to a count of at least one removed feature point so that a count the plurality of feature points to be tracked in the target frame is equal to a count of the plurality of feature points to be tracked in the frame immediately following the target frame; and
initiating a new repetition of the operations.