US 11,748,895 B2
Method and apparatus for processing video frame
Tianwei Lin, Beijing (CN); Xin Li, Beijing (CN); Fu Li, Beijing (CN); Dongliang He, Beijing (CN); Hao Sun, Beijing (CN); and Henan Zhang, Beijing (CN)
Assigned to Beijing Baidu Netcom Science and Technology Co., Ltd., Beijing (CN)
Filed by Beijing Baidu Netcom Science and Technology Co., Ltd., Beijing (CN)
Filed on Feb. 24, 2021, as Appl. No. 17/184,379.
Claims priority of application No. 202010320935.3 (CN), filed on Apr. 22, 2020.
Prior Publication US 2021/0334579 A1, Oct. 28, 2021
Int. Cl. G06K 9/00 (2022.01); G06T 7/246 (2017.01); G06N 3/04 (2023.01); G06V 20/40 (2022.01); G06F 18/25 (2023.01)
CPC G06T 7/246 (2017.01) [G06F 18/253 (2023.01); G06N 3/04 (2013.01); G06V 20/41 (2022.01); G06V 20/46 (2022.01)] 13 Claims
OG exemplary drawing
 
1. A method for processing a video frame, comprising:
converting, using an optical flow generated based on a previous frame and a next frame of adjacent frames in a video, a feature map of the previous frame to obtain a converted feature map;
determining, based on an error of the optical flow, a weight of the converted feature map, and obtaining a fused feature map based on a weighted result of a feature of the converted feature map and a feature of a feature map of the next frame; and
updating the feature map of the next frame to obtain an updated feature map, the updated feature map being the fused feature map,
wherein the optical flow is a dense optical flow; and the method further comprises:
contracting the previous frame to a size of the feature map of the previous frame to obtain a contracted previous frame; contracting the next frame to a size of the feature map of the next frame to obtain a contracted next frame; determining a dense optical flow between the contracted previous frame and the contracted next frame; and using the dense optical flow as the optical flow generated based on the previous frame and the next frame of the adjacent frames in the video.