US 12,299,902 B2
Method, electronic device, and computer program product for processing video
Yuhong Nie, Shanghai (CN); Tianxiang Chen, Shanghai (CN); Sanping Li, Beijing (CN); Anzhou Hou, Shanghai (CN); and Zhen Jia, Shanghai (CN)
Assigned to Dell Products L.P., Round Rock, TX (US)
Filed by Dell Products L.P., Round Rock, TX (US)
Filed on Feb. 10, 2022, as Appl. No. 17/668,537.
Claims priority of application No. 202210074309.X (CN), filed on Jan. 21, 2022.
Prior Publication US 2023/0237675 A1, Jul. 27, 2023
Int. Cl. G06T 7/246 (2017.01); G06N 3/049 (2023.01)
CPC G06T 7/248 (2017.01) [G06N 3/049 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
acquiring a video, in a first stage of a multi-stage video processing system executing on processor and memory resources of at least one computing device, the multi-stage video processing system comprising a plurality of separate sequential processing stages including the first stage and at least a second stage following the first stage, wherein the video comprises at least a current frame and a previous frame that are adjacent to each other;
determining, in the first stage of the multi-stage video processing system and based on a first pixel value of a pixel in the current frame and a second pixel value of a corresponding pixel in the previous frame, whether the current frame has changed relative to the previous frame, the determining of whether the current frame has changed relative to the previous frame being performed at least in part by at least one neural network of the first stage of the multi-stage video processing system;
determining, in the first stage of the multi-stage video processing system, availability of the current frame for a computer vision task that is implemented in the second stage of the multi-stage video processing system, by determining in the neural network of the first stage, utilizing pulse arrays generated as respective encodings of the first and second pixel values, whether or not the current frame has changed relative to the previous frame, wherein the current frame is determined as available for the computer vision task responsive to the current frame having changed relative to the previous frame, and the current frame is determined as not available for the computer vision task responsive to the current frame not having changed relative to the previous frame; and
controlling utilization of the second stage to perform the computer vision task for the current frame based on the determined availability of the current frame, wherein controlling utilization of the second stage to perform the computer vision task for the current frame comprises utilizing the second stage to perform the computer vision task for the current frame responsive to the current frame being determined as available, and bypassing utilization of the second stage to perform the computer vision task for the current frame responsive to the current frame being determined as not available;
wherein performance of the computer vision task implemented in the second stage is selectively bypassed for the current frame responsive to the controlling based on the determined availability of the current frame, to reduce a power consumption of the multi-stage video processing system in processing the video.