US 12,143,696 B2
Video summarization method for enabling easy identification of relevance between appearing objects in event
Yoon Kim, Seoul (KR); Poo Reum Lee, Chuncheon-si (KR); Hee Cheol Kim, Chuncheon-si (KR); and Jung In An, Gangwon-do (KR)
Assigned to ZIOVISION Co., Ltd., Chuncheon-si (KR)
Appl. No. 17/766,523
Filed by ZIOVISION Co., Ltd., Chuncheon-si (KR)
PCT Filed Aug. 14, 2020, PCT No. PCT/KR2020/010823
§ 371(c)(1), (2) Date Apr. 4, 2022,
PCT Pub. No. WO2021/075694, PCT Pub. Date Apr. 22, 2021.
Claims priority of application No. 10-2019-0129196 (KR), filed on Oct. 17, 2019.
Prior Publication US 2023/0336843 A1, Oct. 19, 2023
Int. Cl. H04N 21/8549 (2011.01); G06T 7/20 (2017.01); G06T 7/70 (2017.01); H04N 21/845 (2011.01)
CPC H04N 21/8549 (2013.01) [G06T 7/20 (2013.01); G06T 7/70 (2017.01); H04N 21/8456 (2013.01)] 6 Claims
OG exemplary drawing
 
6. An apparatus for generating a summary video for an original video, the apparatus comprising a hardware processor configured to:
detect a plurality of moving objects appearing in an original video composed of a plurality of frames and generate object information including positions and sizes of the objects within the frames;
assign a same ID to an object whose identicalness is recognized among the objects appearing in the plurality of frames;
generate a frame set by selecting only frames in which the moving objects appear in the original video;
form frame volumes each composed of a plurality of frames by dividing the frame set at a preset time interval; and
generate a summary video having a shorter playback time than the original video by combining the frame volumes,
wherein any one frame volume of the plurality of frame volumes is incorporated into a temporary summary video, and the remaining frame volumes are sequentially incorporated into the temporary summary video according to a predetermined sequence to gradually increase the temporary summary video to create a final summary video,
wherein a degree of overlap of movement lines of moving objects appearing in each frame volume and the temporary summary video and a degree of shortening of time are compared and judged when each frame volume is incorporated into a previously prepared temporary summary video, and an optimal position at which each frame volume is incorporated into the temporary summary video is determined based on the comparison,
wherein the movement lines of the moving objects represent moving paths of the moving objects in an X-Y plane having an X-axis representing displacement and a Y-axis representing time.