US 12,294,772 B2
System and method for generating a synopsis video of a requested duration
James Westland Cain, Newbury (GB); and Drew Martin, Newbury (GB)
Assigned to GRASS VALLEY LIMITED, Newbury (GB)
Filed by Grass Valley Limited, Newbury (GB)
Filed on Aug. 8, 2023, as Appl. No. 18/446,231.
Claims priority of provisional application 63/396,066, filed on Aug. 8, 2022.
Prior Publication US 2024/0048821 A1, Feb. 8, 2024
Int. Cl. H04N 21/8549 (2011.01); H04N 21/234 (2011.01); H04N 21/488 (2011.01)
CPC H04N 21/8549 (2013.01) [H04N 21/23424 (2013.01); H04N 21/4884 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for generating a synopsis video, the system comprising:
a user interface configured to receive an input video of a first duration;
a transcription generator configured to generate a timed text transcription of the input video that includes parsed speech that is mapped to different time instances in the input video;
the user interface further configured to receive a request to generate, based on the input video, a synopsis video with a duration no greater than a second duration that is less than the first duration;
a sentence identifier configured to divide the timed text transcription into a plurality of sentences, wherein each sentence has a set time duration;
a ranking module configured to determine a summary of the input video by:
generating a similarity matrix that compares each of the plurality of sentences;
ranking each of the plurality of sentences based on the similarity matrix; and
selecting, as part of the summary, a subset of the plurality of sentences that includes highest ranked sentences of the plurality of sentences, with the subset having a summed time duration that is less than or equal to the second duration; and
a video editor configured to extract, from the input video, respective clips that correspond to the selected subset of sentences in the summary, and further configured to generate, based on the summary, the synopsis video by combining the extracted clips.