US 12,432,428 B2
Method and system for producing interaction-aware video synopsis
Ariel Naim, Modi'in (IL); Igal Dvir, Modi'in (IL); and Shmuel Peleg, Modi'in (IL)
Assigned to BRIEFCAM LTD., Modi'in (IL)
Filed by BRIEFCAM LTD., Modi'in (IL)
Filed on Apr. 24, 2024, as Appl. No. 18/644,707.
Claims priority of provisional application 63/497,773, filed on Apr. 24, 2023.
Prior Publication US 2024/0357218 A1, Oct. 24, 2024
Int. Cl. H04N 21/8549 (2011.01); G06T 7/194 (2017.01)
CPC H04N 21/8549 (2013.01) [G06T 7/194 (2017.01); G06T 2207/20081 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method of generating an interaction-aware video synopsis, the method comprising:
obtaining, using a computer processor, a source video containing a plurality of source objects;
extracting, using the computer processor, the source objects from the source video;
detecting, using the computer processor, at least one object-interaction between at least two source objects, wherein said object interaction comprises an interaction between the at least two objects in the scene which is visible in the source video;
generating, using the computer processor, synopsis objects by sampling respective source objects; and
generating, using the computer processor, a synopsis video having an overall play time shorter than the overall play time of the source video, by determining a play time for each one of the synopsis objects,
wherein at least two synopsis objects which are played at least partially simultaneously in the synopsis video, are generated from source objects that are captured at different times in the source video, and
maintaining a relative display time in the synopsis video of at least two of the synopsis objects created from the at least two source objects, responsive to the detecting of the at least one object-interaction between the at least two source objects, so the relative display time is the same as the relative display time of the at least two source objects in the source video,
wherein the maintaining of the relative display time in the synopsis video of the at least one object-interaction between the at least two source objects is achieved by either:
a) representing multiple interacting object tubes as if they are a single combined tube, and whenever a new appearance time is determined for the single combined tube, all interacting tubes therein maintain an original relative time; or
b) marking interacting objects and constraining the generating of the video synopsis, by keeping the relative time of iterating objects also in the generated video synopsis.