US 11,694,444 B2
Setting ad breakpoints in a video within a messaging system
Khalil Chatoo, Santa Monica, CA (US); David Michael Hornsby, Surrey (GB); Jeffrey Kile, Los Alamitos, CA (US); Chinmay Lonkar, Playa Vista, CA (US); Zhimin Wang, Culver City, CA (US); and Ian Anthony Wehrman, Venice, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Apr. 5, 2021, as Appl. No. 17/222,451.
Claims priority of provisional application 63/085,446, filed on Sep. 30, 2020.
Prior Publication US 2022/0101013 A1, Mar. 31, 2022
Int. Cl. G06V 20/40 (2022.01); G06T 7/90 (2017.01); G11B 27/10 (2006.01); G11B 27/06 (2006.01); G11B 27/036 (2006.01); G10L 25/78 (2013.01); G06K 9/62 (2022.01); G06V 40/16 (2022.01)
CPC G06V 20/49 (2022.01) [G06K 9/6227 (2013.01); G06T 7/90 (2017.01); G06V 20/46 (2022.01); G06V 40/161 (2022.01); G06V 40/172 (2022.01); G10L 25/78 (2013.01); G11B 27/036 (2013.01); G11B 27/06 (2013.01); G11B 27/10 (2013.01); G06T 2207/10016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
accessing a video;
determining plural shot boundaries for the video, each shot boundary defining a shot corresponding to a contiguous sequence of video frames that is free of cuts or transitions; and
for each shot boundary of the plural shot boundaries,
performing a set of breakpoint tests on the shot boundary, each breakpoint test configured to return a respective score indicating whether the shot boundary corresponds to a breakpoint for potential insertion of an ad during playback of the video,
calculating a combined score for the shot boundary based on combining the each of the respective scores, and
setting, in a case where the combined score meets a threshold value, the shot boundary as the breakpoint,
wherein the set of breakpoint tests includes a background audio test configured to:
group one or more adjacent shots in the video based on background audio, in which speech has been removed, shared by the one or more adjacent shots, and
return a score indicating that the shot boundary corresponds to the breakpoint based on the grouping.