US 12,008,030 B2
System and method for automatic synchronization of video with music, and gaming applications related thereto
John Bo Marino, Oxford, MS (US); and Jeffrey Lloyd Holmes, Oxford, MS (US)
Assigned to Soundtrack Game LLC, Oxford, MS (US)
Filed by Soundtrack Game LLC, Oxford, MS (US)
Filed on Jan. 23, 2023, as Appl. No. 18/100,462.
Application 18/100,462 is a continuation of application No. 17/169,148, filed on Feb. 5, 2021, granted, now 11,593,422.
Application 17/169,148 is a continuation of application No. 16/290,522, filed on Mar. 1, 2019, granted, now 10,915,566, issued on Feb. 9, 2021.
Prior Publication US 2023/0161803 A1, May 25, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 21/242 (2011.01); G06F 16/432 (2019.01); G06F 16/438 (2019.01); G06F 16/483 (2019.01); G06K 7/14 (2006.01); H04N 21/43 (2011.01); H04N 21/4545 (2011.01); H04N 21/81 (2011.01); H04N 21/845 (2011.01); H04N 21/8547 (2011.01); H04N 21/8549 (2011.01)
CPC G06F 16/433 (2019.01) [G06F 16/438 (2019.01); G06F 16/483 (2019.01); G06K 7/1417 (2013.01); H04N 21/4307 (2013.01); H04N 21/816 (2013.01); H04N 21/8456 (2013.01); H04N 21/8549 (2013.01)] 6 Claims
OG exemplary drawing
 
1. A computer system comprising:
a server comprising a processor and a memory, the memory comprising a video database and a music database, the video database configured to store a plurality of video files, each of the video files comprising a plurality of video file markers, and the music database configured to store a plurality of music files, the plurality of music files each comprising a plurality of music file markers,
wherein the server is configured to:
synchronize a music file from the plurality of music files with one of the plurality of video files by aligning the video file markers of the video file with the music file markers for the music file to produce a synchronized video-music tile; and
transmit the synchronized video-music file to a display to be displayed,
wherein the video file markers are generated by the processor for each of the video files stored in the video database and the music file markers are generated by the processor for each of the music tiles stored in the music database,
wherein the video file comprises at least a portion of a movie, a video, or a graphical offering,
wherein the music file comprises at least a portion of a song or an audio offering,
wherein the video file comprises at least one music start time marker that identifies a time point at which the music file will begin playing during playback of the synchronized video-music file, each music start time marker having a priority component and a time component assigned thereto relative to a video timeline of the video file; and
wherein the video file comprises at least one video key frame moment that identifies a key video portion of the video file, each video key frame moment, having a priority component and a time component assigned thereto relative to the video timeline,
wherein the video file markers comprise:
a video file start time marker in the video file that identifies a time point at which the video file will begin playing during playback of the synchronized video-music tile;
a video file end time marker in the video file that identifies a time point at which the video file ends during playback of the synchronized video-music file;
a video file volume envelope in the video file that controls audio volume of the video file is adjusted during playback of the synchronized video-music file; and
a music volume envelope in the video file that controls music volume of the retrieved music file to be synchronized with the video file, and
wherein the music file markers comprise:
at least one music start time marker in the music file that identifies a time point at which the music file will begin playing during playback of the synchronized video-music file, each music time start marker having a priority component and a time component assigned thereto relative to a music timeline of the music file; and
at least one music key sound moment in the music file that identifies a key sound portion of the music file, each music key sound moment having a priority component and a time component assigned thereto relative to the music timeline.