| CPC H04S 7/305 (2013.01) [G06V 20/49 (2022.01)] | 20 Claims |
|
1. A method of audio upmixing, comprising:
performing video scene analysis by segmenting one or more visual objects from one or more video frames of a video;
performing audio analysis by extracting one or more audio signals from an audio corresponding to the video;
determining whether any of the audio signals correspond to any of the visual objects;
estimating a video-based trajectory of a visual object of the visual objects if the visual object is in motion and transitions from on-screen to off-screen, or vice versa, during the video; and
positioning an audio trajectory of an audio signal of the audio signals from at least one speaker associated with the display to at least one other speaker associated with providing surround sound, wherein the audio trajectory is automatically matched with the video, and the audio signal is delivered to the at least one speaker and the at least one other speaker for audio reproduction during presentation of the video.
|