US 12,425,797 B2
Three-dimensional (3D) sound rendering with multi-channel audio based on mono audio input
Vijendra Raj Apsingekar, San Jose, CA (US); Akash Sahoo, San Jose, CA (US); Anil S. Yadav, San Jose, CA (US); and Sivakumar Balasubramanian, Sunnyvale, CA (US)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on Jun. 15, 2023, as Appl. No. 18/335,730.
Claims priority of provisional application 63/396,840, filed on Aug. 10, 2022.
Prior Publication US 2024/0056761 A1, Feb. 15, 2024
Int. Cl. H04S 7/00 (2006.01); G06F 3/16 (2006.01); G10L 19/008 (2013.01); H04S 3/00 (2006.01)
CPC H04S 7/304 (2013.01) [G06F 3/165 (2013.01); G10L 19/008 (2013.01); H04S 3/008 (2013.01); H04S 2400/11 (2013.01)] 20 Claims
OG exemplary drawing
 
8. An electronic device comprising:
at least one processing device configured to:
obtain video content and associated substantially mono audio content;
determine at least one of a position or a motion trajectory of each of one or more objects detected in the video content;
classify each of the one or more objects into one of multiple object classes;
separate audio streams within the audio content based on the video content, each of the audio streams associated with one of multiple audio sources;
classify each of the audio sources into one of the object classes; and
for each of the audio sources classified into the same object class as one of the one or more objects, distribute the audio stream associated with that audio source into multiple audio channels based on at least one of the position or the motion trajectory of that object.