US 12,256,191 B2
Electronic apparatus generating a sound of a plurality of channels and controlling method thereof
Nabil Ibtehaz, Dacca (BD); Golam Rahman Chowdhury, Dacca (BD); and Md Abdullah Al Hadi, Dacca (BD)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Oct. 12, 2022, as Appl. No. 17/964,818.
Application 17/964,818 is a continuation of application No. PCT/KR2022/012729, filed on Aug. 25, 2022.
Claims priority of application No. 10-2021-0162574 (KR), filed on Nov. 23, 2021.
Prior Publication US 2023/0164482 A1, May 25, 2023
Int. Cl. H04R 1/32 (2006.01); G06F 3/16 (2006.01); G10L 19/00 (2013.01); H04S 5/00 (2006.01); H04S 7/00 (2006.01)
CPC H04R 1/326 (2013.01) [G06F 3/16 (2013.01); G10L 19/00 (2013.01); H04S 5/00 (2013.01); H04S 7/30 (2013.01); H04S 2400/11 (2013.01); H04S 2400/15 (2013.01)] 9 Claims
OG exemplary drawing
 
1. An electronic apparatus comprising:
a camera configured to capture an image;
a display:
an input interface comprising circuitry;
a microphone configured to receive an input of a sound of a first channel;
a Time of Flight (ToF) sensor; and
a processor, comprising processing circuitry, configured to cause generation of sounds of a plurality of channels based on the input sound and to:
identify an object and the location of the object from the image by the ToF sensor,
classify the input sound based on an audio source, and allot the classified sound to the corresponding identified object,
copy the classified sound and control to generate sounds of at least two channels,
control to adjust characteristics of the generated sounds of at least two channels based on the audio source allotted to the identified object and the location of the identified object using at least one of sound panning to a predetermined location, time delay, phase delay, strength adjustment, amplitude adjustment and spectral modification, the location of the identified object being sensed by the ToF sensor,
control to mix the sounds of at least two channels wherein the characteristics were adjusted according to the audio source and generate a stereo sound of at least two channels,
based on failing to identify an object corresponding to the classified sound, control the display to display a predetermined indicator and the identified object on the classified sound, and
match the classified sound on which the predetermined indicator is displayed to the identified object based on a user's command input through the input interface.