US 12,273,679 B2
Multi-modal audio processing
Karl Stahl, Palo Alto, CA (US)
Filed by SOUNDHOUND AI IP, LLC, Santa Clara, CA (US)
Filed on Apr. 22, 2024, as Appl. No. 18/642,492.
Application 18/642,492 is a continuation of application No. 18/194,885, filed on Apr. 3, 2023, granted, now 11,997,448.
Application 18/194,885 is a continuation of application No. 17/301,308, filed on Mar. 31, 2021, granted, now 11,627,405, issued on Apr. 11, 2023.
Claims priority of provisional application 63/004,364, filed on Apr. 2, 2020.
Prior Publication US 2024/0276138 A1, Aug. 15, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04R 25/00 (2006.01); G10L 15/22 (2006.01); G10L 21/0316 (2013.01); G10L 25/06 (2013.01); G10L 25/51 (2013.01); H04R 1/08 (2006.01); H04R 1/10 (2006.01); H04R 5/033 (2006.01)
CPC H04R 1/1083 (2013.01) [G10L 15/22 (2013.01); G10L 21/0316 (2013.01); G10L 25/06 (2013.01); G10L 25/51 (2013.01); H04R 1/08 (2013.01); G10L 2015/223 (2013.01); H04R 5/0335 (2013.01); H04R 2420/07 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of processing an audio signal, the method comprising:
receiving a set of sound waves at a microphone of a device, the set of sound waves comprising a sound of interest and other sound;
converting, using the microphone, the set of sound waves into a first audio signal that includes a contribution from the sound of interest and a contribution from the other sound;
receiving, at a receiver of the device, an electromagnetic signal carrying a second audio signal;
extracting the second audio signal from the electromagnetic signal;
correlating the first audio signal with the second audio signal to calculate a correlation value;
in response to the correlation value being larger than a threshold, processing the first audio signal using the second audio signal to reduce the contribution from the other sound in a processed audio signal; and
performing further processing on the processed audio signal to determine a characteristic of the sound of interest.