US 12,352,882 B2
Method, apparatus, and system for speech enhancement and separation based on audio and radio signals
Muhammed Zahid Ozturk, Beltsville, MD (US); Chenshu Wu, Hong Kong (CN); Beibei Wang, Clarksville, MD (US); K. J. Ray Liu, Potomac, MD (US); and Oscar Chi-Lim Au, San Jose, CA (US)
Assigned to ORIGIN RESEARCH WIRELESS, INC., Rockville, MD (US)
Filed by Muhammed Zahid Ozturk, Beltsville, MD (US); Chenshu Wu, Hong Kong (CN); Beibei Wang, Clarksville, MD (US); K. J. Ray Liu, Potomac, MD (US); and Oscar Chi-Lim Au, San Jose, CA (US)
Filed on May 30, 2022, as Appl. No. 17/827,902.
Application 17/827,902 is a continuation in part of application No. 15/326,112, abandoned, previously published as PCT/US2015/041037, filed on Jul. 17, 2015.
Application 17/827,902 is a continuation in part of application No. 16/127,151, filed on Sep. 10, 2018, granted, now 11,012,285.
Application 17/827,902 is a continuation in part of application No. 16/790,610, filed on Feb. 13, 2020, granted, now 11,928,894.
Application 17/827,902 is a continuation in part of application No. 16/790,627, filed on Feb. 13, 2020, granted, now 11,397,258.
Application 17/827,902 is a continuation in part of application No. 16/798,343, filed on Feb. 22, 2020, granted, now 11,340,345.
Application 17/827,902 is a continuation in part of application No. 16/871,000, filed on May 10, 2020, granted, now 11,500,056.
Application 17/827,902 is a continuation in part of application No. 16/871,004, filed on May 10, 2020, granted, now 12,046,040.
Application 17/827,902 is a continuation in part of application No. 16/871,006, filed on May 10, 2020, granted, now 11,408,978.
Application 17/827,902 is a continuation in part of application No. 16/909,913, filed on Jun. 23, 2020, abandoned.
Application 17/827,902 is a continuation in part of application No. 16/909,940, filed on Jun. 23, 2020, granted, now 11,391,830.
Application 17/827,902 is a continuation in part of application No. 16/945,827, filed on Aug. 1, 2020, granted, now 11,444,710.
Application 17/827,902 is a continuation in part of application No. 16/945,837, filed on Aug. 1, 2020, granted, now 11,439,344.
Application 17/827,902 is a continuation in part of application No. 17/019,270, filed on Sep. 13, 2020, granted, now 12,036,948.
Application 17/827,902 is a continuation in part of application No. 17/113,023, filed on Dec. 5, 2020, granted, now 11,770,197.
Application 17/827,902 is a continuation in part of application No. 17/149,625, filed on Jan. 14, 2021.
Application 17/827,902 is a continuation in part of application No. 17/149,667, filed on Jan. 14, 2021, abandoned.
Application 17/827,902 is a continuation in part of application No. 17/180,763, filed on Feb. 20, 2021, granted, now 11,592,913.
Application 16/127,151 is a continuation in part of application No. 16/798,343, filed on Feb. 22, 2020, granted, now 11,340,345.
Application 16/798,343 is a continuation in part of application No. 16/798,337, filed on Feb. 22, 2020, granted, now 10,845,463, issued on Nov. 24, 2020.
Application 17/827,902 is a continuation in part of application No. 17/180,762, filed on Feb. 20, 2021, granted, now 11,531,087.
Application 17/827,902 is a continuation in part of application No. 17/180,760, filed on Feb. 20, 2021, granted, now 11,181,486.
Application 17/827,902 is a continuation in part of application No. 17/180,766, filed on Feb. 20, 2021, granted, now 11,953,618.
Application 17/827,902 is a continuation in part of application No. 17/214,838, filed on Mar. 27, 2021, granted, now 11,340,328.
Application 17/827,902 is a continuation in part of application No. 17/214,841, filed on Mar. 27, 2021, granted, now 11,500,058.
Application 17/827,902 is a continuation in part of application No. 17/214,836, filed on Mar. 27, 2021, granted, now 11,500,057.
Application 17/827,902 is a continuation in part of application No. 17/352,185, filed on Jun. 18, 2021, granted, now 11,906,659.
Application 17/827,902 is a continuation in part of application No. 17/352,306, filed on Jun. 20, 2021, granted, now 11,940,550.
Application 17/827,902 is a continuation in part of application No. 17/492,599, filed on Oct. 2, 2021, granted, now 11,448,727.
Application 17/827,902 is a continuation in part of application No. 17/492,598, filed on Oct. 2, 2021, granted, now 11,448,728.
Application 17/827,902 is a continuation in part of application No. 17/537,432, filed on Nov. 29, 2021.
Application 17/827,902 is a continuation in part of application No. 17/539,058, filed on Nov. 30, 2021, granted, now 12,066,572.
Application 17/827,902 is a continuation in part of application No. 17/540,156, filed on Dec. 1, 2021.
Claims priority of provisional application 63/209,907, filed on Jun. 11, 2021.
Claims priority of provisional application 63/235,103, filed on Aug. 19, 2021.
Claims priority of provisional application 63/253,083, filed on Oct. 6, 2021.
Claims priority of provisional application 63/276,652, filed on Nov. 7, 2021.
Claims priority of provisional application 63/281,043, filed on Nov. 18, 2021.
Claims priority of provisional application 63/293,065, filed on Dec. 22, 2021.
Claims priority of provisional application 63/300,432, filed on Jan. 18, 2022.
Claims priority of provisional application 63/308,927, filed on Feb. 10, 2022.
Claims priority of provisional application 63/332,658, filed on Apr. 19, 2022.
Prior Publication US 2022/0291328 A1, Sep. 15, 2022
Int. Cl. G01S 5/06 (2006.01); G01S 5/02 (2010.01)
CPC G01S 5/06 (2013.01) [G01S 5/0226 (2013.01); G01S 5/0252 (2013.01); G01S 5/0273 (2013.01)] 25 Claims
OG exemplary drawing
 
1. A system for radio-assisted signal estimation, comprising:
a sensor configured to sense a baseband mixture signal in a venue, wherein:
the baseband mixture signal comprises a mixture of a first source signal and an additional signal,
the first source signal is generated by a first motion of a first object in the venue,
the baseband mixture signal is a baseband signal that has not been modulated to a radio frequency;
a transmitter configured to transmit a first radio signal through a wireless channel of the venue;
a receiver configured to receive a second radio signal through the wireless channel, wherein the second radio signal differs from the first radio signal due to the wireless channel and at least the first motion of the first object in the venue, wherein both the first radio signal and the second radio signal are not baseband signals; and
a processor configured for:
obtaining a baseband radio-derived signal based on a radio feature of the second radio signal,
configuring a first adaptive filter for the baseband mixture signal based on the baseband radio-derived signal, wherein configuring the first adaptive filter comprises:
configuring a first baseband filter for the baseband mixture signal, wherein the first baseband filter comprises: a first pre-processing in a first signal domain, a first transformation from the first signal domain to a first transformed domain, and a first transformed-domain filter in the first transformed domain,
configuring a second baseband filter for the baseband radio-derived signal, wherein the second baseband filter comprises: a second pre-processing in a second signal domain, a second transformation from the second signal domain to a second transformed domain, and a second transformed-domain filter in the second transformed domain, and
configuring the first adaptive filter based on the first baseband filter, the second baseband filter, a third filter and a fourth filter, wherein:
the third filter comprises: a third pre-processing based on outputs of the first and second baseband filters, and a third transformed-domain filter in a third signal domain,
the third pre-processing comprises combining a first vector output from the first baseband filter in the first transformed domain with a second vector output from the second baseband filter in the second transformed domain to generate a combined signal in the third signal domain, and
the fourth filter comprises: a fourth transformed-domain filter in the first transformed domain based on output of the third transformed-domain filter, a first inverse transformation from the first transformed domain to the first signal domain, and a post-processing in the first signal domain,
filtering the baseband mixture signal using the first adaptive filter to obtain a first output signal, and
generating an estimation of the first source signal based on the first output signal.