US 12,335,716 B2
Ultrasonic messaging in mixed reality
Ha Nguyen, Fullerton, CA (US); and Masatoshi Chang-Ogimoto, New York, NY (US)
Assigned to Warner Bros. Entertainment Inc., Burbank, CA (US)
Filed by WARNER BROS. ENTERTAINMENT INC., Burbank, CA (US)
Filed on Apr. 17, 2021, as Appl. No. 17/233,437.
Application 17/233,437 is a continuation of application No. PCT/US2019/056833, filed on Oct. 17, 2019.
Claims priority of provisional application 62/747,637, filed on Oct. 18, 2018.
Prior Publication US 2021/0314722 A1, Oct. 7, 2021
Int. Cl. H04S 7/00 (2006.01); H04B 11/00 (2006.01); G06T 19/00 (2011.01)
CPC H04S 7/303 (2013.01) [H04B 11/00 (2013.01); G06T 19/006 (2013.01); H04S 2400/11 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for receiving and processing sonic messaging by a mixed reality (xR) device, the method comprising:
detecting, by one or more processors via a microphone of the xR device, an acoustic signal in a digital audio stream from an audio-video source, the acoustic signal including an embedded control message, wherein the embedded control message includes a location of the audio-video source relative to the xR device;
determining, by the one or more processors, at least one audio or video output for the xR device, based on matching the embedded control message included in the acoustic signal with a control message stored in a memory of the xR device, wherein the control message corresponds to an xR object; and
in response to the determining, outputting, by the one or more processors, the at least one audio or video output by the xR device, wherein the outputting includes rendering an xR output at the location of the audio-video source based on the control message to the xR device in coordination with a display of the audio-video source.