US 12,263,408 B2
Contextual scene enhancement
Victoria Walker, San Mateo, CA (US); Olga Rudi, San Mateo, CA (US); Aslanta Chen, San Mateo, CA (US); Phoenix Nitta-Hill, San Mateo, CA (US); Charles McCoy, San Mateo, CA (US); and Steven Osman, San Mateo, CA (US)
Assigned to SONY INTERACTIVE ENTERTAINMENT LLC, San Mateo, CA (US); and SONY INTERACTIVE ENTERTAINMENT INC., Tokyo (JP)
Filed by SONY INTERACTIVE ENTERTAINMENT LLC, San Mateo, CA (US); and SONY INTERACTIVE ENTERTAINMENT INC., Tokyo (JP)
Filed on Jul. 21, 2022, as Appl. No. 17/870,546.
Prior Publication US 2024/0024783 A1, Jan. 25, 2024
Int. Cl. A63F 13/69 (2014.01); G10L 25/63 (2013.01)
CPC A63F 13/69 (2014.09) [G10L 25/63 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method for enhancing content display, the method comprising:
monitoring audio to be played during display of an associated portion of an interactive content stream provided over a communication network to a viewing device during an interactive session;
analyzing the audio of the interactive content stream using a machine learning model trained to identify a sensation associated with audio content, wherein the audio of the interactive content stream is determined to be associated with an identified sensation;
determining an effect for the identified sensation, wherein the effect is associated with instructions for one or more output devices associated with the viewing device, and wherein the instructions are executable by the viewing device to output the effect via the output devices in coordination with the audio and in real-time with the display of the associated portion of the interactive content stream;
reanalyzing the audio of the associated portion of the interactive content stream based on one or more flags from one or more user devices; and
updating the instructions based on the reanalyzed audio, wherein the updated instructions are associated with an updated effect corresponding to an improvement of the effect, and wherein the updated instructions are executable to present the updated effect during the associated portion of the interactive content stream.