US 12,330,058 B2
Extraction and classification of audio events in gaming systems
Nathan Souviraa-Labastie, Mons-en-Baroeul (FR); Damien Kevin Granger, Lille (FR); and Raphaël Greff, Lille (FR)
Assigned to STEELSERIES ApS, Copenhagen (DK)
Filed by STEELSERIES ApS, Copenhagen SV (DK)
Filed on Aug. 31, 2022, as Appl. No. 17/899,766.
Claims priority of provisional application 63/240,004, filed on Sep. 2, 2021.
Prior Publication US 2023/0064627 A1, Mar. 2, 2023
Int. Cl. A63F 13/21 (2014.01); A63F 13/213 (2014.01); A63F 13/215 (2014.01); A63F 13/424 (2014.01); A63F 13/54 (2014.01); A63F 13/79 (2014.01); A63F 13/533 (2014.01); A63F 13/537 (2014.01); A63F 13/87 (2014.01); G06N 3/02 (2006.01); G06N 3/08 (2023.01); G10L 15/16 (2006.01); G10L 15/26 (2006.01); H04R 3/12 (2006.01); H04R 5/033 (2006.01); H04R 5/04 (2006.01); H04S 7/00 (2006.01)
CPC A63F 13/424 (2014.09) [A63F 13/213 (2014.09); A63F 13/215 (2014.09); A63F 13/54 (2014.09); A63F 13/79 (2014.09); A63F 13/533 (2014.09); A63F 13/537 (2014.09); A63F 13/87 (2014.09); A63F 2300/308 (2013.01); A63F 2300/5546 (2013.01); A63F 2300/572 (2013.01); A63F 2300/6072 (2013.01); A63F 2300/6081 (2013.01); G06N 3/02 (2013.01); G06N 3/08 (2013.01); G10L 15/16 (2013.01); G10L 15/26 (2013.01); H04R 3/12 (2013.01); H04R 5/033 (2013.01); H04R 5/04 (2013.01); H04S 7/302 (2013.01); H04S 7/308 (2013.01); H04S 2400/01 (2013.01); H04S 2420/01 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A device, comprising:
a processing system including a processor; and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
receiving an input audio stream from a gaming system, the input audio stream including gaming audio of a video game played by a game player, the input audio stream including a plurality of classes of sounds;
providing the input audio stream to a neural network;
extracting, by the neural network, sounds of a selected class of sounds of the plurality of classes of sounds;
providing a plurality of output audio streams including providing a first audio stream including the sounds of the selected class of sounds of the input audio stream and a second audio stream including remaining sounds of the input audio stream;
receiving control information from the game player;
modifying one or more of the plurality of output audio streams, forming modified output audio, wherein the modifying includes modifying a gain of sounds of a selected class of sounds according to the control information from the game player to form the modified output audio; and
providing the modified output audio to the game player.