US 11,721,317 B2
Sound effect synthesis
Joshua Reiss, London (GB); Thomas Vassallo, London (GB); Adan Benito, London (GB); and Parham Bahadoran, London (GB)
Assigned to QUEEN MARY UNIVERSITY OF LONDON, London (GB)
Appl. No. 16/960,048
Filed by QUEEN MARY UNIVERSITY OF LONDON, London (GB)
PCT Filed Nov. 29, 2018, PCT No. PCT/GB2018/053459
§ 371(c)(1), (2) Date Jul. 3, 2020,
PCT Pub. No. WO2019/106372, PCT Pub. Date Jun. 6, 2019.
Claims priority of application No. 1719854 (GB), filed on Nov. 29, 2017.
Prior Publication US 2021/0082391 A1, Mar. 18, 2021
Int. Cl. G10K 15/02 (2006.01); G06F 3/16 (2006.01); H03G 3/00 (2006.01); G09B 15/04 (2006.01); G10H 1/00 (2006.01); G10L 13/08 (2013.01); G06F 3/01 (2006.01); G10H 5/02 (2006.01); A63F 13/54 (2014.01); G11B 27/034 (2006.01); A63F 9/24 (2006.01)
CPC G10K 15/02 (2013.01) [G06F 3/165 (2013.01); A63F 9/24 (2013.01); A63F 13/54 (2014.09); G06F 3/01 (2013.01); G09B 15/04 (2013.01); G10H 1/0025 (2013.01); G10H 5/02 (2013.01); G10H 2210/125 (2013.01); G10H 2220/096 (2013.01); G10H 2250/321 (2013.01); G10H 2250/371 (2013.01); G10H 2250/395 (2013.01); G10L 13/08 (2013.01); G11B 27/034 (2013.01); H03G 3/00 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A sound synthesis system for generating a user defined synthesized sound effect, the system comprising:
a receiver of user defined inputs for defining a sound effect;
a generator of control parameters in dependence on the received user defined inputs;
a plurality of sound effect objects, wherein each sound effect object is arranged to generate a different class of sound and each sound effect object comprises a sound synthesis model arranged to generate a sound in dependence on one or more of the control parameters;
a plurality of audio effect objects, wherein each audio effect object is arranged to receive a sound from one or more sound effect objects and one or more other audio effect objects, process the received sound in dependence on one or more of the control parameters and output the processed sound;
a scene creation function arranged to receive sound output from one or more sound effect objects and audio effect objects and to generate a synthesized sound effect in dependence on the received sound; and
an audio routing function arranged to determine the arrangement of audio effect objects, sound effect objects and scene creation function such that one or more sounds received by the scene creation function are dependent on the audio routing function;
wherein the determined arrangement of audio effect objects, sound effect objects and the scene creation function by the audio routing function is dependent on the user defined inputs;
wherein each sound synthesis model comprises an algorithm configured to generate a synthesized sound in dependence on one or more of the control parameters;
wherein each of the audio effects object comprises an algorithm configured to process a received sound in dependence on one or more of the control parameters;
wherein the sound synthesis system is arranged to operate substantially in real time;
wherein the sound synthesis system further comprises a trigger track for defining start times and or end times on the timeline of each sound effect object and audio effect object;
wherein the trigger track further comprises a randomizer arranged to cause random, or pseudo-random, variations of a sound;
wherein a trigger track is provided for one or more synthesis track, auxiliary channel, sound effect, mix bus, sound effect object and audio effect object;
wherein the sound synthesis system further comprises a control track for changing one or more of the control parameters over the timeline; and
wherein a control track is provided for one or more synthesis track, auxiliary channel, sound effect, mix bus, sound effect object and audio effect object.