US 12,106,412 B2
Matching audio to a state-space model for pseudorandom animation
Gurunandan Krishnan Gorumkonda, Seattle, WA (US); and Shree K. Nayar, New York, NY (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jun. 17, 2021, as Appl. No. 17/350,954.
Application 17/350,954 is a continuation of application No. 16/588,329, filed on Sep. 30, 2019, granted, now 11,282,253.
Prior Publication US 2021/0312682 A1, Oct. 7, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 13/20 (2011.01); G06T 13/80 (2011.01); G10L 25/57 (2013.01)
CPC G06T 13/205 (2013.01) [G06T 13/80 (2013.01); G10L 25/57 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
identifying, using one or more processors, a plurality of motion states and a control point of a computer animation model, each motion state of the plurality of motion states having a probability, the control point comprising a portion of a face or a portion of a body;
receiving audio data;
processing the audio data to determine a set of audio characteristics for the audio data;
determining a harmonic speed for the control point using the set of audio characteristics;
assigning a probability of zero to a subset of motion states of the plurality of motion states based on the set of audio characteristics;
pseudo-randomly selecting a first motion state that has a non-zero probability from the plurality of motion states;
generating a motion frequency value representing a frequency of repeating the first motion state using the set of audio characteristics and the harmonic speed; and
animating the computer animation model with the first motion state at the motion frequency value.