US 11,983,807 B2
Automatically generating motions of an avatar
Yueyang Chen, Redmond, WA (US); Xiang Xu, Redmond, WA (US); Ruihua Song, Beijing (CN); Shuo Wang, Redmond, WA (US); Hui Zhang, Redmond, WA (US); Di Li, Beijing (CN); Chengcheng Liu, Redmond, WA (US); and Xiaoyu Qi, Redmond, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Appl. No. 17/253,034
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
PCT Filed Jul. 10, 2018, PCT No. PCT/CN2018/095198
§ 371(c)(1), (2) Date Dec. 16, 2020,
PCT Pub. No. WO2020/010530, PCT Pub. Date Jan. 16, 2020.
Prior Publication US 2021/0192824 A1, Jun. 24, 2021
Int. Cl. G06T 13/40 (2011.01); G06F 16/43 (2019.01); G06F 40/221 (2020.01); H04L 51/02 (2022.01); G06N 20/00 (2019.01)
CPC G06T 13/40 (2013.01) [G06F 16/43 (2019.01); G06F 40/221 (2020.01); H04L 51/02 (2013.01); G06N 20/00 (2019.01)] 17 Claims
OG exemplary drawing
 
1. A method for automatically generating motions of an avatar, comprising:
obtaining a message in a session between a user and an electronic conversational agent, the avatar being a visual representation of the electronic conversational agent;
performing sequential motion parsing to determine a facial animation based on at least one part of the message, wherein the sequential motion parsing determines a time period of the facial animation and the sequential motion parsing is based on at least one of: a keyword in the message, an emotion of the message, a sentence type of the message, a pronoun in the message, and a greeting in the message;
presenting the facial animation, the facial animation having a first facial expression associated with first content of the message and an instant variable second facial expression interspersed within the first facial expression during the presentation of the facial animation, the instant variable second facial expression being variable and different from the first facial expression based on second content of the message that is different from the first content, the instant variable second facial expression being created in real time and interspersed within the first facial expression in real time during the presentation of the facial animation, the message including a waiting period that allows for complete presentation of the instant variable second facial expression, wherein the first facial expression is presented after the complete presentation of the instant variable second facial expression; and
generating at least one motion of the avatar based at least on the facial animation.