US 12,216,810 B2
Systems and methods for automated control of human inhabited characters
Arjun Nagendran, San Mateo, CA (US); and Brian D. Kelly, Orlando, FL (US)
Assigned to Mursion, Inc., San Francisco, CA (US)
Filed by Mursion, Inc., San Francisco, CA (US)
Filed on Feb. 26, 2020, as Appl. No. 16/801,843.
Prior Publication US 2021/0263582 A1, Aug. 26, 2021
Int. Cl. G06F 3/01 (2006.01); G06F 3/04847 (2022.01); G06F 3/0487 (2013.01); G06T 13/40 (2011.01); G10L 15/18 (2013.01); G10L 15/22 (2006.01); G10L 25/63 (2013.01); G10L 15/08 (2006.01)
CPC G06F 3/011 (2013.01) [G06F 3/04847 (2013.01); G06F 3/0487 (2013.01); G06T 13/40 (2013.01); G10L 15/1815 (2013.01); G10L 15/22 (2013.01); G10L 25/63 (2013.01); G10L 2015/088 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A method for automated control of a human inhabited character by a computing device, comprising:
receiving, from a first input device, first data corresponding to audio from one or more users;
receiving, from a second input device, second data corresponding to one or more images of the one or more users;
providing a plurality of mood state levels for the human inhabited character, wherein the mood state levels span a scale ranging from a negative mood to a positive mood;
determining a mood state level from the plurality of mood state levels of the human inhabited character provided by the computing device, wherein the mood state level indicates a level of correlation between the one or more images and an appearance state for the human inhabited character, wherein the mood state level is determined in part based on one or more words or phrases detected in the first data corresponding to audio from the one or more users;
determining the appearance state for the human inhabited character based on the first data, the second data, and the determined mood state level associated with a single mood, wherein determining the appearance state for the human inhabited character includes:
detecting first user information in the first data corresponding to audio from the one or more users; and
transitioning the human inhabited character from a first appearance state associated with a first behavior included in a first group of a plurality of different groups to a second appearance state associated with a second behavior included in a second group of the plurality of different groups in response to detecting the first user information, wherein the plurality of different groups are associated with a corresponding plurality of behaviors, wherein the first group of the plurality of different groups is associated with a first body posture and the second group of the plurality of different groups is associated with a second body posture, wherein a rate at which the human inhabited character transitions from the first appearance state associated with the first behavior included in the first group of the plurality of different groups to the second appearance state associated with the second behavior included in the second group of the plurality of different groups depends in part on the determined mood state level; and
displaying, on a display, the human inhabited character based on the appearance state.