US 12,246,256 B2
Switching character facial expression associated with speech
Junya Fukushige, Tokyo (JP)
Assigned to COLOPL, INC., Tokyo (JP)
Appl. No. 17/621,562
Filed by COLOPL, INC., Tokyo (JP)
PCT Filed Jun. 17, 2020, PCT No. PCT/JP2020/023700
§ 371(c)(1), (2) Date Dec. 21, 2021,
PCT Pub. No. WO2020/255996, PCT Pub. Date Dec. 24, 2020.
Claims priority of application No. 2019-115074 (JP), filed on Jun. 21, 2019.
Prior Publication US 2022/0241692 A1, Aug. 4, 2022
Int. Cl. A63F 13/57 (2014.01); G06T 13/20 (2011.01); G06T 13/40 (2011.01)
CPC A63F 13/57 (2014.09) [G06T 13/205 (2013.01); G06T 13/40 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer-readable storage medium including a program to be executed in a terminal device which comprises a processor, a memory, and an input unit, the program causing the processor to execute steps of:
on a basis of data including information capable of specifying a motion input by a performer who plays a character arranged in a virtual space and a speech of the performer, producing a behavior of the character; and
enabling the character viewed from a predetermined point of view in the virtual space to display on a predetermined display unit and enabling a sound depending on the speech of the performer to output,
the step of producing the behavior of the character including steps of:
controlling a behavior of a mouth of the character in the virtual space based on the data, wherein a mouth shape of the character is changed to a mouth shape corresponding to sound spoken by the performer;
specifying a next facial expression to be taken as a facial expression of the character, wherein the next facial expression is specified in accordance with a predetermined rule and regardless of the performer's motion; and
performing switching control of the facial expression of the character in the virtual space to the facial expression, which is specified by the step of specifying, with lapse of time.