US 11,930,228 B2
Computer program, server device, terminal device and method
Akihiko Shirai, Tokyo (JP); and Yousuke Yamanouchi, Tokyo (JP)
Assigned to GREE, INC., Tokyo (JP)
Filed by GREE, Inc., Tokyo (JP)
Filed on Sep. 24, 2020, as Appl. No. 17/030,942.
Claims priority of application No. 2019-177503 (JP), filed on Sep. 27, 2019.
Prior Publication US 2021/0099735 A1, Apr. 1, 2021
Int. Cl. H04N 21/2343 (2011.01); H04N 21/218 (2011.01); H04N 21/2187 (2011.01); H04N 21/232 (2011.01); H04N 21/235 (2011.01); H04N 21/8545 (2011.01)
CPC H04N 21/2343 (2013.01) [H04N 21/21805 (2013.01); H04N 21/2187 (2013.01); H04N 21/232 (2013.01); H04N 21/235 (2013.01); H04N 21/8545 (2013.01)] 29 Claims
OG exemplary drawing
 
1. A non-transitory computer readable medium comprising instructions that, when executed by a processor, cause the processor to
retrieve a first stream of a first data type including a motion, a sound, a comment, or information relating to gifting, and a second stream of a second data type including a background video, the first data type including intermediate information including depth information relating to the background video and depth information relating to the motion, wherein the motion is a motion of an avatar;
determine whether or not to perform synthesis by using the intermediate information;
generate synthesized data from the first stream and the second stream based on the determination, the synthesized data relating to the first data type and the second data type, such that the motion of the avatar is synthesized with the background video; and
transmit the synthesized data.
 
24. A server device, comprising:
a processor,
wherein the processor is configured to:
retrieve a first stream of a first data type including a motion, a sound, a comment, or information relating to gifting, the first data type including intermediate information including depth information relating to a background video and depth information relating to the motion, wherein the motion is a motion of an avatar,
retrieve a second stream of a second data type including the background video,
determine whether or not to perform synthesis by using the intermediate information,
generate synthesized data relating to the first data type and the second data type based on the determination, such that the motion of the avatar is synthesized with the background video, and
transmit the synthesized data, by executing a computer readable command.
 
25. A terminal device, comprising:
a processor,
wherein the processor is configured to:
retrieve a first stream of a first data type including a motion, a sound, a comment, or information relating to gifting, the first data type including intermediate information including depth information relating to a background video and depth information relating to the motion, wherein the motion is a motion of an avatar,
retrieve a second stream of a second data type including the background video,
determine whether or not to perform synthesis by using the intermediate information,
generate synthesized data relating to the first data type and the second data type based on the determination, such that the motion of the avatar is synthesized with the background video, and
provide the synthesized data, by executing a computer readable command.
 
26. A method to be executed by a processor executing a computer readable command, the method comprising:
retrieving a first stream of a first data type including a motion, a sound, a comment, or information relating to gifting, the first data type including intermediate information including depth information relating to the background video and depth information relating to the motion, wherein the motion is a motion of an avatar,
retrieving a second stream of a second data type including the background video,
determining whether or not to perform synthesis by using the intermediate information,
generating synthesized data relating to the first data type and the second data type based on the determination, such that the motion of the avatar is synthesized with the background video, and
providing the synthesized data, by executing the command.