US 12,231,614 B2
Communication terminal device, communication method, and software program
Rui Sato, Tokyo (JP)
Assigned to VIRTUAL WINDOW CO., LTD., Tokyo (JP)
Appl. No. 17/919,082
Filed by VIRTUALWINDOW CO., LTD., Tokyo (JP)
PCT Filed Apr. 30, 2020, PCT No. PCT/JP2020/018345
§ 371(c)(1), (2) Date Oct. 14, 2022,
PCT Pub. No. WO2021/220494, PCT Pub. Date Nov. 4, 2021.
Prior Publication US 2023/0164304 A1, May 25, 2023
Int. Cl. H04N 13/344 (2018.01); G06F 3/01 (2006.01); G06F 3/14 (2006.01); G06F 3/16 (2006.01); G06T 17/20 (2006.01); H04N 13/111 (2018.01)
CPC H04N 13/344 (2018.05) [G06F 3/013 (2013.01); G06F 3/1423 (2013.01); G06F 3/16 (2013.01); G06T 17/20 (2013.01); H04N 13/111 (2018.05); H04N 2213/008 (2013.01)] 29 Claims
OG exemplary drawing
 
1. A communication terminal device provided in plurality and interconnected via a communication line, each of the communication terminal devices comprising:
an audio acquisition unit configured to acquire audio including a voice of an own user using an own device;
a visual information acquisition unit configured to acquire visual information for enabling formation of three-dimensional data of a person in a predetermined user space;
an information transmission unit configured to transmit, to another device, image transmission information based on visual information on the user space and audio transmission information based on the audio;
an image display unit configured to display a display image which is generated by performing a projection transformation on three-dimensional data of a person in a shared virtual space, in which a user space of the own device and a user space of the other device are arranged, based on image transmission information transmitted from the other device, such that the three-dimensional data is projected onto a two-dimensional display surface having a fixed relative position with respect to the shared virtual space, and which looks as if the person in the shared virtual space were being viewed from a viewpoint position of the own user through the display surface, on the display surface; and
an audio output unit configured to output audio on the basis of audio transmission information transmitted from the other device.