US 11,720,178 B2
Information processing device, information processing method, and computer-readable recording medium
Ryouhei Yasuda, Tokyo (JP); and Takuro Noda, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/429,806
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Mar. 3, 2020, PCT No. PCT/JP2020/008826
§ 371(c)(1), (2) Date Aug. 10, 2021,
PCT Pub. No. WO2020/189254, PCT Pub. Date Sep. 24, 2020.
Claims priority of application No. 2019-048684 (JP), filed on Mar. 15, 2019.
Prior Publication US 2022/0129080 A1, Apr. 28, 2022
Int. Cl. G06F 3/01 (2006.01); H04N 13/383 (2018.01)
CPC G06F 3/017 (2013.01) [G06F 3/012 (2013.01); G06F 3/013 (2013.01); H04N 13/383 (2018.05)] 24 Claims
OG exemplary drawing
 
1. An information processing device, comprising:
an eyeball information acquisition section configured to acquire position and posture information of eyeballs of a user from a first sensor;
a sightline estimation section configured to estimate a sightline vector of the user on a basis of the position and posture information of the eyeballs;
a display control section configured to control a display device in such a manner that the display device displays a guide image for showing a gaze state based on the estimated sightline vector;
a gesture information acquisition section configured to acquire gesture information of the user, which is different from the position and posture information of the eyeballs, from a second sensor; and
a mode switching section configured to switch between a first mode and a second mode according to mode switching input provided by the user with regard to the guide image, the first mode being a mode of reflecting the position and posture information of the eyeballs in the guide image, the second mode being a mode of correcting the gaze state on a basis of the gesture information, wherein
the gesture information includes information related to head gesture when the user rotates his/her head,
the display control section is further configured to set a rotation angle of the sightline vector according to a rotation angle of the head of the user, in such a manner that the rotation angle of the sightline vector falls within a first range, and
the eyeball information acquisition section, the sightline estimation section, the display control section, the gesture information acquisition section, and the mode switching section are each implemented via at least one processor.