US 12,085,726 B2
Information processing device and information processing method
Jun Kimura, Tokyo (JP); and Hirotake Ichikawa, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/755,911
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Nov. 10, 2020, PCT No. PCT/JP2020/041886
§ 371(c)(1), (2) Date May 11, 2022,
PCT Pub. No. WO2021/100553, PCT Pub. Date May 27, 2021.
Claims priority of application No. 2019-209323 (JP), filed on Nov. 20, 2019.
Prior Publication US 2022/0382065 A1, Dec. 1, 2022
Int. Cl. G02B 27/01 (2006.01); G06F 3/01 (2006.01)
CPC G02B 27/0179 (2013.01) [G02B 27/017 (2013.01); G06F 3/017 (2013.01); G02B 2027/0178 (2013.01)] 14 Claims
OG exemplary drawing
 
1. An information processing device, comprising:
a central processing unit (CPU) configured to:
control a display device to project a plurality of content images duplicated from a single content image towards eyeballs of a wearer, wherein
the display device has optical transparency, and
each of the plurality of content images includes an operation object that corresponds to a real object in a real world;
detect a gesture operation of the wearer on the plurality of content images viewed by the wearer;
measure three-dimensional coordinates of the detected gesture operation;
estimate three-dimensional coordinates of the real object based on the measured three-dimensional coordinates of the detected gesture operation;
compare the estimated three-dimensional coordinates of the real object with three-dimensional coordinates of the operation object;
detect, based on the comparison of the estimated three-dimensional coordinates of the real object with the three-dimensional coordinates of the operation object, a wearing state of the wearer with respect to the display device, wherein
the wearing state corresponds to a positional relationship between the eyeballs of the wearer and eyeboxes,
the eyeboxes are areas in which the plurality of content images is projected, and
the eyeboxes are between the eyeballs of the wearer and the display device;
determine a mounting misalignment of the display device with the wearer based on the detected wearing state; and
control, based on the determined mounting misalignment, the display device to display a notification regarding the mounting misalignment.