US 12,076,087 B2
Information processing apparatus and information processing method
Masayuki Yokoyama, Tokyo (JP); and Takuro Noda, Tokyo (JP)
Assigned to SONY CORPORATION, Tokyo (JP)
Appl. No. 17/040,042
Filed by SONY CORPORATION, Tokyo (JP)
PCT Filed Feb. 20, 2019, PCT No. PCT/JP2019/006216
§ 371(c)(1), (2) Date Sep. 21, 2020,
PCT Pub. No. WO2019/187808, PCT Pub. Date Oct. 3, 2019.
Claims priority of application No. 2018-063486 (JP), filed on Mar. 29, 2018.
Prior Publication US 2021/0019493 A1, Jan. 21, 2021
Int. Cl. A61B 3/113 (2006.01); A61B 3/00 (2006.01); A61B 3/14 (2006.01); A61B 5/00 (2006.01); G06T 7/70 (2017.01); G06V 10/80 (2022.01); G06V 40/16 (2022.01); G06V 40/19 (2022.01); G06V 40/18 (2022.01)
CPC A61B 3/113 (2013.01) [A61B 3/0008 (2013.01); A61B 3/14 (2013.01); A61B 5/7221 (2013.01); G06T 7/70 (2017.01); G06V 10/809 (2022.01); G06V 40/171 (2022.01); G06V 40/19 (2022.01); G06T 2207/30201 (2013.01); G06V 40/193 (2022.01)] 15 Claims
OG exemplary drawing
 
1. An information processing apparatus, comprising:
a central processing unit (CPU) configured to:
acquire eye information regarding an eye of a user; and
determine a first line-of-sight direction based on the eye information using a first method, wherein
the eye information includes an eyeball image of an eyeball of the user,
the eyeball image is obtained by performing image-capturing on the eyeball in a state of being irradiated with at least one piece of irradiation light,
the at least one piece of irradiation light is a plurality of pieces of irradiation light,
the first method is a method including detecting, from the eyeball image, at least one bright spot generated due to the at least one piece of irradiation light, and determining the first line-of-sight direction based on the detected at least one bright spot;
determine a second line-of-sight direction based on the eye information using a second method that is different from the first method;
calculate reliability information regarding at least one of reliability of the first line-of-sight direction or reliability of the second line-of-sight direction;
synthesize, based on the reliability information, the first line-of-sight direction and the second line-of-sight direction, wherein
the reliability information includes a weighting coefficient used to synthesize the first line-of-sight direction and the second line-of-sight direction;
determine a line-of-sight direction of the user, based on the synthesized first line-of-sight direction and the synthesized second line-of-sight direction;
detect, from the eyeball image, a pair of bright spots from among a plurality of bright spots generated due to the plurality of pieces of irradiation light, wherein the pair of bright spots is a pair of bright spots provided in a specified arrangement;
detect a corneal region of the eyeball; and
calculate the weighting coefficient based on a position of the pair of bright spots in the corneal region.