US 12,190,411 B2
Display device, display method, and non-transitory storage medium
Shohei Odan, Yokohama (JP); Tetsuya Suwa, Yokohama (JP); Hideo Tsuru, Yokohama (JP); Hayato Nakao, Yokohama (JP); Takayuki Sugahara, Yokohama (JP); and Motomu Takada, Yokohama (JP)
Assigned to JVCKENWOOD Corporation, Yokohama (JP)
Filed by JVCKENWOOD Corporation, Yokohama (JP)
Filed on May 26, 2023, as Appl. No. 18/324,181.
Application 18/324,181 is a continuation of application No. PCT/JP2021/043602, filed on Nov. 29, 2021.
Claims priority of application No. 2020-198624 (JP), filed on Nov. 30, 2020; application No. 2020-198647 (JP), filed on Nov. 30, 2020; and application No. 2020-199156 (JP), filed on Nov. 30, 2020.
Prior Publication US 2023/0298223 A1, Sep. 21, 2023
Int. Cl. G06T 11/00 (2006.01); G06F 3/01 (2006.01); G06V 20/20 (2022.01); G06V 20/50 (2022.01)
CPC G06T 11/00 (2013.01) [G06F 3/011 (2013.01); G06V 20/20 (2022.01); G06V 20/50 (2022.01)] 12 Claims
OG exemplary drawing
 
1. A display device comprising:
a display in which an image is displayed;
an output controller configured to display an image in the display;
an imager configured to capture an image of an object present within a field of view of a user;
a visually recognized object identifying unit configured to identify, based on the image captured by the imager, a type of the object present within the field of view of the user; and
a visual recognition count identifying unit configured to identify, based on an identification result by the visually recognized object identifying unit, a visual recognition count which indicates a number of times by which the user has looked at the object for each of the identified type, wherein
the output controller is further configured to display in the display, based on the visual recognition count, a sub image which includes information on the object for each of the identified type;
the visually recognized object identifying unit is further configured to identify a type of an object that has been present in a predetermined region in the image captured by the imager but was not present in the predetermined region in the image captured by the imager within a predetermined time from a time of capturing the image;
the display device further comprises a line-of-sight switch count identifying unit configured to identify, based on an identification result by the visually recognized object identifying unit, a line-of-sight switch count which indicates a number of times by which the user has looked away from the object of a same type, and
when the line-of-sight switch count becomes equal to or greater than a predetermined count, the output controller is further configured to stop displaying of the sub image which includes the information on the object of the identified type.
 
11. A display method for displaying an image in a display, comprising:
acquiring a captured image in which an object present within field of view of a user is included;
identifying, based on the image, a type of the object present within the field of view of the user;
identifying, based on an identification result about the type of the object present within the field of view of the user, a visual recognition count which indicate a number of times by which the user has looked at the object for each of the identified type; and
displaying in the display, based on the visual recognition count, a sub image which includes information on the object for each of the identified type, wherein
at the identifying of the type of the object, a type of an object that has been present in a predetermined region in the image captured by the imager but was not present in the predetermined region in the image captured by the imager within a predetermined time from a time of capturing the image is identified, wherein
the display method further comprises:
identifying a line-of-sight switch count which indicates a number of times by which the user has looked away from the object of a same type based on the visual recognition count; and
stopping, when the line-of-sight switch count becomes equal to or greater than a predetermined count, the displaying of the sub image which includes the information on the object of the identified type.
 
12. A non-transitory storage medium that stores a computer program that causes a computer to execute a process comprising:
acquiring a captured image in which an object present within field of view of a user is included;
identifying, based on the image, a type of the object present within the field of view of the user;
identifying, based on an identification result about the type of the object present within the field of view of the user, a visual recognition count which indicate a number of times by which the user has looked at the object for each of the identified type; and
displaying in the display, based on the visual recognition count, a sub image which includes information on the object for each of the identified type, wherein
at the identifying of the type of the object, a type of an object that has been present in a predetermined region in the image captured by the imager but was not present in the predetermined region in the image captured by the imager within a predetermined time from a time of capturing the image is identified, wherein
the process further comprises:
identifying a line-of-sight switch count which indicates a number of times by which the user has looked away from the object of a same type based on the visual recognition count; and
stopping, when the line-of-sight switch count becomes equal to or greater than a predetermined count, the displaying of the sub image which includes the information on the object of the identified type.