US 12,240,469 B2
Occupant state detection device and occupant state detection method
Hirotaka Sakamoto, Tokyo (JP); Toshiyuki Hatta, Tokyo (JP); and Shintaro Watanabe, Tokyo (JP)
Assigned to MITSUBISHI ELECTRIC CORPORATION, Tokyo (JP)
Appl. No. 17/928,015
Filed by Mitsubishi Electric Corporation, Tokyo (JP)
PCT Filed Jul. 9, 2020, PCT No. PCT/JP2020/026913
§ 371(c)(1), (2) Date Nov. 28, 2022,
PCT Pub. No. WO2022/009401, PCT Pub. Date Jan. 13, 2022.
Prior Publication US 2023/0211791 A1, Jul. 6, 2023
Int. Cl. B60W 40/09 (2012.01); G06V 20/59 (2022.01); G06V 40/20 (2022.01)
CPC B60W 40/09 (2013.01) [G06V 20/597 (2022.01); G06V 40/28 (2022.01); B60W 2540/221 (2020.02); B60W 2540/223 (2020.02); B60W 2540/26 (2013.01)] 5 Claims
OG exemplary drawing
 
1. An occupant state detection device comprising:
processing circuitry configured to
acquire a captured image obtained by imaging an occupant;
acquire a temperature image indicating a temperature of a surface of a body of the occupant measured in a non-contact manner;
detect a motion of the occupant on a basis of the acquired captured image;
detect a temperature of a hand of the occupant on a basis of the acquired temperature image
estimate an awakening level of the occupant on a basis of the detected motion of the occupant and the detected temperature of the hand of the occupant;
estimate the awakening level of the occupant on a basis of the motion of the hand of the occupant in response to the motion of the occupant including a motion of the hand of the occupant such that a motion of the hand of the occupant has been detected; and
estimate the awakening level of the occupant on a basis of the detected motion of the occupant and the detected temperature of the hand of the occupant in response to the motion of the occupant not including a motion of the hand of the occupant such that a motion of the hand of the occupant has not been detected; and
control a vehicle system in response to the estimated awakening level of the occupant.