US 12,420,807 B2
Driving safety management system based on driver emotion and fatigue degree analysis
Caixia Liu, Shanghai (CN)
Assigned to THE THIRD RESEARCH INSTITUTE OF MINISTRY OF PUBLIC SECURITY, Shanghai (CN)
Appl. No. 18/681,959
Filed by THE THIRD RESEARCH INSTITUTE OF MINISTRY OF PUBLIC SECURITY, Shanghai (CN)
PCT Filed Nov. 4, 2022, PCT No. PCT/CN2022/129872
§ 371(c)(1), (2) Date Feb. 7, 2024,
PCT Pub. No. WO2023/236433, PCT Pub. Date Dec. 14, 2023.
Claims priority of application No. 202210642174.2 (CN), filed on Jun. 7, 2022.
Prior Publication US 2024/0343254 A1, Oct. 17, 2024
Int. Cl. B60W 40/08 (2012.01); B60W 10/18 (2012.01); B60W 30/14 (2006.01); B60W 50/14 (2020.01); G06V 20/59 (2022.01); G06V 40/16 (2022.01)
CPC B60W 40/08 (2013.01) [B60W 10/18 (2013.01); B60W 30/146 (2013.01); B60W 50/14 (2013.01); G06V 20/597 (2022.01); G06V 40/174 (2022.01); B60W 2040/0818 (2013.01); B60W 2040/0881 (2013.01); B60W 2050/143 (2013.01); B60W 2420/403 (2013.01); B60W 2540/229 (2020.02); B60W 2556/45 (2020.02)] 11 Claims
OG exemplary drawing
 
1. A driving safety management system based on driver emotion and fatigue analysis, comprising:
a driver emotion/fatigue monitoring unit, wherein the driver emotion/fatigue monitoring unit comprises a real-time emotion recognition module and a fatigue status monitoring module;
the real-time emotion recognition module is configured to obtain current driver facial expression dynamics and transmit the obtained facial expression dynamics to an intelligent emotion analysis module of the real-time emotion recognition module or an intelligent emotion analysis module of a vehicle-mounted gateway unit or an intelligent emotion analysis module of a remote management unit through the vehicle-mounted gateway unit, wherein the intelligent emotion analysis module is capable of performing an intelligent emotion analysis directly based on the facial expression dynamics, and a corresponding real-time emotion analysis result is formed; the fatigue status monitoring module is configured to obtain current driver fatigue status monitoring information and transmit the obtained information to a fatigue status determination module of the fatigue status monitoring module or a fatigue status determination module of the vehicle-mounted gateway unit or a fatigue status determination module of the remote management unit through the vehicle-mounted gateway unit, wherein the fatigue status determination module is capable of performing an intelligent fatigue status determination directly based on the received fatigue status monitoring information, and a corresponding fatigue level for determining a current driver real-time status is formed; and the driver emotion/fatigue monitoring unit can be directly associated with the vehicle control unit or associated with the vehicle control unit through the vehicle-mounted gateway unit according to a real-time emotion recognition result and/or a fatigue status determination result, to control speed limitation, speed control or speed reduction of operation status of an anti-lock brake system module, a speed limit management module, an intelligent brake management module and/or an electronic control brake auxiliary module;
the vehicle-mounted gateway unit, respectively associated with the driver emotion/fatigue monitoring unit, the vehicle control unit, a warning prompt unit, and a remote management unit; wherein the vehicle-mounted gateway unit can further cooperate with the driver emotion/fatigue monitoring unit to monitor the driver facial dynamic expression or facial vibration amplitude and pressure statuses in different areas of the seat under the driver in real time during vehicle driving, comprehensively analyze the driver real-time emotion status, cautiously determine the real-time fatigue level of the driver;
the vehicle control unit, linked to a speed control system and a braking system of the vehicle and associated with the vehicle-mounted gateway unit and the driver emotion/fatigue monitoring unit, wherein the vehicle control unit controls the vehicle driving status according to a driver real-time emotion status analysis result and a fatigue status determination result sent by the driver emotion/fatigue monitoring unit or the vehicle-mounted gateway unit;
the warning prompt unit, respectively connected and coordinated with the driver emotion/fatigue monitoring unit and the vehicle-mounted gateway unit; and
the remote management unit, wherein the remote management unit cooperates with the driver emotion/fatigue monitoring unit to complete driver emotion recognition and/or fatigue status determination through the vehicle control unit, and can give corresponding vehicle management and driver management control instructions and feed back the instructions to the vehicle-mounted gateway unit.