US 12,351,201 B2
Simulation learning-based drowsy driving simulation platform system and method for detecting careless driving in conjunction with deep learning
A Ra Choi, Seongnam-si (KR)
Assigned to HYUNDAI MOBIS CO., LTD., Seoul (KR)
Filed by HYUNDAI MOBIS CO., LTD., Seoul (KR)
Filed on Aug. 19, 2022, as Appl. No. 17/891,325.
Claims priority of application No. 10-2021-0110483 (KR), filed on Aug. 20, 2021.
Prior Publication US 2023/0057662 A1, Feb. 23, 2023
Int. Cl. B60W 50/14 (2020.01); B60W 10/18 (2012.01); B60W 10/20 (2006.01); B60W 30/14 (2006.01); G06V 10/776 (2022.01); G06V 20/59 (2022.01)
CPC B60W 50/14 (2013.01) [B60W 10/18 (2013.01); B60W 10/20 (2013.01); B60W 30/14 (2013.01); G06V 10/776 (2022.01); G06V 20/597 (2022.01); B60W 2420/403 (2013.01); B60W 2540/043 (2020.02); B60W 2540/229 (2020.02); B60W 2540/30 (2013.01); B60W 2555/20 (2020.02)] 14 Claims
OG exemplary drawing
 
1. A method of detecting, using a simulation learning-based drowsy driving simulation platform system, careless driving by a driver of a vehicle in conjunction with deep learning, the method comprising:
acquiring an actual image of the driver using an image acquisition unit;
acquiring vibration information of the vehicle;
generating a synthesis image by converting the acquired actual image received from the image acquisition unit into the synthesis image using a converted image generation unit, wherein generating the synthesis image includes:
generating first simulation target images using the converted image generation unit, wherein the first simulation target images are each based on the acquired actual image and each include different appearance information from one another and from appearance information of the acquired actual image; and
generating second simulation target images using the converted image generation unit in which the vibration information of the vehicle is applied to the first simulation target images;
determining, based on the synthesis image and using a careless driving determination unit, whether the driver is performing careless driving;
determining, based on the synthesis image, a careless driving level of the driver; and
controlling, during a smart cruise control operation of the vehicle, the vehicle based on the determined careless driving level.