US 12,340,600 B2
Devices and methods for monitoring drivers of vehicles
Benjamin Oren Alpert, Sunnyvale, CA (US); Jacek Jakub Konieczny, Poznan (PL); and Shukui Zhang, Redwood City, CA (US)
Assigned to Nauto, Inc., Sunnyvale, CA (US)
Filed by Nauto, Inc., Palo Alto, CA (US)
Filed on Dec. 4, 2020, as Appl. No. 17/112,967.
Prior Publication US 2022/0180109 A1, Jun. 9, 2022
Int. Cl. G06T 7/70 (2017.01); G06F 18/2413 (2023.01); G06F 18/2431 (2023.01); G06V 20/59 (2022.01)
CPC G06V 20/597 (2022.01) [G06F 18/2413 (2023.01); G06F 18/2431 (2023.01); G06T 7/70 (2017.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30201 (2013.01)] 26 Claims
OG exemplary drawing
 
1. An apparatus comprising:
a camera configured to view a driver of a vehicle;
an additional camera configured to view an environment outside the vehicle; and
a processing unit configured to receive an image of the driver from the camera;
wherein the processing unit is configured to process the image of the driver;
wherein the processing unit is configured to determine whether the driver is engaged with a driving task or not based on a pose of the driver as it appears in the image, and also based on one or more images from the additional camera that is configured to view the environment outside the vehicle, the one or more images from the additional camera comprising an image of the environment outside the vehicle;
wherein the processing unit is configured to determine the pose of the driver as it appears in the image based on a pose classification threshold, and wherein the pose classification threshold is for comparison with a pose classification score provided by a neural network model, the pose classification score comprising a head orientation score; and
wherein the processing unit is configured to adjust the pose classification threshold based on the image of the environment outside the vehicle.