US 12,258,016 B2
Methods and devices for triggering vehicular actions based on passenger actions
Min-An Chao, Munich (DE); Neslihan Kose Cihangir, Munich (DE); and Rafael Rosales, Unterhaching (DE)
Assigned to Mobileye Vision Technologies Ltd., Jersualem (IL)
Filed by Mobileye Vision Technologies Ltd., Jerusalem (IL)
Filed on Feb. 22, 2024, as Appl. No. 18/584,410.
Application 18/584,410 is a continuation of application No. 18/077,258, filed on Dec. 8, 2022, granted, now 11,932,249.
Application 18/077,258 is a continuation of application No. 16/830,312, filed on Mar. 26, 2020, granted, now 11,568,655, issued on Jan. 31, 2023.
Prior Publication US 2024/0190431 A1, Jun. 13, 2024
Int. Cl. B60W 30/16 (2020.01); B60W 40/08 (2012.01); B60W 60/00 (2020.01); G06N 3/04 (2023.01); G06T 7/50 (2017.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/40 (2022.01); G06V 20/58 (2022.01); G06V 20/59 (2022.01)
CPC B60W 30/16 (2013.01) [B60W 40/08 (2013.01); B60W 60/001 (2020.02); G06N 3/04 (2013.01); G06T 7/50 (2017.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/40 (2022.01); G06V 20/58 (2022.01); G06V 20/593 (2022.01); G06V 20/597 (2022.01); B60W 2420/403 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/30252 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A system for triggering a vehicular action based on monitoring of one or more occupants of a vehicle, the system comprising:
at least one processor comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to:
receive, from an image acquisition device, a plurality of subsets of image data detailing the one or more occupants;
identify a plurality of features of the one or more occupants in the plurality of subsets of image data;
identify, based on the plurality of subsets of image data, at least one change in the plurality of features over time, wherein identifying the at least one change includes inputting at least some of the plurality of subsets of image data into a spatio-temporal model;
determine a state of the one or more occupants from a plurality of states based on the at least one change, wherein the spatio-temporal model includes an output layer providing a score for each of the plurality of states, and wherein the state that is associated with the one or more occupants is based on the score;
determine, based on the determined state of the one or more occupants and an assumed minimum braking rate of the vehicle, a theoretical safe distance between the vehicle and at least one object; and
trigger the vehicular action based on the determined theoretical safe distance.