US 12,249,184 B2
Methods and systems to predict activity in a sequence of images
Alexandru Malaescu, Bucharest (RO); Dan Filip, Bucharest (RO); Mihai Ciuc, Bucharest (RO); Liviu-Cristian Dutu, Bucharest (RO); and Madalin Dumitru-Guzu, Bucharest (RO)
Assigned to Tobii Technologies Limited, Galway (IE)
Filed by Tobii Technologies Limited, Galway (IE)
Filed on Aug. 17, 2023, as Appl. No. 18/235,025.
Application 18/235,025 is a continuation of application No. 16/929,051, filed on Jul. 14, 2020, granted, now 11,776,319.
Prior Publication US 2023/0419727 A1, Dec. 28, 2023
Int. Cl. G06V 40/20 (2022.01); G06F 18/2113 (2023.01); G06F 18/214 (2023.01); G06F 18/22 (2023.01); G06T 7/00 (2017.01); G06V 10/75 (2022.01); G06V 20/13 (2022.01); G06V 20/30 (2022.01)
CPC G06V 40/20 (2022.01) [G06F 18/2113 (2023.01); G06F 18/214 (2023.01); G06F 18/22 (2023.01); G06T 7/97 (2017.01); G06V 10/751 (2022.01); G06V 20/13 (2022.01); G06V 20/30 (2022.01)] 14 Claims
OG exemplary drawing
 
1. A driver monitoring system to determine activity in a sequence of successively acquired images of a scene within a vehicle, comprising:
memory; and
one or more processors configured to perform operations comprising:
acquiring the sequence of images;
forming, for each image in the sequence of images, a feature block of features extracted from the image;
determining, for each image in the sequence of images, image specific information, wherein the image specific information includes a weighting indicating image importance for the image and one or more likelihoods of one or more activities, wherein the weighting is determined based on retrieving a previously determined stored feature block and image specific information of the previously determined stored feature block;
storing the formed feature blocks and the determined image specific information;
passing a plurality of weighted feature blocks through a predictive model to determine an activity in the sequence of images;
comparing the determined activities with a most likely image activity in the image specific information;
validating the determined activity based on the comparison; and
controlling the vehicle according to the validated activity.