US 12,190,625 B2
Modular predictions for complex human behaviors
Dominic Noy, London (GB); Matthew Cameron Angus, London (GB); James Over Everard, London (GB); Wassim El Youssoufi, London (GB); Raunaq Bose, London (GB); Leslie Cees Nooteboom, London (GB); and Maya Audrey Lara Pindeus, London (GB)
Assigned to Humanising Autonomy Limited, London (GB)
Filed by Humanising Autonomy Limited, London (GB)
Filed on Oct. 2, 2023, as Appl. No. 18/479,797.
Application 18/479,797 is a continuation of application No. 17/011,854, filed on Sep. 3, 2020, granted, now 11,816,914.
Claims priority of provisional application 62/896,487, filed on Sep. 5, 2019.
Prior Publication US 2024/0029467 A1, Jan. 25, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 40/00 (2022.01); B60W 60/00 (2020.01); G06F 18/20 (2023.01); G06N 3/08 (2023.01); G06N 7/01 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/56 (2022.01); G06V 20/58 (2022.01); G06V 40/10 (2022.01)
CPC G06V 40/103 (2022.01) [B60W 60/0027 (2020.02); G06F 18/295 (2023.01); G06N 3/08 (2013.01); G06N 7/01 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/56 (2022.01); G06V 20/58 (2022.01); B60W 2554/4046 (2020.02)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving a plurality of sequential images comprising a first image depicting a human captured at a first time and a second image depicting the human captured at a second time later than the first time;
inputting at least a portion of the first image into a hybrid model comprising a deep learning model and a probabilistic graphical model, the deep learning model comprising a multi-task model having different branches, each different branch trained to determine a different feature;
receiving, as output from the hybrid model, a plurality of probabilities corresponding to a probability for a given variable feature corresponding to different states of the human;
inputting the plurality of probabilities and the second image into the hybrid model and receiving, as output from the hybrid model, a confidence value that the human will exhibit a behavior; and
outputting the confidence value that the human will exhibit the behavior to a control system.