US 12,380,711 B2
Monitoring system for one or more objects stored in a vehicle
Ha-Kyung Kwon, Sunnyvale, CA (US)
Assigned to TOYOTA RESEARCH INSTITUTE, INC., Los Altos, CA (US)
Filed by TOYOTA RESEARCH INSTITUTE, INC., Los Altos, CA (US)
Filed on Jan. 31, 2022, as Appl. No. 17/589,392.
Prior Publication US 2023/0245473 A1, Aug. 3, 2023
Int. Cl. G06V 20/59 (2022.01); B60W 50/16 (2020.01); G06T 7/246 (2017.01); G06T 7/73 (2017.01); G06V 10/82 (2022.01); G06V 20/64 (2022.01); B60W 50/14 (2020.01)
CPC G06V 20/59 (2022.01) [B60W 50/16 (2013.01); G06T 7/251 (2017.01); G06T 7/75 (2017.01); G06V 10/82 (2022.01); G06V 20/64 (2022.01); B60W 2050/143 (2013.01); B60W 2050/146 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30268 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method for monitoring cargo in a vehicle, comprising:
identifying, via one or more sensors associated with the vehicle, a first object placed within a storage location in the vehicle and a second object within the location;
determining, at a trained machine learning model via one or more images of the first object, one or more first physical attributes of the first object, the one or more first physical attributes including one or more of a fragility, distribution of weight, or hardness of the first object, the one or more first physical attributes being determined at a first time period;
determining, at the trained machine learning model via one or more images of the second object, one or more second physical attributes of the second object, the one or more second physical attributes including one or more of a fragility, distribution of weight, or hardness of the second object, the one or more second physical attributes being determined at a second time period;
updating, at a third time period by the trained machine learning model, the one or more second physical attributes based on changes predicted to occur to the one or more second physical attributes over a period of time from the second time period to the third time period, the third time period being after the second time period;
monitoring via the one or more sensors, the first object while the vehicle is traveling from a first location to a second location, a view of the first object being obscured from an occupant of the vehicle while the vehicle is traveling from the first location to the second location;
predicting, based on monitoring the first object, a potential collision between the first object and a second object within the storage location;
predicting, based on predicting the potential collision, potential damage to the second object in accordance with the one or more second physical attributes and the one or more first physical attributes; and
generating an alert based on predicting the potential damage to the second object.