US 12,005,919 B2
Varying extended reality content based on risk level of a driving environment
Hiroshi Yasuda, San Francisco, CA (US); and Simon A. I. Stent, Cambridge, MA (US)
Assigned to Toyota Research Institute, Inc., Los Altos, CA (US)
Filed by Toyota Research Institute, Inc., Los Altos, CA (US)
Filed on Feb. 22, 2022, as Appl. No. 17/677,125.
Prior Publication US 2023/0264706 A1, Aug. 24, 2023
Int. Cl. B60W 50/14 (2020.01); B60K 35/00 (2006.01); B60W 40/02 (2006.01); G02B 27/01 (2006.01); G06T 19/00 (2011.01); G06V 20/20 (2022.01); G06V 20/56 (2022.01); B60K 35/22 (2024.01); B60K 35/28 (2024.01); B60K 35/81 (2024.01)
CPC B60W 50/14 (2013.01) [B60K 35/00 (2013.01); B60W 40/02 (2013.01); G02B 27/017 (2013.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); G06V 20/56 (2022.01); B60K 35/22 (2024.01); B60K 35/28 (2024.01); B60K 35/81 (2024.01); B60K 2360/165 (2024.01); B60K 2360/176 (2024.01); B60K 2360/177 (2024.01); B60W 2050/146 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of varying extended reality content in a video presented on a display located within a vehicle, the display being a video pass through display, the video including extended reality content, the method comprising:
determining a risk level of an external environment of the vehicle based on a complexity of the external environment of the vehicle, the complexity being based on at least one of: a number of objects detected in the external environment, a density of objects detected in the external environment, a number of different directions that objects detected in the external environment are moving, a number of different types of objects detected in the external environment, a number of a particular type of object detected in the external environment, an amount of occlusions of individual objects detected in the external environment, and a degree of agreement in data captured by one or more sensors of the vehicle; and
causing an amount of the extended reality content presented in the video to be varied based on the risk level, the amount being proportional to the risk level of the external environment of the vehicle, the amount including:
a number of augmented objects in the video; or
a number of extended reality overlays over one or more objects and/or one or more portions of the external environment in the video,
whereby varying the amount of extended reality content signals to a human driver that greater or lesser attention can be paid to the external environment due to the risk level.