US 12,319,306 B2
Displaying automated driving system status for vehicle occupant awareness
Joseph F. Szczerba, Grand Blanc, MI (US); Roy J. Mathieu, Rochester Hills, MI (US); Akilesh Rajavenkatanarayanan, Macomb, MI (US); Joonbum Lee, Madison, WI (US); Hansol Rheem, Madison, WI (US); and John D. Lee, Madison, WI (US)
Assigned to GM GLOBAL TECHNOLOGY OPERATIONS LLC, Detroit, MI (US); and WISCONSIN ALUMNI RESEARCH FOUNDATION, Madison, WI (US)
Filed by GM Global Technology Operations LLC, Detroit, MI (US); and Wisconsin Alumni Research Foundation, Madison, WI (US)
Filed on May 31, 2023, as Appl. No. 18/326,270.
Prior Publication US 2024/0400078 A1, Dec. 5, 2024
Int. Cl. B60W 50/14 (2020.01); B60K 35/00 (2006.01); B60K 35/23 (2024.01); B60K 35/28 (2024.01); B60K 35/60 (2024.01)
CPC B60W 50/14 (2013.01) [B60K 35/00 (2013.01); B60K 35/23 (2024.01); B60K 35/28 (2024.01); B60K 35/60 (2024.01); B60K 2360/175 (2024.01); B60K 2360/177 (2024.01); B60K 2360/785 (2024.01); B60W 2050/146 (2013.01); B60W 2540/227 (2020.02); B60W 2556/20 (2020.02)] 21 Claims
OG exemplary drawing
 
1. A system for providing information to an occupant of a vehicle, the system comprising:
an automated driving system;
a display configured to provide information to the occupant, wherein the display includes an augmented reality head-up display (AR-HUD) system including an occupant position tracking device and an AR-HUD projector; and
a controller in electrical communication with the automated driving system and the display, wherein the controller is programmed to:
determine an automation confidence level for a location of interest using the automated driving system, wherein the location of interest is a location in an environment surrounding the vehicle; and
notify the occupant using the AR-HUD system based at least in part on the automation confidence level by displaying a notification graphic overlayed on the location of interest, wherein to display the notification graphic overlayed on the location of interest, the controller is further programmed to:
compare the automation confidence level for the location of interest to a first automation confidence level threshold;
compare the automation confidence level for the location of interest to a second automation confidence level threshold;
generate a first graphic in response to determining that the automation confidence level for the location of interest is greater than or equal to the first automation confidence level threshold;
generate a second graphic in response to determining that the automation confidence level for the location of interest is less than the second automation confidence level threshold;
generate a third graphic in response to determining that the automation confidence level for the location of interest is less than the first automation confidence level threshold and greater than or equal to the second automation confidence level threshold;
determine a position of the occupant of the vehicle using the occupant position tracking device;
calculate a size, shape, and location of at least one of the first graphic, the second graphic, and the third graphic based on the position of the occupant and the location of interest; and
display at least one of the first graphic, the second graphic, and the third graphic on a windscreen of the vehicle using the AR-HUD system based on the size, shape, and location.