US 11,697,346 B1
Lane position in augmented reality head-up display system
John P. Weiss, Shelby Township, MI (US); Joseph F. Szczerba, Grand Blanc, MI (US); Thomas A. Seder, Fraser, MI (US); and Kai-Han Chang, Madison Heights, MI (US)
Assigned to GM GLOBAL TECHNOLOGY OPERATIONS LLC, Detroit, MI (US)
Filed by GM Global Technology Operations LLC, Detroit, MI (US)
Filed on Mar. 29, 2022, as Appl. No. 17/707,239.
Int. Cl. B60K 35/00 (2006.01); G06V 20/56 (2022.01); G06T 7/73 (2017.01); G06T 7/50 (2017.01); G06T 11/00 (2006.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G08G 1/0967 (2006.01)
CPC B60K 35/00 (2013.01) [G02B 27/0093 (2013.01); G02B 27/0101 (2013.01); G06T 7/50 (2017.01); G06T 7/73 (2017.01); G06T 11/001 (2013.01); G06V 20/588 (2022.01); G08G 1/096766 (2013.01); B60K 2370/1529 (2019.05); B60K 2370/168 (2019.05); B60K 2370/178 (2019.05); B60K 2370/179 (2019.05); B60K 2370/188 (2019.05); B60K 2370/21 (2019.05); B60K 2370/52 (2019.05); B60K 2370/736 (2019.05); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0141 (2013.01); G06T 2207/30256 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method of providing lane position alerts to a driver of a vehicle with a head-up display system, comprising:
detecting, with at least one non-visual sensor, objects within an environment surrounding the vehicle;
capturing, with at least one image capturing device, images of the environment surrounding the vehicle;
tracking, with a drive monitoring system, a position of the driver's eyes;
identifying, with a controller in electronic communication with the at least one non-visual sensor and the at least one image capturing device, lane markers and objects within the environment surrounding the vehicle;
determining, with the controller, the position of the vehicle within a lane of a roadway the vehicle is traveling upon, and determining a distance between the vehicle and identified lane markers and objects within the environment surrounding the vehicle; and
displaying, with a laser of a holographic projection module adapted to project an image upon an inner surface of a windshield of the vehicle and in electronic communication with the controller, a lane position alert including a first shaded area that substantially fills and is centered within the lane traveled in within a far image plane and a second shaded area positioned adjacent the first shaded area within the far image plane, wherein the lane position alert appears to the driver to be positioned on the roadway surface in front of the vehicle;
wherein when the distance between the vehicle and identified lane markers and objects within the environment surrounding the vehicle is less than the pre-determined distance, the displaying a lane position alert further includes displaying a lane position alert within the first shaded area including a color-coded graphical lane position alert indicating immediate corrective action by the driver is necessary; and
wherein, when the distance between the vehicle and identified lane markers and objects within the environment surrounding the vehicle is greater than a pre-determined distance and decreasing, the displaying a lane position alert further includes displaying a lane position alert within the second shaded area including a color-coded graphical lane position alert indicating the vehicle is moving away from an optimal position within the lane.