US 12,456,306 B2
Identifying person of interest with augmented reality head-up display
Pallavi Gautam, Royal Oak, MI (US); Joseph F. Szczerba, Grand Blanc, MI (US); Robert C. Jablonski, Rochester, MI (US); and Thomas A. Seder, Fraser, MI (US)
Assigned to GM Global Technology Operations LLC, Detroit, MI (US)
Filed by GM Global Technology Operations LLC, Detroit, MI (US)
Filed on Jul. 26, 2023, as Appl. No. 18/359,431.
Prior Publication US 2025/0037474 A1, Jan. 30, 2025
Int. Cl. G06V 20/58 (2022.01); B60K 35/10 (2024.01); B60K 35/23 (2024.01); B60K 35/28 (2024.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06V 40/10 (2022.01)
CPC G06V 20/58 (2022.01) [B60K 35/10 (2024.01); G02B 27/0101 (2013.01); G02B 27/0179 (2013.01); G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06V 40/10 (2022.01); B60K 35/23 (2024.01); B60K 35/28 (2024.01); B60K 2360/177 (2024.01); B60K 2360/23 (2024.01); B60K 2360/25 (2024.01); B60K 2360/334 (2024.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0141 (2013.01); G02B 2027/0187 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method of identifying a person of interest for an occupant within a vehicle with a head-up system, comprising:
identifying, with a controller in communication with an external scene camera adapted to capture images of an external environment in proximity to the vehicle, at least one person of interest to the occupant, that has a connection to the occupant, located within the external environment in proximity to the vehicle;
characterizing, with the controller, the at least one person of interest as one of friendly to the occupant or not-friendly to the occupant;
determining, with the controller, appropriate augmentation graphics related to the identified at least one person of interest to be displayed for the occupant; and
displaying, with the head-up display system, the augmentation graphics onto an inner surface of a windshield of the vehicle;
determining, with the controller, if the windshield is in a privacy mode, wherein the windshield is opaque and the external environment is not visible to the occupant through the windshield and the occupant is not visible to persons within the external environment, and when the windshield is in the privacy mode, deactivating the privacy mode prior to displaying appropriate augmentation graphics on the inner surface of the windshield; and
after characterization of the at least one person of interest to the occupant:
de-activating the privacy mode, allowing the occupant and the at least one person of interest to the occupant to see one another when the at least one person of interest to the occupant is characterized as friendly to the occupant; and
activating the privacy mode preventing the occupant and the at least one person of interest to the occupant from seeing one another when the at least one person of interest to the occupant is characterized as un-friendly to the occupant.