US 12,272,150 B2
Identification of objects by color with ARHUD
Jacob Alan Bond, Rochester Hills, MI (US); Joseph F. Szczerba, Grand Blanc, MI (US); and Kai-Han Chang, Sterling Heights, MI (US)
Assigned to GM GLOBAL TECHNOLOGY OPERATIONS LLC, Detroit, MI (US)
Filed by GM Global Technology Operations LLC, Detroit, MI (US)
Filed on Aug. 8, 2022, as Appl. No. 17/818,165.
Prior Publication US 2024/0042954 A1, Feb. 8, 2024
Int. Cl. G06V 20/56 (2022.01); B60R 1/20 (2022.01); B60R 16/037 (2006.01); G06V 20/20 (2022.01); G06V 20/70 (2022.01)
CPC G06V 20/56 (2022.01) [B60R 1/20 (2022.01); B60R 16/0373 (2013.01); G06V 20/70 (2022.01); B60R 2300/105 (2013.01); G06V 20/20 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A system for displaying information to an occupant of a vehicle, the system comprising:
a vehicle microphone for converting acoustic waves to electrical signals;
a vehicle camera for capturing images of an environment surrounding the vehicle;
a display for displaying information to the occupant;
a vehicle communication system;
a mobile device; and
a vehicle controller in electrical communication with the vehicle microphone, the vehicle camera, and the vehicle communication system, wherein the vehicle controller is programmed to:
receive a voice command from the occupant using the vehicle microphone, wherein the voice command relates to a requested object;
determine an identity and a color of the requested object based on the voice command;
transmit the identity and the color of the requested object to the mobile device using the vehicle communication system;
capture a first image of the environment using the vehicle camera, wherein the environment includes a relevant object;
capture a second image of the environment surrounding the occupant using a mobile device camera of the mobile device;
identify a location of the relevant object in the environment based at least in part on the first image, the second image, and the identity and the color of the requested object; and
display a graphic indicating the location of the relevant object in the environment using the display, wherein the display includes at least one of: a vehicle display and a mobile device display of the mobile device.