US 11,793,434 B1
System to perform visual recognition and vehicle adaptation
Jingyan Wan, Sterling Heights, MI (US); Ke Liu, Lexington, MA (US); and Omer Tsimhoni, Bloomfield Hills, MI (US)
Assigned to GM GLOBAL TECHNOLOGY OPERATIONS LLC, Detroit, MI (US)
Filed by GM Global Technology Operations LLC, Detroit, MI (US)
Filed on May 18, 2022, as Appl. No. 17/747,449.
Int. Cl. A61B 5/16 (2006.01); A61B 5/18 (2006.01); A61B 5/00 (2006.01); B60K 35/00 (2006.01)
CPC A61B 5/165 (2013.01) [A61B 5/18 (2013.01); A61B 5/6893 (2013.01); B60K 35/00 (2013.01); B60K 2370/149 (2019.05); B60K 2370/1529 (2019.05); B60K 2370/193 (2019.05)] 19 Claims
OG exemplary drawing
 
1. A system for interfacing a motor vehicle with a person residing in the motor vehicle, the system comprising:
a brain-computer interface (BCI) configured to monitor a brain activity of the person, wherein the brain activity is in the form of electric signals from a visual cortex of the person;
a driver monitoring system (DMS) configured to collect data on where the person is looking, wherein the DMS includes a camera; and
an electronic control unit (ECU) in communication with the BCI and the DMS, wherein the ECU includes a processor and a non-transitory computer readable medium, the ECU is programmed to control a head-up display (HUD) of the motor vehicle based on the brain activity of the person monitored by the BCI and the data on where the person is looking received from the DMS; and
wherein the ECU is programmed to:
determine a visual focus strength of the person on an in-vehicle display of the motor vehicle;
determine a visual focus duration of the person on the in-vehicle display of the motor vehicle;
compare the visual focus strength of the person on an in-vehicle display of the motor vehicle with a strength threshold to determine whether the visual focus strength of the person on an in-vehicle display of the motor vehicle is greater than the strength threshold;
compare the visual focus duration of the person on the in-vehicle display of the motor vehicle with a duration threshold to determine whether the visual focus duration of the person on the in-vehicle display of the motor vehicle is greater than the duration threshold; and
in response to determining that: (a) the visual focus strength of the person on an in-vehicle display of the motor vehicle is greater than the strength threshold and (b) the visual focus duration of the person on the in-vehicle display of the motor vehicle is greater than the duration threshold, command the in-vehicle display to execute a command.