US 12,253,826 B1
Configuring hologram interactions with vehicle passengers
Brian Howard Katz, San Antonio, TX (US); Jon Dwain McLaughlin, Syracuse, NY (US); Surender Kumar, Palatine, IL (US); Roberto Virgillio Jolliffe, San Antonio, TX (US); Shayla Leigh Callis, Simi Valley, CA (US); Sydney Ann Conrad-Cook, Van Meter, IA (US); and Breanna Nicole Allerkamp, Boerne, TX (US)
Assigned to United States Automobile Association (USAA), San Antonio, TX (US)
Filed by UIPCO, LLC, San Antonio, TX (US)
Filed on Mar. 2, 2022, as Appl. No. 17/684,596.
Int. Cl. G03H 1/00 (2006.01); B60K 35/00 (2006.01); B60N 2/02 (2006.01); E05F 15/72 (2015.01); B60K 35/28 (2024.01); B62D 1/18 (2006.01); G06F 3/01 (2006.01); G06F 3/16 (2006.01)
CPC G03H 1/0005 (2013.01) [B60K 35/00 (2013.01); B60N 2/0276 (2013.01); E05F 15/72 (2015.01); B60K 35/28 (2024.01); B60K 2360/161 (2024.01); B60K 2360/29 (2024.01); B62D 1/18 (2013.01); E05Y 2400/45 (2013.01); E05Y 2400/85 (2013.01); E05Y 2800/252 (2013.01); E05Y 2900/531 (2013.01); E05Y 2900/548 (2013.01); E05Y 2900/55 (2013.01); G03H 2001/0061 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/167 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method for selecting an input modality for interacting with a generated hologram in a vehicle, the method comprising:
receiving sensor data, from one or more sensing devices, representative of at least one of a vehicle's condition or a condition of a passenger of the vehicle;
detecting, by analyzing the sensor data using one or more machine learning models, a condition comprising one or more of a vehicle crash or impairment of the passenger;
triggering, based on the detected condition, a capture mode that determines a state of impairment for the passenger;
selecting at least one input modality for interacting with the passenger using at least a mapping that maps a set of input modalities to states of impairment,
wherein the input modality is selected for a display device configured to display a hologram,
wherein the selected input modality comprises one or more of audio, movement, gesture, or gaze,
wherein the mapping maps at least a portion of the states of impairment to a limited subset of the set of input modalities, and
wherein the limited subset of the set of input modalities excludes at least another portion of the set of input modalities;
building a set of instructions for the passenger using one or more of the sensor data or the state of impairment for the passenger;
displaying, using the display device, the hologram; and
controlling, based on input received from the passenger via the selected input modality, the displayed hologram, wherein the controlling guides the passenger, via the hologram, through the set of instructions, and the set of instructions are configured to guide the passenger to safety or to alleviate danger to the passenger related to the detected condition.