US 12,437,014 B2
Proactive multi-modal automotive concierge
Evans Castonguay, Montreal (CA); Balakrishna Venkata Jagannadha Kolluru, Austin, TX (US); Christian Benien, Aachen (DE); William Bille, Montreal (CA); Iqbal Arshad, South Barrington, IL (US); and Ricky Hoobler, Waltham, MA (US)
Assigned to Cerence Operating Company, Burlington, MA (US)
Filed by Cerence Operating Company, Burlington, MA (US)
Filed on Oct. 15, 2024, as Appl. No. 18/915,764.
Claims priority of provisional application 63/543,868, filed on Oct. 12, 2023.
Claims priority of provisional application 63/685,291, filed on Aug. 21, 2024.
Claims priority of provisional application 63/703,238, filed on Oct. 4, 2024.
Claims priority of provisional application 63/706,114, filed on Oct. 11, 2024.
Claims priority of provisional application 63/706,118, filed on Oct. 11, 2024.
Prior Publication US 2025/0124091 A1, Apr. 17, 2025
Int. Cl. G06F 16/9535 (2019.01); B60K 35/10 (2024.01); B60K 35/22 (2024.01); B60K 35/26 (2024.01)
CPC G06F 16/9535 (2019.01) [B60K 35/10 (2024.01); B60K 35/22 (2024.01); B60K 35/265 (2024.01); B60K 2360/1438 (2024.01); B60K 2360/164 (2024.01)] 19 Claims
OG exemplary drawing
 
1. An apparatus for providing information services to a user in a vehicle, said apparatus comprising
an infotainment system mounted within said vehicle,
a sensor set connected to said infotainment system, said sensor set comprising a microphone for receiving an utterance from said user, a loudspeaker, a touch-screen interface, and a display, wherein said infotainment system provides audible outputs through the loudspeaker and/or through said display, for communicating with said user,
a plurality of context source §. in communication with said infotainment system,
a context aggregator that aggregates context from said context sources for said infotainment system,
an automotive concierge that is hosted by said infotainment system, wherein said automotive concierge engages in an interaction with said user based on context from said context source,
a language model that is in communication with said automotive concierge,
a prompter that generates a prompt for said language model in response to an instruction from said automotive concierge, said instruction being based on said context and said prompt being selected to cause said language model to generate content that invites a choice from said user,
a mode selector that selects:
a first communication-channel for enabling said user to provide first information to said infotainment system and
a second communication-channel for enabling said infotainment system to provide second information to said user,
wherein said first communication-channel is selected from the group consisting of said microphone and said touch-screen interface,
wherein said second communication-channel is selected from the group consisting of said loudspeaker and said display,
an interaction mode for delivering said content to said user and for providing information from said user to said automotive concierge, wherein said interaction mode comprises said first communication channel and said second communication channel,
wherein said mode selector selects said first communication-channel and said second communication-channel for said interaction mode based on a selection signal received from said automotive concierge, said selection signal being based on said context from said context source,
wherein, based on said selection signal, said mode selector selects said interaction mode from the group consisting of:
a first interaction mode, which provides communication between said infotainment and said user via said microphone and said loudspeaker,
a second interaction mode, which provides communication between said infotainment system and said user via said microphone and said display,
a third interaction mode, which provides communication between said infotainment system and said user via said touch-screen interface and said loudspeaker, and
a fourth interaction mode, which provides communication between said infotainment system and said user via said touch-screen interface and said display, and
wherein, in said default configuration of said interaction mode, said interaction mode provides communication between said infotainment system and said user via said microphone and said loudspeaker.