US 12,434,134 B2
Multimodal sensor fusion for building virtual gamepad for in-car games
Mohammad Medhi Moniri, Ulm (DE); and Erland Unruh, Ulm (DE)
Assigned to Cerence Operating Company, Burlington, MA (US)
Filed by CERENCE OPERATING COMPANY, Burlington, MA (US)
Filed on Jul. 28, 2023, as Appl. No. 18/361,049.
Prior Publication US 2025/0032899 A1, Jan. 30, 2025
Int. Cl. A63F 13/213 (2014.01); A63F 13/215 (2014.01); A63F 13/803 (2014.01)
CPC A63F 13/213 (2014.09) [A63F 13/215 (2014.09); A63F 13/803 (2014.09)] 20 Claims
OG exemplary drawing
 
1. A vehicle gaming system for a vehicle, the vehicle gaming system comprising:
one or more computing devices configured to:
obtain body gesture data indicative of one or more recognized poses of a user of a video game;
obtain speech data indicative of one or more recognized words spoken by the user in a passenger cabin of the vehicle;
generate a multimodal gaming input by combining the body gesture data and the speech data;
identify one or more game commands for the video game being played from a game command datastore based on the multimodal gaming input; and
transmit the one or more game commands to a remote gaming server to obtain gaming codes associated with the one or more game commands to cause the video game to perform an action associated with the one or more game commands.