US 12,002,463 B2
Systems and methods for voice-based initiation of custom device actions
Bo Wang, San Jose, CA (US); Venkat Kotla, Mountain View, CA (US); Chad Yoshikawa, Mountain View, CA (US); Chris Ramsdale, Mountain View, CA (US); Pravir Gupta, Los Altos, CA (US); Alfonso Gomez-Jordana, Mountain View, CA (US); Kevin Yeun, Mountain View, CA (US); Jae Won Seo, Mountain View, CA (US); Lantian Zheng, San Jose, CA (US); and Sang Soo Sung, Palo Alto, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Apr. 25, 2022, as Appl. No. 17/728,614.
Application 17/728,614 is a continuation of application No. 15/781,787, granted, now 11,314,481, previously published as PCT/US2018/031454, filed on May 7, 2018.
Claims priority of provisional application 62/640,007, filed on Mar. 7, 2018.
Prior Publication US 2022/0244910 A1, Aug. 4, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G10L 15/22 (2006.01); G06F 3/16 (2006.01); G10L 15/18 (2013.01); G10L 15/26 (2006.01); G10L 15/30 (2013.01)
CPC G10L 15/22 (2013.01) [G06F 3/167 (2013.01); G10L 15/1822 (2013.01); G10L 15/26 (2013.01); G10L 15/30 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A data processing system to provide content responsive to voice-based interactions, comprising:
a memory to store device action data including a plurality of device action-command pairs supported by a plurality of electronic devices associated with a device model, each device action-command pair including a respective device action of a plurality of device actions and a respective device executable command of a plurality of device executable commands to trigger performance of the respective device action, the respective device executable command being an executable command specific to the plurality of electronic devices associated with the device model;
a device action customization component to map a device model identifier indicative of the device model of the plurality of electronic devices to each of the plurality of device action-command pairs supported by the plurality of electronic devices associated with the device model;
a communications interface to receive, from an electronic device, an audio signal and the device model identifier, the audio signal obtained by the electronic device responsive to a voice-based query;
a natural language processor component to identify, using content associated with the audio signal and the device model identifier, a device action-command pair of the plurality of device action-command pairs;
the device action customization component to identify a context of the voice-based query based on the device action data or the device action-command pair;
a content selector component to select a digital component based on the context of the voice-based query, the digital component comprising audio or visual content; and
the communications interface to transmit the digital component and a device executable command associated with the device action-command pair to the electronic device, the device executable command to cause performance of the device action associated with the device action-command pair and the digital component for presentation by the electronic device, the digital component causing the electronic device to render the audio or visual content on the electronic device in connection with and based on the performance of the device action.