US 12,243,521 B2
Multimodal transmission of packetized data
Gaurav Bhaya, Sunnyvale, CA (US); and Robert Stets, Mountain View, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Jul. 28, 2021, as Appl. No. 17/387,608.
Application 17/387,608 is a continuation of application No. 16/696,622, filed on Nov. 26, 2019, granted, now 11,087,760.
Application 16/696,622 is a continuation of application No. 16/039,202, filed on Jul. 18, 2018, granted, now 10,535,348, issued on Jan. 14, 2020.
Application 16/039,202 is a continuation of application No. 15/395,703, filed on Dec. 30, 2016, granted, now 10,032,452, issued on Jul. 24, 2018.
Prior Publication US 2021/0358498 A1, Nov. 18, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G10L 15/00 (2013.01); G06F 3/16 (2006.01); G10L 15/14 (2006.01); G10L 15/18 (2013.01); G10L 15/22 (2006.01); G10L 15/26 (2006.01); G10L 15/30 (2013.01); H04L 47/25 (2022.01); G10L 15/08 (2006.01)
CPC G10L 15/22 (2013.01) [G06F 3/165 (2013.01); G10L 15/14 (2013.01); G10L 15/1822 (2013.01); G10L 15/26 (2013.01); G10L 15/30 (2013.01); H04L 47/25 (2013.01); G10L 2015/088 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system to transmit data in a voice-based computing environment, comprising:
a data processing system comprising one or more processors and memory to:
receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a sensor of a client computing device associated with an electronic account;
parse the input audio signal to identify a request;
select a content item responsive to the request;
identify a plurality of interfaces executed by one or more client computing devices linked with the electronic account, the one or more client computing devices comprising the client computing device;
determine a characteristic of each of the plurality of interfaces;
select, based on the characteristic of each of the plurality of interfaces executed by the one or more client computing devices linked with the electronic account, a first interface of the plurality of interfaces having a first characteristic, the first interface executed by a first computing device; and
provide, to the first computing device, the content item for presentation as audio output via the first interface.