US 12,230,278 B1
Output of visual supplemental content
Yining Bao, Bellevue, WA (US); Ellen Hong, Seattle, WA (US); Wenjun Xiong, Santa Clara, CA (US); Luis Pantoja, Tracy, CA (US); Manish Dutt Sharma, Sammamish, WA (US); and Felix Xiaomeng Wu, Seattle, WA (US)
Assigned to Amazon Technologies, Inc., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Feb. 22, 2022, as Appl. No. 17/677,520.
Int. Cl. G10L 17/22 (2013.01); G06F 3/14 (2006.01); G10L 13/02 (2013.01); G10L 17/14 (2013.01)
CPC G10L 17/22 (2013.01) [G06F 3/14 (2013.01); G10L 13/02 (2013.01); G10L 17/14 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A computing system comprising:
at least one processor; and
at least one memory comprising instructions that, when executed by the at least one processor, cause the computing system to:
receive, from a device, input data corresponding to a user input;
determine output data responsive to the user input;
send the output data to the device;
after sending the output data to the device, determine supplemental content is to be presented by the device, wherein the supplemental content is unresponsive to the user input;
receive first presentation data comprising:
first data representing first supplemental content, and
second data indicating the first supplemental content is to be presented visually using a first software version;
receive second presentation data comprising:
third data representing second supplemental content, and
fourth data indicating the second supplemental content is to be presented audibly;
determine the first software version is installed at the device;
determine a user identifier associated with the input data;
determine supplemental content history data associated with the user identifier, the supplemental content history data representing at least one instance of previously presented supplemental content;
process, using a machine learning (ML) model, the first presentation data, the second presentation data, and the supplemental content history data to determine the first supplemental content is to be presented instead of the second supplemental content; and
send the first presentation data to the device, wherein the device uses the first presentation data to visually present the first supplemental content.