US 12,118,981 B2
Determining multilingual content in responses to a query
Wangqing Yuan, Wilmington, MA (US); Bryan Christopher Horling, Belmont, CA (US); and David Kogan, Natick, MA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Sep. 15, 2021, as Appl. No. 17/475,897.
Prior Publication US 2023/0084294 A1, Mar. 16, 2023
Int. Cl. G10L 15/00 (2013.01); G10L 13/08 (2013.01); G10L 15/22 (2006.01); G10L 15/26 (2006.01)
CPC G10L 13/086 (2013.01) [G10L 15/22 (2013.01); G10L 2015/223 (2013.01); G10L 2015/225 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
receiving audio data that captures a spoken query of a user that is in a first language, wherein the spoken query is provided via an automated assistant interface of a client device, and wherein the first language is specified as a primary language for the user;
generating, based on processing the audio data, a first language response to the spoken query, wherein the first language response is in the first language;
generating a second language response, to the spoken query, that is in the second language, wherein the second language is specified as a secondary language of interest to the user;
determining, based on verification data provided with or derived from the audio data, to render multilingual content in response to the spoken query, the multilingual content including the first language response and the second language response;
in response to determining to render the multilingual content:
causing the multilingual content to be rendered at the assistant interface of the client device and in response to the spoken query;
determining a query suggestion, wherein determining the query suggestion is based on the spoken query, the first language response, and/or the second language response;
in response to determining to render the multilingual content:
causing a first language version of the query suggestion and a second language version of the query suggestion to be rendered at the assistant interface of the client device in response to the spoken query;
prior to receiving any selection of the first language version of the query suggestion or the second language version of the query suggestion:
generating a first response to the query suggestion in the first language;
generating a second response to the query suggestion in the second language; and
causing the first response and the second response to be cached;
receiving a selection of the first language version of the query suggestion; and
in response to receiving the selection of first language version of the query suggestion:
causing the cached first response to the query suggestion to be audibly rendered; and
causing the cached second response to the query suggestion to be audibly rendered subsequent to causing the cached first response to the query suggestion to be audibly rendered.