US 11,967,321 B2
Automated assistant control of non-assistant applications via identification of synonymous term and/or speech processing biasing
Joseph Lange, Zurich (CH); Abhanshu Sharma, Zurich (CH); Adam Coimbra, Cupertino, CA (US); Gökhan Bakir, Zurich (CH); Gabriel Taubman, New York, NY (US); Ilya Firman, Sunnyvale, CA (US); Jindong Chen, Hillsborough, CA (US); James Stout, Sunnyvale, CA (US); Marcin Nowak-Przygodzki, Bäch (CH); Reed Enger, Maplewood, NJ (US); Thomas Weedon Hume, San Francisco, CA (US); Vishwath Mohan, Mountain View, CA (US); Jacek Szmigiel, Zurich (CH); Yunfan Jin, Sunnyvale, CA (US); Kyle Pedersen, Brooklyn, NY (US); and Gilles Baechler, Zurich (CH)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Nov. 30, 2021, as Appl. No. 17/538,641.
Claims priority of provisional application 63/252,894, filed on Oct. 6, 2021.
Prior Publication US 2023/0103677 A1, Apr. 6, 2023
Int. Cl. G10L 15/22 (2006.01); G06F 3/16 (2006.01); G06F 40/247 (2020.01); G06F 40/30 (2020.01); G10L 15/18 (2013.01)
CPC G10L 15/22 (2013.01) [G06F 3/167 (2013.01); G06F 40/247 (2020.01); G06F 40/30 (2020.01); G10L 15/1815 (2013.01); G10L 15/1822 (2013.01); G10L 2015/223 (2013.01); G10L 2015/228 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
determining, by an automated assistant, that a user is accessing an application interface of an application that is different from the automated assistant,
wherein the application interface is rendered at a display interface of a computing device and the computing device provides access to the automated assistant;
identifying, by the automated assistant, one or more terms that are synonymous with a particular feature of the application interface of the application;
receiving, from the user, a spoken utterance that includes a particular term of the one or more terms identified by the automated assistant,
wherein the particular term is not expressly rendered in the application interface;
determining, based on having identified the particular term as being synonymous with the particular feature, to control the application using a type of input that can be received by an operating system of the computing device for interacting with the particular feature of the application interface; and
causing, by the automated assistant and in response to the spoken utterance, the operating system to interact with the particular feature of the application interface.