US 11,833,422 B2
Providing automated user input to an application
Mohamed Musbah, Montreal (CA); Matthew Mitchell Dixon, Westmount (CA); Geoffrey Jacoby Gordon, Montreal (CA); Mahmoud Adada, Montreal (CA); Soroush Mehri, Montreal (CA); Andrew James McNamara, Cambridge (CA); and Jonathan David Morrison, North Bend, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Feb. 22, 2022, as Appl. No. 17/677,516.
Application 17/677,516 is a continuation of application No. 17/537,951, filed on Nov. 30, 2021, granted, now 11,724,186.
Application 17/537,951 is a continuation of application No. 16/660,584, filed on Oct. 22, 2019, granted, now 11,213,746, issued on Jan. 4, 2022.
Prior Publication US 2022/0176244 A1, Jun. 9, 2022
Int. Cl. A63F 13/422 (2014.01); A63F 13/358 (2014.01); G06N 20/00 (2019.01)
CPC A63F 13/422 (2014.09) [A63F 13/358 (2014.09); G06N 20/00 (2019.01); A63F 2300/534 (2013.01); A63F 2300/535 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method performed by a computing device, the method comprising:
obtaining application output by an interactive application;
providing the application output to a user interaction model, wherein the user interaction model:
processes the application output to obtain application output embeddings; and
maps the application output embeddings to automated user inputs; and
providing the automated user inputs to the interactive application.