US 12,141,709 B1
Providing contextual actions for mobile onscreen content
Ibrahim Badr, Zurich (CH); Mauricio Zuluaga, Adliswil (CH); Aneto Okonkwo, Zurich (CH); and Gökhan Bakir, Zurich (CH)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Jun. 29, 2023, as Appl. No. 18/216,402.
Application 18/216,402 is a continuation of application No. 17/324,249, filed on May 19, 2021, granted, now 11,734,581.
Application 17/324,249 is a continuation of application No. 16/702,248, filed on Dec. 3, 2019, granted, now 11,017,299, issued on May 25, 2021.
Application 16/702,248 is a continuation of application No. 15/386,771, filed on Dec. 21, 2016, granted, now 10,535,005, issued on Jan. 14, 2020.
Claims priority of provisional application 62/413,174, filed on Oct. 26, 2016.
This patent is subject to a terminal disclaimer.
Int. Cl. G06N 5/022 (2023.01); G06F 3/04817 (2022.01); G06F 3/0482 (2013.01); G06F 9/54 (2006.01); G06F 40/134 (2020.01); H04L 9/40 (2022.01); G06F 8/61 (2018.01); H04W 88/02 (2009.01)
CPC G06N 5/022 (2013.01) [G06F 3/04817 (2013.01); G06F 3/0482 (2013.01); G06F 9/54 (2013.01); G06F 40/134 (2020.01); H04L 63/08 (2013.01); G06F 8/61 (2013.01); H04W 88/02 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
transmitting, via an application programming interface (API) and to an action suggestion engine, and during a current session in which a user is interacting with a third-party application that is administered by a third-party via a client device, context information that reflects user interactions with the third-party application,
wherein the context information is not visible on a current screen of the client device during the current session, and wherein the user interactions with the third-party application include one or more of: current user interactions with the third-party application during the current session, or historical user interactions with the third-party application prior to the current session, and
wherein transmitting the context information that reflects user interactions with the third-party application via the API and to the action suggestion engine causes the action suggestion engine to:
predict, based on the context information, an action to be performed using an additional third-party application that is administered by an additional third-party,
wherein the additional third-party that administers the additional third-party application differs from the third-party that administers the third-party application; and
cause an indication of the predicted action to be performed using the additional third-party application to be provided for presentation to the user during the current session in which the user is interacting with the third-party application;
receiving, via the API and from the action suggestion engine, and based on user input being received that is directed to the predicted action to be performed using the additional third-party application, an indication to transfer focus from the third-party application to the additional third-party application;
in response to receiving the indication to transfer focus from the third-party application to the additional third-party application:
transmitting, via the API and to the additional third-party application, data derived from the user interactions with the third-party application to the additional third-party application,
wherein the data derived from the user interactions with the third-party application to the additional third-party application includes: (i) an intent that is indicative of the predicted action to be performed using the additional third-party application, and (ii) one or more values for one or more corresponding parameters associated with the intent that is indicative of the predicted action to be performed using the additional third-party application.