US 12,271,408 B2
Streaming real-time dialog management
David Elson, Port Washington, NY (US); Christa Wimberley, Mountain View, CA (US); Benjamin Ross, Mountain View, CA (US); David Eisenberg, New York, NY (US); Sudeep Gandhe, Mountain View, CA (US); Kevin Chavez, Mountain View, CA (US); and Raj Agarwal, Mountain View, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Dec. 29, 2023, as Appl. No. 18/400,826.
Application 18/400,826 is a continuation of application No. 18/088,270, filed on Dec. 23, 2022, granted, now 11,860,913.
Application 18/088,270 is a continuation of application No. 17/114,350, filed on Dec. 7, 2020, granted, now 11,537,646, issued on Dec. 27, 2022.
Application 17/114,350 is a continuation of application No. 15/783,290, filed on Oct. 13, 2017, granted, now 10,860,628, issued on Dec. 8, 2020.
Claims priority of provisional application 62/459,820, filed on Feb. 16, 2017.
Prior Publication US 2024/0134893 A1, Apr. 25, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/33 (2019.01); G06F 16/00 (2019.01); G06F 16/3329 (2025.01); G06F 16/334 (2025.01); G06F 40/30 (2020.01); G06N 20/00 (2019.01); G06Q 10/10 (2023.01); G10L 15/22 (2006.01); G06F 40/205 (2020.01)
CPC G06F 16/3329 (2019.01) [G06F 16/00 (2019.01); G06F 16/3344 (2019.01); G06F 40/30 (2020.01); G06N 20/00 (2019.01); G06Q 10/10 (2013.01); G10L 15/22 (2013.01); G06F 40/205 (2020.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
receiving, at an assistant device, a first input from a user during a real-time dialog between the user and the assistant device, wherein the first input from the user is received at one or more of a graphical interface, an audio interface, or a haptic interface of the assistant device;
transmitting, by the assistant device, features of the first input to a remote device;
receiving, at the assistant device, one or more predicted responses generated in response to the transmitting of the features of the first input by the assistant device to the remote device, wherein one or more of the predicted responses correspond to a particular schema of one or more schemas;
storing, during the real-time dialog between the user and the assistant device, the one or more predicted responses and data indicating that the one or more predicted responses correspond to the particular schema;
receiving, at the assistant device and subsequent to receiving the first input, a second input from the user during the real-time dialog between the user and the assistant device, wherein the second input is different from the first input, and wherein the second input from the user is received at one or more of the graphical interface, the audio interface, or the haptic interface of the assistant device, and/or one or more of a graphical interface, a audio interface, or a haptic interface of another assistant device;
in response to receiving the second input:
identifying, based on processing the second input, that the second input also corresponds to the particular schema;
determining, based on processing the data indicating that the one or more predicted responses correspond to the particular schema and based on identifying that the second input also corresponds to the particular schema to provide a predicted response, of the one or more predicted responses that correspond to the particular schema, to the user; and
causing, based on determining to provide the predicted response, one or more of the assistant device or the another assistant device to render a prompt for the user regarding the predicted response.