US 11,935,536 B2
Action validation for digital assistant-based applications
Dharma Muppalla, Lawrenceville, NJ (US); and Nikhil Rao, Santa Clara, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Sep. 29, 2022, as Appl. No. 17/956,480.
Application 17/956,480 is a continuation of application No. 16/482,187, granted, now 11,461,221, previously published as PCT/US2019/035616, filed on Jun. 5, 2019.
Prior Publication US 2023/0016967 A1, Jan. 19, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 9/44 (2018.01); G06F 3/16 (2006.01); G06F 9/445 (2018.01); G06F 9/451 (2018.01); G06F 9/455 (2018.01); G06F 11/07 (2006.01); G06F 11/36 (2006.01); G06F 16/242 (2019.01); G06F 16/2455 (2019.01); G10L 15/22 (2006.01)
CPC G10L 15/22 (2013.01) [G06F 3/167 (2013.01); G06F 9/453 (2018.02); G06F 11/0769 (2013.01); G06F 11/366 (2013.01); G06F 11/3664 (2013.01); G06F 11/3692 (2013.01); G06F 16/243 (2019.01); G06F 16/24565 (2019.01); G10L 2015/223 (2013.01); G10L 2015/225 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method of validating actions in a digital assistant-based application, comprising:
identifying, by a data processing system comprising at least one processor, an application provided by an application developer device, the application having a conversational interface;
selecting, by the data processing system based on the application, an action from an action repository of the data processing system;
generating, by the data processing system and based on the action, a trigger phrase for input into the application, the trigger phrase representing a simulated voice-based input;
executing, by the data processing system, the application to process the trigger phrase to identify an action responsive to the trigger phrase;
generating, by the data processing system, a first query to request a value of a parameter used by the application to execute the action responsive to the trigger phrase;
generating, by the data processing system, a first response to the first query for input into the application, the first response including a simulated value as the value for the parameter, wherein when the first response is provided for input into the application, the simulated value is detected, and based on the simulated value being detected, execution by the application of at least a portion of the action responsive to the trigger phrase is blocked;
determining, by the data processing system based on execution of the application to process the first response, an error code, including:
determining a state of the application is a termination state;
evaluating the state of the application to determine a resource utilized by the application is active; and
generating the error code indicating that the application failed to deactivate the resource responsive to the termination state; and
providing, by the data processing system to the application developer device, a notification based on the error code.