US 12,142,275 B2
Enabling speech interactions on web-based user interfaces
Jebakumar Mathuram Santhosm Swvigaradoss, Hyderabad (IN); Satya Sarika Sunkara, Sangareddy (IN); Ankit Goel, Hyderabad (IN); Jason Aloia, Carlsbad, CA (US); and Rishabh Verma, Palwal (IN)
Assigned to ServiceNow, Inc., Santa Clara, CA (US)
Filed by ServiceNow, Inc., Santa Clara, CA (US)
Filed on Jan. 16, 2023, as Appl. No. 18/097,443.
Application 18/097,443 is a continuation of application No. 17/025,655, filed on Sep. 18, 2020, granted, now 11,594,218.
Prior Publication US 2023/0169975 A1, Jun. 1, 2023
Int. Cl. G10L 15/22 (2006.01); G10L 15/08 (2006.01)
CPC G10L 15/22 (2013.01) [G10L 15/08 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
determining one or more associated identifiers based on one or more associated tag types of an interactable element of web content;
associating the determined one or more associated identifiers with the interactable element;
matching, based on the association of the determined one or more associated identifiers with the interactable element, a received speech input to the interactable element corresponding to a best element similarity score among different element similarity scores for a plurality of different interactable element candidates of the web content;
identifying an action to be performed on the matched interactable element;
specifically for the identified action, determining whether the speech input specifies sufficient information for the action to be performed on the matched interactable element including by comparing at least a portion of a processed version the speech input with cataloged dropdown list options stored in a dropdown list data structure linked to an entry of an interactable element data structure associated with an aria-label of the matched interactable element to determine whether a single specific matched dropdown list option has a best dropdown list option score determined to meet at least a dropdown list threshold value among a plurality of dropdown list option scores for the cataloged dropdown list options; and
performing the action with respect to the interactable element based on the matching.