US 11,895,269 B2
Determination and visual display of spoken menus for calls
Joseph Joseph Cherukara, San Francisco, CA (US); Amit Sivan, Tel Aviv (IL); Andrew George Shebanow, San Jose, CA (US); Yoav Tzur, Tel Aviv (IL); Felix Wang, New York, NY (US); and Yaniv Leviathan, Sunnyvale, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Dec. 2, 2021, as Appl. No. 17/540,895.
Claims priority of provisional application 63/236,651, filed on Aug. 24, 2021.
Prior Publication US 2023/0066100 A1, Mar. 2, 2023
Int. Cl. H04M 3/493 (2006.01); H04M 1/72469 (2021.01); H04M 3/42 (2006.01); G10L 15/26 (2006.01); G10L 15/22 (2006.01)
CPC H04M 3/4936 (2013.01) [G10L 15/22 (2013.01); G10L 15/26 (2013.01); H04M 1/72469 (2021.01); H04M 3/42059 (2013.01); G10L 2015/223 (2013.01); G10L 2015/225 (2013.01); H04M 2201/40 (2013.01); H04M 2201/42 (2013.01); H04M 2203/2038 (2013.01); H04M 2203/551 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
during a call between a call device and a device associated with a target entity:
obtaining selection option data including one or more selection options for a user of the call device to navigate through a call menu provided by the target entity in the call;
causing one or more visual options corresponding to the one or more selection options to be displayed by the call device before the call device receives audio data that includes speech indicating the one or more selection options, wherein the one or more visual options are each selectable via user input to cause corresponding navigation through the call menu, and wherein each of the one or more visual options include respective text;
receiving audio data in the call, the audio data including the speech indicating the one or more selection options;
while receiving the audio data, programmatically analyzing a portion of the audio data that is currently being received to determine current text representing the speech in the portion of the audio data that is currently being received;
determining, based on the current text, a particular portion of the respective text of a corresponding one of the one or more visual options displayed during the call; and
causing a visual indicator to be displayed during the call, wherein the visual indicator highlights the particular portion of the respective text of the corresponding one of the one or more visual options displayed during the call.