US 11,756,538 B1
Lower latency speech processing
Carl Joshua Dell, Seattle, WA (US); Timothy Kay Cheng, Bellevue, WA (US); and Scott G. LeBaron, Edmonds, WA (US)
Assigned to AMAZON TECHNOLOGIES, INC., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Dec. 10, 2019, as Appl. No. 16/709,651.
Int. Cl. G10L 15/00 (2013.01); G10L 15/22 (2006.01); G10L 15/02 (2006.01); G10L 15/18 (2013.01); G10L 15/30 (2013.01); G10L 15/065 (2013.01); G10L 25/30 (2013.01); G10L 15/183 (2013.01); G10L 15/16 (2006.01)
CPC G10L 15/22 (2013.01) [G10L 15/02 (2013.01); G10L 15/065 (2013.01); G10L 15/1815 (2013.01); G10L 15/30 (2013.01); G10L 15/16 (2013.01); G10L 15/1822 (2013.01); G10L 15/183 (2013.01); G10L 25/30 (2013.01); G10L 2015/223 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, by a feature generation component, first data representing a feature definition for a machine learning model of a skill ranking component;
receiving first input data representing a user request;
determining, from the first input data, natural language understanding (NLU) data representing the user request, the NLU data comprising skill identifier data and intent data representing a semantic interpretation of the user request;
generating, by the feature generation component, first feature data from the skill identifier data and the intent data using the feature definition;
sending, by the feature generation component, the first feature data to the skill ranking component;
storing, by the skill ranking component, the first feature data in a first cache local to the skill ranking component;
storing, by the feature generation component, the first feature data in a second cache local to the feature generation component; and
generating, by the skill ranking component, a ranked list of speech processing skills for processing the user request by inputting the first feature data into the machine learning model of the skill ranking component.