US 12,136,419 B2
Multimodality in digital assistant systems
Pierre P. Greborio, Sunnyvale, CA (US); Didier Rene Guzzoni, Mont-sur-Rolle (CH); and Philippe P. Piernot, Los Gatos, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Aug. 31, 2023, as Appl. No. 18/240,986.
Application 18/240,986 is a continuation of application No. 17/732,243, filed on Apr. 28, 2022, granted, now 11,783,815.
Application 17/732,243 is a continuation of application No. 16/441,461, filed on Jun. 14, 2019, granted, now 11,348,573, issued on May 31, 2022.
Claims priority of provisional application 62/820,164, filed on Mar. 18, 2019.
Prior Publication US 2023/0410798 A1, Dec. 21, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G10L 15/22 (2006.01); G10L 15/18 (2013.01); G10L 15/30 (2013.01)
CPC G10L 15/1815 (2013.01) [G10L 15/1822 (2013.01); G10L 15/22 (2013.01); G10L 15/30 (2013.01); G10L 2015/223 (2013.01)] 45 Claims
OG exemplary drawing
 
1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
detect a context of the electronic device;
in accordance with a determination that the context of the electronic device corresponds to a predetermined type of event:
receive a natural language input;
determine, based on the natural language input, a first value for a first node of a plurality of nodes of a parsing structure, the first node corresponding to a natural language data stream;
determine, based on the detected context, a second value for a second node of the plurality of nodes of the parsing structure; and
perform a task associated with the natural language input using the parsing structure, the first value, and the second value.