US 11,688,022 B2
Semantic representations using structural ontology for assistant systems
Armen Aghajanyan, Bellevue, WA (US); Sonal Gupta, Sunnyvale, CA (US); Brian Moran, Redmond, WA (US); Theodore Frank Levin, Seattle, WA (US); Crystal Annette Naomi Su Hua Nakatsu, San Jose, CA (US); Daniel Difranco, Seattle, WA (US); Jonathan David Christensen, Redmond, WA (US); Kirk LaBuda, Seattle, WA (US); and Anuj Kumar, Santa Clara, CA (US)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on Aug. 20, 2020, as Appl. No. 16/998,423.
Claims priority of provisional application 62/923,342, filed on Oct. 18, 2019.
Prior Publication US 2021/0117624 A1, Apr. 22, 2021
Int. Cl. G06F 40/30 (2020.01); G06F 9/54 (2006.01); G06F 40/205 (2020.01); G06F 40/242 (2020.01); G06N 3/04 (2006.01); G06N 3/08 (2006.01); G06F 16/9536 (2019.01); G10L 15/18 (2013.01); G10L 15/22 (2006.01); G10L 15/30 (2013.01); G10L 15/32 (2013.01); G06F 40/253 (2020.01); G06N 20/00 (2019.01); G06F 3/01 (2006.01); G06Q 50/00 (2012.01); G06F 16/9032 (2019.01); G06F 9/48 (2006.01); G10L 15/08 (2006.01); H04N 7/14 (2006.01); H04L 67/306 (2022.01); G06F 9/451 (2018.01); G06F 16/332 (2019.01); G06F 40/35 (2020.01); G06F 40/56 (2020.01); G06V 20/20 (2022.01); G06V 10/82 (2022.01); G06V 40/16 (2022.01); G06V 20/30 (2022.01); G06V 10/20 (2022.01); G06V 10/764 (2022.01); G06V 20/00 (2022.01); G06V 40/20 (2022.01); H04L 51/222 (2022.01); H04L 51/224 (2022.01); H04L 51/52 (2022.01); H04L 51/212 (2022.01); H04L 67/75 (2022.01); G06N 3/047 (2023.01); G06N 3/045 (2023.01); G06F 18/2321 (2023.01); G06Q 10/109 (2023.01); G10L 15/06 (2013.01); G10L 15/16 (2006.01); H04L 51/18 (2022.01); G06V 20/40 (2022.01); G06F 3/16 (2006.01)
CPC G06Q 50/01 (2013.01) [G06F 3/011 (2013.01); G06F 3/013 (2013.01); G06F 9/453 (2018.02); G06F 9/485 (2013.01); G06F 9/4881 (2013.01); G06F 9/547 (2013.01); G06F 16/3329 (2019.01); G06F 16/90332 (2019.01); G06F 16/9536 (2019.01); G06F 18/2321 (2023.01); G06F 40/205 (2020.01); G06F 40/242 (2020.01); G06F 40/253 (2020.01); G06F 40/30 (2020.01); G06F 40/35 (2020.01); G06F 40/56 (2020.01); G06N 3/045 (2023.01); G06N 3/047 (2023.01); G06N 3/08 (2013.01); G06N 20/00 (2019.01); G06Q 10/109 (2013.01); G06V 10/255 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/00 (2022.01); G06V 20/20 (2022.01); G06V 20/30 (2022.01); G06V 40/16 (2022.01); G06V 40/25 (2022.01); G10L 15/063 (2013.01); G10L 15/08 (2013.01); G10L 15/16 (2013.01); G10L 15/1815 (2013.01); G10L 15/1822 (2013.01); G10L 15/22 (2013.01); G10L 15/30 (2013.01); G10L 15/32 (2013.01); H04L 51/18 (2013.01); H04L 51/212 (2022.05); H04L 51/222 (2022.05); H04L 51/224 (2022.05); H04L 51/52 (2022.05); H04L 67/306 (2013.01); H04L 67/75 (2022.05); H04N 7/147 (2013.01); G06F 3/017 (2013.01); G06F 3/167 (2013.01); G06V 20/41 (2022.01); G06V 40/174 (2022.01); G06V 2201/10 (2022.01); G10L 2015/088 (2013.01); G10L 2015/223 (2013.01); G10L 2015/227 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method comprising, by one or more computing systems:
receiving, by an assistant xbot from a client system associated with a user, a user input comprising a natural-language utterance;
determining a semantic representation of the user input based on a structural ontology, wherein the structural ontology defines a labeling syntax for parsing the natural-language utterance to semantic units comprising a plurality of actions, objects, and attributes, and wherein the semantic representation embeds at least one object within at least one action and declares at least one attribute of the at least one embedded object to be acted upon;
sending, to an agent, a request for executing a task corresponding to the user input, wherein the request is based on the semantic representation;
receiving, from the agent, results generated by the agent from executing the task, wherein the results are mapped to a structure determined by the structural ontology; and
sending, from the assistant xbot to the client system, instructions for presenting a response to the user input, wherein the response is based on the results.