US 11,842,522 B2
Generating multi-perspective responses by assistant systems
Emmanouil Koukoumidis, Kirkland, WA (US); Michael Robert Hanson, Los Altos, CA (US); Rajen Subba, San Carlos, CA (US); Heidi Young, Woodinville, WA (US); Rushin Shah, Santa Clara, CA (US); Jinsong Yu, Bellevue, WA (US); Benoit F. Dumoulin, Palo Alto, CA (US); Jeremy Gillmor Kahn, Seattle, WA (US); and Chandrasekhar Iyer, Pleasanton, CA (US)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on Feb. 3, 2023, as Appl. No. 18/164,480.
Application 18/164,480 is a continuation of application No. 17/543,539, filed on Dec. 6, 2021, granted, now 11,715,289.
Application 17/543,539 is a continuation of application No. 16/176,312, filed on Oct. 31, 2018, granted, now 11,308,169, issued on Apr. 19, 2022.
Claims priority of provisional application 62/660,876, filed on Apr. 20, 2018.
Prior Publication US 2023/0186618 A1, Jun. 15, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/00 (2019.01); G06V 10/82 (2022.01); G06F 9/451 (2018.01); G10L 15/18 (2013.01); G10L 15/183 (2013.01); G10L 15/22 (2006.01); G06F 16/338 (2019.01); G06F 16/332 (2019.01); G06F 16/33 (2019.01); G06N 20/00 (2019.01); G06F 16/9535 (2019.01); G06Q 50/00 (2012.01); H04L 67/306 (2022.01); G06F 16/176 (2019.01); G10L 15/06 (2013.01); G10L 15/16 (2006.01); G06F 3/01 (2006.01); G06F 16/9032 (2019.01); G06F 16/2457 (2019.01); H04L 5/02 (2006.01); G06F 3/16 (2006.01); G06N 3/08 (2023.01); G10L 15/26 (2006.01); G06F 16/9038 (2019.01); G06F 16/904 (2019.01); G06F 40/30 (2020.01); G06F 40/40 (2020.01); G06F 16/22 (2019.01); G06F 16/23 (2019.01); G06F 7/14 (2006.01); H04L 43/0882 (2022.01); H04L 43/0894 (2022.01); H04L 12/28 (2006.01); H04L 41/00 (2022.01); H04L 41/22 (2022.01); H04W 12/08 (2021.01); G10L 15/07 (2013.01); G10L 17/22 (2013.01); G06N 3/006 (2023.01); G10L 17/06 (2013.01); G06F 16/248 (2019.01); G06F 16/951 (2019.01); G06F 16/242 (2019.01); G06F 16/2455 (2019.01); G10L 15/02 (2006.01); G10L 15/187 (2013.01); G06V 20/10 (2022.01); G06V 40/20 (2022.01); G06F 40/295 (2020.01); H04L 51/52 (2022.01); H04L 51/216 (2022.01); H04L 67/50 (2022.01); H04L 67/5651 (2022.01); H04L 51/18 (2022.01); H04L 67/75 (2022.01); G06F 16/903 (2019.01); G06F 40/205 (2020.01); G06F 18/2411 (2023.01); G06N 7/01 (2023.01); G06V 10/764 (2022.01); H04L 67/10 (2022.01); H04L 51/046 (2022.01); G10L 13/00 (2006.01); G10L 13/04 (2013.01); H04L 67/53 (2022.01)
CPC G06V 10/82 (2022.01) [G06F 3/011 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/167 (2013.01); G06F 7/14 (2013.01); G06F 9/453 (2018.02); G06F 16/176 (2019.01); G06F 16/2255 (2019.01); G06F 16/2365 (2019.01); G06F 16/243 (2019.01); G06F 16/248 (2019.01); G06F 16/24552 (2019.01); G06F 16/24575 (2019.01); G06F 16/24578 (2019.01); G06F 16/338 (2019.01); G06F 16/3323 (2019.01); G06F 16/3329 (2019.01); G06F 16/3344 (2019.01); G06F 16/904 (2019.01); G06F 16/9038 (2019.01); G06F 16/90332 (2019.01); G06F 16/90335 (2019.01); G06F 16/951 (2019.01); G06F 16/9535 (2019.01); G06F 18/2411 (2023.01); G06F 40/205 (2020.01); G06F 40/295 (2020.01); G06F 40/30 (2020.01); G06F 40/40 (2020.01); G06N 3/006 (2013.01); G06N 3/08 (2013.01); G06N 7/01 (2023.01); G06N 20/00 (2019.01); G06Q 50/01 (2013.01); G06V 10/764 (2022.01); G06V 20/10 (2022.01); G06V 40/28 (2022.01); G10L 15/02 (2013.01); G10L 15/063 (2013.01); G10L 15/07 (2013.01); G10L 15/16 (2013.01); G10L 15/183 (2013.01); G10L 15/187 (2013.01); G10L 15/1815 (2013.01); G10L 15/1822 (2013.01); G10L 15/22 (2013.01); G10L 15/26 (2013.01); G10L 17/06 (2013.01); G10L 17/22 (2013.01); H04L 5/02 (2013.01); H04L 12/2816 (2013.01); H04L 41/20 (2013.01); H04L 41/22 (2013.01); H04L 43/0882 (2013.01); H04L 43/0894 (2013.01); H04L 51/18 (2013.01); H04L 51/216 (2022.05); H04L 51/52 (2022.05); H04L 67/306 (2013.01); H04L 67/535 (2022.05); H04L 67/5651 (2022.05); H04L 67/75 (2022.05); H04W 12/08 (2013.01); G06F 2216/13 (2013.01); G10L 13/00 (2013.01); G10L 13/04 (2013.01); G10L 2015/223 (2013.01); G10L 2015/225 (2013.01); H04L 51/046 (2013.01); H04L 67/10 (2013.01); H04L 67/53 (2022.05)] 20 Claims
OG exemplary drawing
 
1. A method comprising, by one or more computing systems:
receiving, from a head-mounted device, a user query inputted on the head-mounted device, wherein the user query corresponds to a plurality of dialog-intents;
executing a plurality of tasks corresponding to the plurality of dialog-intents;
generating, by a stitching model, a multi-perspective response based on two or more of execution results of the plurality of tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results; and
sending, to the head-mounted device, instructions for presenting the multi-perspective response on the head-mounted device.