US 12,253,620 B2
Multi-user intelligent assistance
Kazuhito Koishida, Redmond, WA (US); Alexander A. Popov, Kirkland, WA (US); Uros Batricevic, Redmond, WA (US); and Steven Nabil Bathiche, Bellevue, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Sep. 27, 2021, as Appl. No. 17/449,054.
Application 17/449,054 is a continuation of application No. 15/657,822, filed on Jul. 24, 2017, granted, now 11,194,998.
Claims priority of provisional application 62/482,165, filed on Apr. 5, 2017.
Claims priority of provisional application 62/459,020, filed on Feb. 14, 2017.
Prior Publication US 2022/0012470 A1, Jan. 13, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G10L 15/22 (2006.01); A61B 5/00 (2006.01); A61B 5/0205 (2006.01); A61B 5/0507 (2021.01); A61B 5/11 (2006.01); A61B 5/117 (2016.01); G01S 5/18 (2006.01); G01S 5/28 (2006.01); G01S 13/72 (2006.01); G06F 1/3206 (2019.01); G06F 1/3231 (2019.01); G06F 1/324 (2019.01); G06F 3/01 (2006.01); G06F 3/03 (2006.01); G06F 3/0482 (2013.01); G06F 3/04842 (2022.01); G06F 3/16 (2006.01); G06F 18/20 (2023.01); G06F 18/25 (2023.01); G06F 18/28 (2023.01); G06F 18/40 (2023.01); G06F 21/32 (2013.01); G06F 21/35 (2013.01); G06F 40/211 (2020.01); G06F 40/35 (2020.01); G06N 5/025 (2023.01); G06N 5/047 (2023.01); G06N 20/00 (2019.01); G06T 7/246 (2017.01); G06T 7/292 (2017.01); G06T 7/60 (2017.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06V 10/94 (2022.01); G06V 20/40 (2022.01); G06V 20/52 (2022.01); G06V 20/64 (2022.01); G06V 30/262 (2022.01); G06V 40/10 (2022.01); G06V 40/16 (2022.01); G06V 40/20 (2022.01); G07C 9/28 (2020.01); G08B 13/14 (2006.01); G10L 15/02 (2006.01); G10L 15/06 (2013.01); G10L 15/08 (2006.01); G10L 15/18 (2013.01); G10L 15/19 (2013.01); G10L 15/24 (2013.01); G10L 15/26 (2006.01); G10L 15/28 (2013.01); G10L 15/32 (2013.01); G10L 17/04 (2013.01); G10L 17/08 (2013.01); G10L 25/51 (2013.01); H04L 9/40 (2022.01); H04L 51/02 (2022.01); H04L 67/12 (2022.01); H04L 67/50 (2022.01); H04N 7/18 (2006.01); H04N 21/231 (2011.01); H04N 21/422 (2011.01); H04N 21/442 (2011.01); H04N 23/11 (2023.01); H04N 23/611 (2023.01); H04R 1/40 (2006.01); H04R 3/00 (2006.01); H04W 4/029 (2018.01); H04W 4/33 (2018.01); A61B 5/05 (2021.01); G01S 5/16 (2006.01); G01S 11/14 (2006.01); G01S 13/38 (2006.01); G01S 13/86 (2006.01); G01S 13/88 (2006.01); G06F 3/0488 (2022.01); G06F 16/70 (2019.01); G06N 3/044 (2023.01); G07C 9/32 (2020.01); G08B 29/18 (2006.01); G10L 17/00 (2013.01); H04N 23/90 (2023.01)
CPC G01S 5/28 (2013.01) [A61B 5/0205 (2013.01); A61B 5/0507 (2013.01); A61B 5/1113 (2013.01); A61B 5/117 (2013.01); A61B 5/7475 (2013.01); G01S 5/18 (2013.01); G01S 13/726 (2013.01); G06F 1/3206 (2013.01); G06F 1/3231 (2013.01); G06F 1/324 (2013.01); G06F 3/011 (2013.01); G06F 3/017 (2013.01); G06F 3/0304 (2013.01); G06F 3/0482 (2013.01); G06F 3/04842 (2013.01); G06F 3/167 (2013.01); G06F 18/251 (2023.01); G06F 18/28 (2023.01); G06F 18/29 (2023.01); G06F 18/41 (2023.01); G06F 21/32 (2013.01); G06F 21/35 (2013.01); G06F 40/211 (2020.01); G06F 40/35 (2020.01); G06N 5/025 (2013.01); G06N 5/047 (2013.01); G06N 20/00 (2019.01); G06T 7/248 (2017.01); G06T 7/292 (2017.01); G06T 7/60 (2013.01); G06T 7/70 (2017.01); G06T 7/74 (2017.01); G06V 10/94 (2022.01); G06V 20/40 (2022.01); G06V 20/52 (2022.01); G06V 20/653 (2022.01); G06V 30/274 (2022.01); G06V 40/10 (2022.01); G06V 40/103 (2022.01); G06V 40/166 (2022.01); G06V 40/167 (2022.01); G06V 40/172 (2022.01); G06V 40/173 (2022.01); G06V 40/23 (2022.01); G06V 40/25 (2022.01); G07C 9/28 (2020.01); G08B 13/1427 (2013.01); G10L 15/02 (2013.01); G10L 15/063 (2013.01); G10L 15/08 (2013.01); G10L 15/18 (2013.01); G10L 15/1815 (2013.01); G10L 15/1822 (2013.01); G10L 15/19 (2013.01); G10L 15/22 (2013.01); G10L 15/24 (2013.01); G10L 15/26 (2013.01); G10L 15/28 (2013.01); G10L 15/32 (2013.01); G10L 17/04 (2013.01); G10L 17/08 (2013.01); G10L 25/51 (2013.01); H04L 51/02 (2013.01); H04L 63/102 (2013.01); H04L 67/12 (2013.01); H04L 67/535 (2022.05); H04N 7/181 (2013.01); H04N 7/188 (2013.01); H04N 21/231 (2013.01); H04N 21/42203 (2013.01); H04N 21/44218 (2013.01); H04N 21/44224 (2020.08); H04N 23/11 (2023.01); H04N 23/611 (2023.01); H04R 1/406 (2013.01); H04R 3/005 (2013.01); H04W 4/029 (2018.02); H04W 4/33 (2018.02); A61B 5/05 (2013.01); A61B 5/1118 (2013.01); G01S 5/16 (2013.01); G01S 11/14 (2013.01); G01S 13/38 (2013.01); G01S 13/867 (2013.01); G01S 13/888 (2013.01); G06F 3/0488 (2013.01); G06F 16/70 (2019.01); G06F 2203/0381 (2013.01); G06F 2221/2111 (2013.01); G06N 3/044 (2023.01); G06T 2207/10016 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20101 (2013.01); G06T 2207/30196 (2013.01); G06T 2207/30201 (2013.01); G06T 2207/30204 (2013.01); G06T 2207/30232 (2013.01); G06V 2201/05 (2022.01); G07C 9/32 (2020.01); G08B 29/186 (2013.01); G10L 2015/0635 (2013.01); G10L 2015/088 (2013.01); G10L 2015/223 (2013.01); G10L 2015/225 (2013.01); G10L 2015/228 (2013.01); G10L 17/00 (2013.01); H04N 23/90 (2023.01); Y02D 10/00 (2018.01)] 20 Claims
OG exemplary drawing
 
1. An intelligent assistant computer, comprising:
a logic machine; and
a storage machine holding instructions executable by the logic machine to:
recognize another intelligent assistant computer;
record speech spoken by a first user;
determine a self-selection score for the first user based on the speech spoken by the first user;
receive a remote-selection score for the first user from the other intelligent assistant computer;
if the self-selection score is greater than the remote-selection score, respond to the first user, determine a disengagement metric of the first user based on recorded speech spoken by the first user, and block subsequent responses to all other users until the disengagement metric of the first user exceeds a blocking threshold;
if the self-selection score is less than the remote-selection score, do not respond to the first user; and
stop blocking subsequent responses to another user responsive to a new self-selection score for the first user being less than a new remote-selection score for the first user.