US 11,948,575 B2
Dynamically assigning multi-modality circumstantial data to assistant action requests for correlating with subsequent requests
Andrew Gallagher, Fremont, CA (US); Caroline Pantofaru, San Carlos, CA (US); Vinay Bettadapura, San Jose, CA (US); and Utsav Prabhu, Pittsburgh, PA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Jan. 12, 2023, as Appl. No. 18/096,446.
Application 18/096,446 is a continuation of application No. 17/548,972, filed on Dec. 13, 2021, granted, now 11,557,295.
Application 17/548,972 is a continuation of application No. 16/613,686, granted, now 11,200,898, issued on Dec. 14, 2021, previously published as PCT/US2019/034930, filed on May 31, 2019.
Prior Publication US 2023/0169974 A1, Jun. 1, 2023
Int. Cl. G10L 15/22 (2006.01); G10L 15/24 (2013.01); H04R 1/40 (2006.01); H04R 3/00 (2006.01)
CPC G10L 15/22 (2013.01) [G10L 15/24 (2013.01); H04R 1/406 (2013.01); H04R 3/005 (2013.01); G10L 2015/223 (2013.01); G10L 2015/228 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
receiving audio data that is captured via one or more microphones of a computing device, wherein the audio data captures a spoken utterance, of a user, that is directed to an automated assistant of the computing device;
determining, based on processing the audio data:
that the spoken utterance requests performance, by the automated assistant, of an action, and
that the user is non-authenticated;
causing performance of the action in response to determining that the spoken utterance requests performance of the action;
in response to determining that the user is non-authenticated:
storing, only transiently until one or more purge conditions are satisfied, circumstantial data and an association of the circumstantial data to the action, the circumstantial data characterizing one or more circumstantial conditions associated with the user providing the spoken utterance;
receiving, at the computing device and prior to the one or more purge conditions being satisfied, further user interface input;
comparing the circumstantial data, stored in association with the action, to further circumstantial data characterizing one or more circumstantial conditions associated with the further user interface input; and
in response to the comparing indicating a threshold degree of similarity:
causing performance of a further action that is based on both the further user interface input and the action.