US 11,782,569 B2
Contextual triggering of assistive functions
Kristin A. Gray, San Mateo, CA (US); Tim Wantland, Pacifica, CA (US); Matthew Stokes, Hancock, NH (US); Bingying Xia, Mountain View, CA (US); Karen Vertierra, Mountain View, CA (US); Melissa Barnhart, Pacifica, CA (US); and Gus Winkleman, Mountain View, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Jul. 26, 2021, as Appl. No. 17/443,352.
Prior Publication US 2023/0026521 A1, Jan. 26, 2023
Int. Cl. G06F 3/0482 (2013.01); G06F 3/04812 (2022.01); H04W 4/38 (2018.01); H04W 4/029 (2018.01); G06F 3/04847 (2022.01); G06F 3/0488 (2022.01); G06F 3/16 (2006.01)
CPC G06F 3/04812 (2013.01) [G06F 3/0482 (2013.01); G06F 3/0488 (2013.01); G06F 3/04847 (2013.01); G06F 3/167 (2013.01); H04W 4/029 (2018.02); H04W 4/38 (2018.02)] 22 Claims
OG exemplary drawing
 
12. A system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
while a user device is using a first presentation mode comprising a visual-based presentation mode to present content to a user of the user device:
receiving sensor data captured by the user device, the sensor data conveying an orientation and proximity of the user device relative to a face of the user;
obtaining a current state of the user of the user device based on the sensor data;
determining that the current state of the user indicates that the user is:
performing a current activity of reading the content presented to the user using the first presentation mode; and
approaching a potential hazard to the user; and
based on determining that the current state of the user indicates that the user is performing the current activity of reading, providing, as output from a user interface of the user device:
a user-selectable option that when selected causes the user device to use a second presentation mode comprising an audio-based presentation mode to present the content to the user; and
a warning to the user, the warning notifying the user of the potential hazard; and
in response to receiving a user input indication indicating selection of the user-selectable option, continuing to present the content to the user of the user device by initiating presentation of the content using the second presentation mode and the first presentation mode in parallel.