US 12,277,262 B1
User comfort monitoring and notification
Akiko Ikkai, San Jose, CA (US); Grant H. Mulliken, Los Gatos, CA (US); Izzet B. Yildiz, Sunnyvale, CA (US); and Sterling R. Crispin, Santa Cruz, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Aug. 18, 2023, as Appl. No. 18/235,558.
Application 18/235,558 is a continuation of application No. 17/845,412, filed on Jun. 21, 2022, granted, now 11,762,457.
Application 17/845,412 is a continuation of application No. 17/030,622, filed on Sep. 24, 2020, abandoned.
Application 18/235,558 is a continuation of application No. 17/030,622, filed on Sep. 24, 2020, abandoned.
Claims priority of provisional application 62/991,273, filed on Mar. 18, 2020.
Claims priority of provisional application 62/907,124, filed on Sep. 27, 2019.
Int. Cl. G06F 3/01 (2006.01); G06V 40/16 (2022.01)
CPC G06F 3/012 (2013.01) [G06F 3/015 (2013.01); G06V 40/174 (2022.01)] 21 Claims
OG exemplary drawing
 
1. A method comprising:
at a device comprising a processor and a display:
presenting a multimedia environment;
obtaining a first set of data regarding a body via a first sensor, wherein the first set of data corresponds to a facial expression;
obtaining a second set of data regarding physiological data via a second sensor, wherein the second set of data corresponds to a physiological response during the presentation of the multimedia environment;
determining a comfort state while viewing the multimedia environment based on: i) decoding facial expressions and ii) identifying the physiological response as being associated with the comfort state by detecting a change in a sound of a user while the user is speaking; and
updating the multimedia environment based on determining the comfort state.