US 12,277,361 B2
Wearable device for facilitating enhanced interaction
Jonathan Ive, San Francisco, CA (US); Julian Hoenig, Lisbon (PT); Julian Jaede, San Jose, CA (US); Seung Wook Kim, San Jose, CA (US); Chris Wilson, San Francisco, CA (US); William A. Sorrentino, III, Mill Valley, CA (US); Alan C. Dye, San Francisco, CA (US); and Stephen O. Lemay, Cupertino, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 25, 2023, as Appl. No. 18/372,659.
Application 18/372,659 is a continuation of application No. 16/010,373, filed on Jun. 15, 2018, granted, now 11,861,255.
Claims priority of provisional application 62/521,184, filed on Jun. 16, 2017.
Prior Publication US 2024/0012600 A1, Jan. 11, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/14 (2006.01); G06T 3/18 (2024.01); G06T 11/00 (2006.01); G06T 11/60 (2006.01); G06V 20/20 (2022.01); G06V 40/16 (2022.01)
CPC G06F 3/1423 (2013.01) [G06T 11/60 (2013.01); G06V 20/20 (2022.01); G06V 40/174 (2022.01); G06T 3/18 (2024.01); G06T 11/001 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A head-mounted device comprising:
a housing;
a wearer-facing camera positioned in the housing and configured to capture a first image of a portion of a wearer's face;
an outward-facing display positioned in the housing and configured to display a second image of the portion of the wearer's face, the second image based on the captured first image;
an outward-facing sensing system configured to:
detect a lighting condition of an environment surrounding the head-mounted device; and
determine a position of an external observer relative to the outward-facing display, wherein the position of the external observer relative to the outward-facing display changes over time; and
a processor operatively coupled to the wearer-facing camera, the outward-facing display, and the outward-facing sensing system and configured to produce the second image of the portion of the wearer's face by:
modifying the captured first image based at least in part on the detected lighting condition of the environment surrounding the head-mounted device; and
repeatedly modifying the captured first image based at least in part on the position of the external observer relative to the outward-facing display as the position of the external observer relative to the outward-facing display changes over time.