CPC G02B 27/017 (2013.01) [G02B 27/0172 (2013.01); G06F 1/163 (2013.01); G06F 1/1686 (2013.01); G06F 1/1688 (2013.01); G06F 3/011 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/0304 (2013.01); G06F 40/58 (2020.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); G06V 40/28 (2022.01); G02B 27/0179 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0141 (2013.01); G02B 2027/0178 (2013.01); G02B 2027/0187 (2013.01); G06F 3/16 (2013.01); G06T 7/70 (2017.01); G06T 2207/20084 (2013.01); G06V 30/10 (2022.01)] | 20 Claims |
1. A wearable display device, comprising:
a frame configured to be wearable on a head of a user, the frame configured to support a display in front of an eye of the user;
the display, comprising a plurality of waveguides configured to present virtual content to the eye of the user with various levels of wavefront curvature, such that the virtual content appears to be at a plurality of different depth planes;
one or more cameras configured to generate one or more images of at least a portion of an environment of the user; and
processing electronics configured to:
receive the one or more images from the one or more cameras;
identify, in the one or more images, at least one physical object in the environment of the user;
determine that the at least one physical object includes text comprising one or more letters or characters in a first language and, in response, generate modified text that includes a translation of at least a portion of the text from the first language to a second language;
generate a virtual representation of the at least one physical object comprising the modified text at a selected depth plane of the plurality of different depth planes such that the virtual representation appears closer to the user than a distance of the at least one physical object from the user, wherein the selected depth plane at which to present the virtual representation is selected from among the plurality of different depth planes based at least partly on the distance of the at least one physical object from the user; and
render the virtual representation of the at least one physical object using the display.
|