US 11,747,618 B2
Systems and methods for sign language recognition
Eric Browy, Meridian, ID (US); Michael Janusz Woods, Mountain View, CA (US); and Andrew Rabinovich, San Francisco, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Aug. 3, 2022, as Appl. No. 17/817,127.
Application 17/817,127 is a continuation of application No. 16/986,935, filed on Aug. 6, 2020, granted, now 11,410,392.
Application 16/986,935 is a continuation of application No. 16/801,684, filed on Feb. 26, 2020, granted, now 10,769,858, issued on Sep. 8, 2020.
Application 16/801,684 is a continuation of application No. 15/702,312, filed on Sep. 12, 2017, granted, now 10,580,213, issued on Mar. 3, 2020.
Claims priority of provisional application 62/440,320, filed on Dec. 29, 2016.
Claims priority of provisional application 62/394,013, filed on Sep. 13, 2016.
Prior Publication US 2022/0375177 A1, Nov. 24, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G02B 27/01 (2006.01); G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06F 1/16 (2006.01); G06F 3/03 (2006.01); G06F 40/58 (2020.01); G06V 20/20 (2022.01); G06V 40/20 (2022.01); G06F 3/16 (2006.01); G06T 7/70 (2017.01); G06V 30/10 (2022.01)
CPC G02B 27/017 (2013.01) [G02B 27/0172 (2013.01); G06F 1/163 (2013.01); G06F 1/1686 (2013.01); G06F 1/1688 (2013.01); G06F 3/011 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/0304 (2013.01); G06F 40/58 (2020.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); G06V 40/28 (2022.01); G02B 27/0179 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0141 (2013.01); G02B 2027/0178 (2013.01); G02B 2027/0187 (2013.01); G06F 3/16 (2013.01); G06T 7/70 (2017.01); G06T 2207/20084 (2013.01); G06V 30/10 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A wearable display device, comprising:
a frame configured to be wearable on a head of a user, the frame configured to support a display in front of an eye of the user;
the display, comprising a plurality of waveguides configured to present virtual content to the eye of the user with various levels of wavefront curvature, such that the virtual content appears to be at a plurality of different depth planes;
one or more cameras configured to generate one or more images of at least a portion of an environment of the user; and
processing electronics configured to:
receive the one or more images from the one or more cameras;
identify, in the one or more images, at least one physical object in the environment of the user;
determine that the at least one physical object includes text comprising one or more letters or characters in a first language and, in response, generate modified text that includes a translation of at least a portion of the text from the first language to a second language;
generate a virtual representation of the at least one physical object comprising the modified text at a selected depth plane of the plurality of different depth planes such that the virtual representation appears closer to the user than a distance of the at least one physical object from the user, wherein the selected depth plane at which to present the virtual representation is selected from among the plurality of different depth planes based at least partly on the distance of the at least one physical object from the user; and
render the virtual representation of the at least one physical object using the display.