US 9,984,505 B2
Display of text information on a head-mounted display
Noam Rimon, San Mateo, CA (US); and Jeffrey Roger Stafford, San Mateo, CA (US)
Assigned to Sony Interactive Entertainment Inc., Tokyo (JP)
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Sep. 30, 2014, as Appl. No. 14/503,196.
Prior Publication US 2016/0093105 A1, Mar. 31, 2016
Int. Cl. G06T 19/00 (2011.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06T 11/60 (2006.01); G06F 3/041 (2006.01); G06F 3/0488 (2013.01); G06F 3/0484 (2013.01)
CPC G06T 19/006 (2013.01) [G02B 27/017 (2013.01); G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/041 (2013.01); G06F 3/0488 (2013.01); G06F 3/04845 (2013.01); G06T 11/60 (2013.01); G02B 2027/0178 (2013.01); G06F 2203/04806 (2013.01)] 30 Claims
OG exemplary drawing
 
1. A method for presenting text information on a head-mounted display, comprising:
rendering a view of a virtual environment to the head-mounted display;
tracking an orientation of the head-mounted display;
tracking a gaze of a user of the head-mounted display;
processing the gaze of the user and the orientation of the head-mounted display, to identify a gaze target in the virtual environment towards which the gaze of the user is directed;
receiving text information for rendering on the head-mounted display;
responsive to receiving the text information, rendering in the virtual environment a virtual device in place of a handheld device held by the user, so that when the gaze of the user defines a real world view direction towards the handheld device then the virtual device is rendered in place of the handheld device in the virtual environment as presented through the head-mounted display, and presenting the text information on the virtual device in the virtual environment in a vicinity of the gaze target, wherein the virtual device is maneuverable in the virtual environment in response to detected movement of the handheld device, such that movement of the virtual device in the virtual environment is tracked to the detected movement of the handheld device.