US 11,956,415 B2
Head mounted display apparatus
Osamu Kawamae, Kyoto (JP); Kenichi Shimada, Tokyo (JP); Manabu Katsuki, Kyoto (JP); and Megumi Kurachi, Kyoto (JP)
Assigned to MAXELL, LTD., Kyoto (JP)
Filed by MAXELL, LTD., Kyoto (JP)
Filed on Jan. 5, 2023, as Appl. No. 18/150,431.
Application 18/150,431 is a continuation of application No. 17/299,114, granted, now 11,582,441, previously published as PCT/JP2018/044569, filed on Dec. 4, 2018.
Prior Publication US 2023/0156176 A1, May 18, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 13/344 (2018.01); G02B 27/01 (2006.01); G06T 19/00 (2011.01); H04N 13/239 (2018.01); H04N 13/279 (2018.01)
CPC H04N 13/344 (2018.05) [G02B 27/0172 (2013.01); G06T 19/006 (2013.01); H04N 13/239 (2018.05); H04N 13/279 (2018.05); G02B 2027/0129 (2013.01); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01)] 5 Claims
OG exemplary drawing
 
1. A head mounted display apparatus comprising:
a first lens configured to display a CG image for a right eye;
a second lens configured to display a CG image for a left eye;
a first camera configured to capture an image for the right eye;
a second camera configured to capture an image for the left eye;
an information processor configured to generate the CG image for the right eye in which occlusion at a time of seeing by the right eye is expressed and the CG image for the left eye in which occlusion at a time of seeing by the left eye is expressed, based on the images captured by the first camera and the second camera, project the generated CG image for the right eye onto the first lens, and project the generated CG image for the left eye onto the second lens; and
a communication interface configured to acquire an application which provides image generation data used for generation of the CG image,
wherein the information processor includes:
a first information generator configured to generate occlusion information indicating a shielding relationship between the CG image to be displayed on the first lens and a real environment based on the images captured by the first camera and the second camera;
a second information generator configured to generate occlusion information indicating a shielding relationship between the CG image to be displayed on the second lens and the real environment based on the images captured by the first camera and the second camera;
a first shielded region calculator configured to calculate a shielded region in which the CG image displayed on the first lens is shielded by an object when the CG image is seen by the right eye, based on the occlusion information generated by the first information generator;
a second shielded region calculator configured to calculate a shielded region in which the CG image displayed on the second lens is shielded by the object when the CG image is seen by the left eye, based on the occlusion information generated by the second information generator;
an image generator configured to generate the CG image for the right eye in which the shielded region calculated by the first shielded region calculator is not displayed and the CG image for the left eye in which the shielded region calculated by the second shielded region calculator is not displayed, based on the CG image generation data provided from the application; and
a display configured to project the CG image for the right eye and the CG image for the left eye generated by the image generator onto the first lens and the second lens, respectively,
wherein the occlusion information generated by the first information generator and the second information generator includes a blur amount set in accordance with distance information provided from the application, and
wherein the image generator performs a process of blurring an outline of the CG image for the right eye in which the shielded region is not displayed and an outline of the CG image for the left eye in which the shielded region is not displayed, based on the blur amount acquired from the occlusion information.