US 11,711,502 B2
Method of outputting three-dimensional image and electronic device performing the method
Seok Lee, Hwaseong-si (KR); Juyong Park, Seongnam-si (KR); and Dong Kyung Nam, Yongin-si (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Jun. 29, 2021, as Appl. No. 17/361,936.
Application 17/361,936 is a continuation of application No. 16/446,102, filed on Jun. 19, 2019, granted, now 11,070,782.
Claims priority of application No. 10-2018-0153425 (KR), filed on Dec. 3, 2018.
Prior Publication US 2021/0329210 A1, Oct. 21, 2021
Int. Cl. G06T 7/70 (2017.01); G06T 15/00 (2011.01); G06T 15/20 (2011.01); H04N 13/117 (2018.01); H04N 13/366 (2018.01); G02B 27/01 (2006.01); B60K 35/00 (2006.01); H04N 13/00 (2018.01)
CPC H04N 13/117 (2018.05) [G02B 27/0101 (2013.01); G06T 15/005 (2013.01); H04N 13/366 (2018.05); B60K 35/00 (2013.01); B60K 2370/1529 (2019.05); B60K 2370/1531 (2019.05); B60K 2370/31 (2019.05); B60K 2370/334 (2019.05); G02B 2027/014 (2013.01); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01); G06T 7/70 (2017.01); G06T 15/205 (2013.01); H04N 2013/0081 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method performed by an electronic device for outputting a three-dimensional (3D) image, the method comprising:
obtaining eye position information of a user in a coordinate system of a display panel;
calculating virtual viewpoints of the user with respect to an optical system based on the eye position information and optical system information corresponding to the optical system;
transforming the coordinate system of the display panel into a graphic space coordinate system;
setting at least two viewpoints within the graphic space coordinate system based on the eye position information;
setting an object to be output within the graphic space coordinate system by transforming a pose of the object into the graphic space coordinate system;
generating a stereo image with respect to the object to be output on a virtual screen based on the at least two viewpoints set within the graphic space coordinate system; and
rendering a 3D image based on the virtual viewpoints and the stereo image to the user through the optical system,
wherein the graphic space coordinate system is a global coordinate system of a virtual 3D space corresponding to a real space of a system including the electronic device, and
wherein the generating the stereo image comprises:
setting a first plane and a second plane within a pyramidal structure with respect to each of the at least two viewpoints within the graphic space coordinate system;
generating frustum information based on the first plane and the second plane;
determining the pose of the object based on pose information of a system in which the user is present; and
generating the stereo image based on the frustum information and the object set within the graphic space coordinate system.