US 12,477,076 B2
Image synthesis device for electronic mirror and method thereof
Hideyuki Tsutsumitake, Yokohama (JP)
Assigned to Kabushiki Kaisha Toshiba, Tokyo (JP)
Filed by Kabushiki Kaisha Toshiba, Tokyo (JP)
Filed on Jun. 3, 2024, as Appl. No. 18/731,446.
Application 18/731,446 is a division of application No. 18/459,788, filed on Sep. 1, 2023, granted, now 12,041,375.
Application 18/459,788 is a continuation of application No. 17/729,080, filed on Apr. 26, 2022, granted, now 11,800,045, issued on Oct. 24, 2023.
Application 17/729,080 is a continuation of application No. 17/323,033, filed on May 18, 2021, granted, now 11,356,618, issued on Jun. 7, 2022.
Application 17/323,033 is a continuation of application No. 16/661,439, filed on Oct. 23, 2019, granted, now 11,044,421, issued on Jun. 22, 2021.
Application 16/661,439 is a continuation of application No. 15/659,725, filed on Jul. 26, 2017, granted, now 10,506,178, issued on Dec. 10, 2019.
Claims priority of application No. 2017-008584 (JP), filed on Jan. 20, 2017.
Prior Publication US 2024/0323311 A1, Sep. 26, 2024
Int. Cl. H01L 29/94 (2006.01); B60R 1/26 (2022.01); G06T 3/4038 (2024.01); G06T 11/00 (2006.01); G06T 11/60 (2006.01); H04N 5/262 (2006.01); H04N 5/272 (2006.01); H04N 7/18 (2006.01); H04N 23/81 (2023.01); H04N 23/90 (2023.01)
CPC H04N 5/2628 (2013.01) [B60R 1/26 (2022.01); G06T 3/4038 (2013.01); G06T 11/001 (2013.01); G06T 11/60 (2013.01); H04N 5/272 (2013.01); H04N 7/181 (2013.01); H04N 23/811 (2023.01); H04N 23/90 (2023.01); B60R 2300/105 (2013.01); B60R 2300/303 (2013.01); B60R 2300/306 (2013.01); B60R 2300/8046 (2013.01); B60R 2300/8066 (2013.01)] 8 Claims
OG exemplary drawing
 
1. An image synthesis method, using an image synthesis device including a first camera, a second camera, a projective transformation module, and a synthesis module, the method comprising:
obtaining a first image by the first camera;
obtaining a second image by the second camera;
projectively transforming the first image to generate a complimentary image by the projective transformation module;
superimposing the complimentary video on a part of the second image by the synthesis module;
replacing a position of each pixel on a reference plane set by a viewpoint of the first camera with a position of a respective corresponding pixel on a first virtual plane by the projective transformation module;
converting the position of each pixel on the first virtual plane to a position of a respective corresponding pixel on a second virtual plane set by a viewpoint of the second camera;
determining a position of the complimentary image on the second virtual plane by a distance from the first camera to the reference plane set by the viewpoint; and
adjusting, when a shift occurs between the complimentary image and the second image due to the distance to the reference plane, the distance from the viewpoint of the first camera to the reference plane.