US 11,941,749 B2
Image display method, display control device, and recording medium for displaying shape image of subject and coordinates estimated from two-dimensional coordinates in reference image projected thereon
Yohei Sakamoto, Hachioji (JP)
Assigned to Evident Corporation, Nagano (JP)
Filed by Evident Corporation, Nagano (JP)
Filed on Oct. 19, 2021, as Appl. No. 17/504,930.
Claims priority of application No. 2020-180445 (JP), filed on Oct. 28, 2020.
Prior Publication US 2022/0130105 A1, Apr. 28, 2022
Int. Cl. G06T 15/20 (2011.01); G06T 7/70 (2017.01); F02C 7/00 (2006.01)
CPC G06T 15/205 (2013.01) [G06T 7/70 (2017.01); F02C 7/00 (2013.01); F05D 2260/80 (2013.01); G06T 2207/10068 (2013.01); G06T 2207/30108 (2013.01); G06T 2207/30244 (2013.01)] 30 Claims
OG exemplary drawing
 
1. An image display method comprising:
a storage step in which a processor causes a storage medium to store three-dimensional data generated on the basis of two or more two-dimensional images of a subject,
wherein the three-dimensional data include three-dimensional coordinates of two or more points of the subject and a first camera coordinate, the first camera coordinate indicating three-dimensional coordinates of a first camera that acquires each of the two or more two-dimensional images, the first camera coordinate being associated with each of the two or more two-dimensional images;
a first selection step in which the processor selects a reference image that is a two-dimensional image of the subject;
a second selection step in which the processor selects at least one of the two or more two-dimensional images as a selected image on the basis of the reference image;
an estimation step in which the processor estimates, on the basis of the first camera coordinate associated with the selected image, a second camera coordinate that is previously unknown, the second camera coordinate indicating three-dimensional coordinates of a second camera that acquired the reference image; and
a display step in which the processor;
projects two-dimensional coordinates of one or more points of a region of the subject seen in the reference image onto a three-dimensional model of the subject to estimate corresponding one or more coordinates on the three-dimensional model;
generates a shape image showing the three-dimensional model of the subject seen from a viewpoint different from the second camera coordinate, the one or more coordinates on the three-dimensional model estimated from the two-dimensional coordinates of the one or more points of the region of the subject seen in the reference image projected onto the three-dimensional model; and
displays the shape image on a display.