US 12,333,644 B2
Image display method, display control device, and recording medium for displaying shape image of subject and coordinates estimated from two-dimensional coordinates in reference image projected thereon
Yohei Sakamoto, Hachioji (JP)
Assigned to Evident Corporation, Nagano (JP)
Filed by Evident Corporation, Nagano (JP)
Filed on Feb. 20, 2024, as Appl. No. 18/582,072.
Application 18/582,072 is a continuation of application No. 17/504,930, filed on Oct. 19, 2021, granted, now 11,941,749.
Claims priority of application No. 2020-180445 (JP), filed on Oct. 28, 2020.
Prior Publication US 2024/0193852 A1, Jun. 13, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 15/20 (2011.01); G06T 7/70 (2017.01); F02C 7/00 (2006.01)
CPC G06T 15/205 (2013.01) [G06T 7/70 (2017.01); F02C 7/00 (2013.01); F05D 2260/80 (2013.01); G06T 2207/10068 (2013.01); G06T 2207/30108 (2013.01); G06T 2207/30244 (2013.01)] 33 Claims
OG exemplary drawing
 
1. An image display method comprising:
a selection step in which a processor selects two or more two-dimensional images of a subject from an image group including a plurality of two-dimensional images of the subject;
an estimation step in which the processor estimates a camera coordinate indicating three-dimensional coordinates of a camera that acquired each of the two or more two-dimensional images on the basis of the two or more two-dimensional images and estimates three-dimensional coordinates of two or more points of the subject on the basis of the camera coordinate;
a generation step in which the processor generates a three-dimensional model on the basis of the three-dimensional coordinates of the two or more points of the subject; and
a display step in which the processor displays a three-dimensional image on a display,
wherein the three-dimensional image visualizes a position indicated by at least one of the camera coordinate and a set of three-dimensional coordinates of one or more points of the subject calculated on the basis of the camera coordinate,
wherein, in the display step, the processor:
projects two-dimensional coordinates of one or more points of a region of the subject seen in a reference image onto the three-dimensional model to estimate corresponding one or more coordinates on the three-dimensional model; and
displays a shape image showing the three-dimensional model seen from a viewpoint different from the camera coordinate, the one or more coordinates on the three-dimensional model estimated from the two-dimensional coordinates of the one or more points of the region of the subject seen in the reference image projected onto the three dimensional model.