US 12,226,077 B2
Computer-readable medium contaning a program, method, and apparatus for generating a virtual endoscopic image and outputting operation assistance information
Akihiko Nishide, Tokyo (JP); and Junko Sugai, Kanagawa (JP)
Assigned to HOYA CORPORATION, Tokyo (JP)
Appl. No. 17/766,056
Filed by HOYA CORPORATION, Tokyo (JP)
PCT Filed Jan. 28, 2021, PCT No. PCT/JP2021/002954
§ 371(c)(1), (2) Date Apr. 1, 2022,
PCT Pub. No. WO2021/192593, PCT Pub. Date Sep. 30, 2021.
Claims priority of application No. 2020-056712 (JP), filed on Mar. 26, 2020.
Prior Publication US 2022/0351407 A1, Nov. 3, 2022
Int. Cl. G06K 9/00 (2022.01); A61B 1/005 (2006.01); G06T 7/70 (2017.01)
CPC A61B 1/009 (2022.02) [A61B 1/005 (2013.01); G06T 7/70 (2017.01); G06T 2207/10068 (2013.01); G06T 2207/10081 (2013.01); G06T 2207/10132 (2013.01)] 10 Claims
OG exemplary drawing
 
1. A non-transitory computer-readable medium containing a program causing a computer to execute processing comprising:
acquiring an endoscopic image of a subject from an endoscope;
acquiring a three-dimensional medical image obtained by capturing an image of an internal body portion of the subject by means of X-ray CT, X-ray cone beam CT, MRI-CT, or an ultrasonic diagnosis apparatus configured to capture a three-dimensional image of an internal body portion of the subject;
generating a virtual endoscopic image reconfigured from the three-dimensional medical image, based on the acquired endoscopic image;
calculating distance image information in the endoscopic image based on the virtual endoscopic image and the endoscopic image; and
outputting operation assistance information on an operation of the endoscope based on the distance image information and the three-dimensional medical image, wherein
the operation assistance information includes an insertion speed of the endoscope.