US 12,342,082 B2
Program, information processing method, and endoscope system for generating a composite endoscopic image
Akihiko Nishide, Tokyo (JP); and Junko Sugai, Kanagawa (JP)
Assigned to HOYA CORPORATION, Tokyo (JP)
Appl. No. 18/019,911
Filed by HOYA CORPORATION, Tokyo (JP)
PCT Filed Sep. 6, 2021, PCT No. PCT/JP2021/032584
§ 371(c)(1), (2) Date Feb. 6, 2023,
PCT Pub. No. WO2022/070782, PCT Pub. Date Apr. 7, 2022.
Claims priority of application No. 2020-167752 (JP), filed on Oct. 2, 2020.
Prior Publication US 2023/0353879 A1, Nov. 2, 2023
Int. Cl. H04N 23/698 (2023.01); G06T 5/50 (2006.01); G06T 5/80 (2024.01); H04N 13/106 (2018.01)
CPC H04N 23/698 (2023.01) [G06T 5/50 (2013.01); G06T 5/80 (2024.01); H04N 13/106 (2018.05)] 12 Claims
OG exemplary drawing
 
9. An information processing method that causes a computer to execute processing comprising:
acquiring endoscopic images obtained by capturing images of a subject by a plurality of imaging units arranged on an end surface and a peripheral surface of a tubular distal end portion provided in an insertion portion of an endoscope;
generating a composite image obtained by combining a plurality of the captured endoscopic images so as to form a view of an entire circumferential direction including a front visual field and a rear visual field with respect to the distal end portion;
acquiring an insertion distance and a rotation angle of the endoscope inserted into a body of the subject at a time point when the endoscopic images are captured; and
outputting the composite image in association with the acquired insertion distance and rotation angle of the endoscope;
generating a plurality of the composite images based on the endoscopic images captured at a plurality of time points;
generating a stereoscopic image in which a plurality of the endoscopic images captured in different visual field directions is arranged for a same observation site in the body of the subject based on the plurality of the composite images, the generating of the stereoscopic image comprising:
dividing each of the plurality of the composite images by each visual field direction, and
aligning the respective divided composite images based on the rotation angle of the endoscope and joining the images according to the insertion distance of the endoscope; and
outputting the generated stereoscopic image.