US 12,076,183 B2
Image processing device and image display method
Katsuhiko Shimizu, Fujinomiya (JP); Yasukazu Sakamoto, Hiratsuka (JP); and Ryosuke Saga, Osaka (JP)
Assigned to TERUMO KABUSHIKI KAISHA, Tokyo (JP); and ROKKEN INC., Sakai (JP)
Appl. No. 17/043,055
Filed by TERUMO KABUSHIKI KAISHA, Tokyo (JP); and Rokken Inc., Sakai (JP)
PCT Filed Mar. 27, 2019, PCT No. PCT/JP2019/013473
§ 371(c)(1), (2) Date Sep. 29, 2020,
PCT Pub. No. WO2019/189518, PCT Pub. Date Oct. 3, 2019.
Claims priority of application No. 2018-066170 (JP), filed on Mar. 29, 2018.
Prior Publication US 2021/0015452 A1, Jan. 21, 2021
Int. Cl. A61B 8/12 (2006.01); A61B 8/00 (2006.01); A61B 8/08 (2006.01)
CPC A61B 8/12 (2013.01) [A61B 8/0891 (2013.01); A61B 8/463 (2013.01); A61B 8/466 (2013.01); A61B 8/5215 (2013.01)] 6 Claims
OG exemplary drawing
 
1. An image processing device comprising:
a motor that is connected with a peripheral information acquisition device located inside a tubular member and is configured to move the peripheral information acquisition device along an extending direction of the tubular member, the peripheral information acquisition device being configured to emit an ultrasound wave or light toward a periphery of the tubular member inside an organ or a blood vessel and acquire a reflected ultrasound wave or reflected light as peripheral information;
a memory; and
a processor configured to:
sequentially generate two-dimensional images based on the peripheral information acquired by the peripheral information acquisition device;
generate a three-dimensional image of the organ or the blood vessel based on the two-dimensional images sequentially generated;
store, in the memory, position correspondence information indicating respective positions along a predetermined coordinate axis inside the three-dimensional image that correspond to positions of the motor or image correspondence information associating the respective positions along the predetermined coordinate axis inside the three-dimensional image with the two-dimensional images sequentially generated;
determine a position, from among the respective positions along the predetermined coordinate axis inside the three-dimensional image, corresponding to a current position of the peripheral information acquisition device based on the position correspondence information or the image correspondence information stored in the memory;
generate, in real time, display information including a first display area in which a two-dimensional image generated based on the peripheral information acquired by the peripheral information acquisition device at the current position is displayed, and a second display area in which the determined position corresponding to the current position of the peripheral information acquisition device is identified and displayed along with the three-dimensional image; and
update, in a case where the display information is previously displayed and the peripheral information acquisition device has moved, the display information such that a newly determined position corresponding to a position to which the peripheral information acquisition device has moved is identified and displayed in the second display area while a two-dimensional image generated based on the peripheral information acquired by the peripheral information acquisition device at the position to which the peripheral information acquisition device has moved is displayed in the first display area.