US 12,324,648 B2
Assisting medical procedures with luminescence images processed in limited informative regions identified in corresponding auxiliary images
Giovanni Valbusa, Colleretto Giacosa (IT); and Adrian Taruttis, Munich (DE)
Assigned to SurgVision GmbH, Munich (DE)
Appl. No. 17/801,218
Filed by SurgVision GmbH, Munich (DE)
PCT Filed Feb. 19, 2021, PCT No. PCT/EP2021/054162
§ 371(c)(1), (2) Date Aug. 19, 2022,
PCT Pub. No. WO2021/165471, PCT Pub. Date Aug. 26, 2021.
Claims priority of application No. 20158847 (EP), filed on Feb. 21, 2020.
Prior Publication US 2022/0409057 A1, Dec. 29, 2022
Int. Cl. A61B 5/00 (2006.01); G06T 5/40 (2006.01); G06T 5/92 (2024.01); G06T 5/94 (2024.01); G06T 7/11 (2017.01); G06T 7/136 (2017.01); G06T 7/174 (2017.01); G06T 7/187 (2017.01); G06T 7/194 (2017.01); G06V 10/26 (2022.01); G06V 10/28 (2022.01); G06V 10/50 (2022.01); G06V 10/60 (2022.01); G06V 10/764 (2022.01); G06V 10/77 (2022.01)
CPC A61B 5/0071 (2013.01) [G06T 5/40 (2013.01); G06T 5/92 (2024.01); G06T 5/94 (2024.01); G06T 7/11 (2017.01); G06T 7/136 (2017.01); G06T 7/174 (2017.01); G06T 7/187 (2017.01); G06T 7/194 (2017.01); G06V 10/267 (2022.01); G06V 10/28 (2022.01); G06V 10/507 (2022.01); G06V 10/60 (2022.01); G06V 10/764 (2022.01); G06V 10/7715 (2022.01); A61B 5/7267 (2013.01); A61B 2505/05 (2013.01); A61B 2576/00 (2013.01); G06T 2207/10064 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30004 (2013.01); G06T 2207/30096 (2013.01); G06V 2201/034 (2022.01)] 24 Claims
OG exemplary drawing
 
1. A method for imaging a region of interest of a patient fora medical procedure performed thereon,
wherein the method comprises, under the control of a computing device:
acquiring, by the computing device, a luminescence image of a field of view containing the region of interest, the region of interest comprising at least one target body of the medical procedure containing a luminescence substance, and one or more foreign objects different from the region of interest, the luminescence image comprising a plurality of luminescence values representative of a luminescence light being emitted by the luminescence substance at corresponding luminescence locations of the field of view,
acquiring, by the computing device, an auxiliary image of the field of view, the auxiliary image comprising a plurality of auxiliary values representative of an auxiliary light, different from the luminescence light, being received from corresponding auxiliary locations of the field of view,
segmenting, by the computing device, the auxiliary values of the auxiliary image semantically into at least one region of interest class defining an auxiliary informative region representative of the region of interest without the foreign objects and one or more foreign object classes defining a non-informative region representative of the foreign objects,
identifying, by the computing device, the luminescence values of the luminescence image defining a luminescence informative region corresponding to the auxiliary values of the auxiliary informative region of the auxiliary image,
generating, by the computing device, a processed luminescence image by processing the luminescence image limited to the luminescence informative region, the processed luminescence image comprising a plurality of processed luminescence values being based on the luminescence values of the luminescence informative region, wherein the processed luminescence image provides a further representation of the target body facilitating an identification thereof, and
displaying, by the computing device an output image base on the processed luminescence image substantially in real-time with said acquiring the luminescence image.