US 12,299,908 B2
Multi-modal system for visualization and analysis of surgical specimens
Ralph S. Dacosta, Etobicoke (CA); Kathryn Ottolino-Perry, Toronto (CA); and Christopher Gibson, Toronto (CA)
Assigned to University Health Network, Toronto (CA)
Appl. No. 17/423,597
Filed by University Health Network, Toronto (CA)
PCT Filed Jan. 17, 2020, PCT No. PCT/IB2020/050381
§ 371(c)(1), (2) Date Jul. 16, 2021,
PCT Pub. No. WO2020/148722, PCT Pub. Date Jul. 23, 2020.
Claims priority of provisional application 62/793,715, filed on Jan. 17, 2019.
Prior Publication US 2022/0108461 A1, Apr. 7, 2022
Int. Cl. G06T 7/33 (2017.01); G01N 21/64 (2006.01); G06T 7/38 (2017.01); G16H 30/40 (2018.01)
CPC G06T 7/33 (2017.01) [G01N 21/6456 (2013.01); G06T 7/38 (2017.01); G16H 30/40 (2018.01); G06T 2207/10028 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/10064 (2013.01); G06T 2207/10081 (2013.01); G06T 2207/10088 (2013.01); G06T 2207/10101 (2013.01); G06T 2207/10136 (2013.01); G06T 2207/30024 (2013.01); G06T 2207/30096 (2013.01); G06T 2207/30204 (2013.01)] 85 Claims
OG exemplary drawing
 
1. A method of generating a three-dimensional image of a target using two-dimensional images obtained within an enclosed environment, comprising:
while a target is positioned within the enclosed environment:
generating a three-dimensional map of a target area associated with one or more fiducial markers;
capturing a two-dimensional white light image of the target area and the one or more fiducial markers;
capturing a two-dimensional fluorescence image of the target area and the one or more fiducial markers;
creating a three-dimensional white light image from the two-dimensional white light image and the three-dimensional map;
creating a three-dimensional fluorescence image from the two-dimensional fluorescence image and the three-dimensional map; and
aligning the three-dimensional white light image and the three-dimensional fluorescence image using the one or more fiducial markers to form a three-dimensional superimposed image.