US 12,126,887 B2
Hyperspectral and fluorescence imaging with topology laser scanning in a light deficient environment
Joshua D. Talbert, Salt Lake City, UT (US); and Donald M. Wichern, Ogden, UT (US)
Assigned to Cilag GmbH International, Zug (CH)
Filed by Cilag GmbH International, Zug (CH)
Filed on Oct. 24, 2019, as Appl. No. 16/663,270.
Claims priority of provisional application 62/864,181, filed on Jun. 20, 2019.
Prior Publication US 2020/0404131 A1, Dec. 24, 2020
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 23/56 (2023.01); A61B 1/00 (2006.01); A61B 1/04 (2006.01); A61B 1/045 (2006.01); A61B 1/06 (2006.01); A61B 5/00 (2006.01); A61B 5/026 (2006.01); A61B 5/0275 (2006.01); G06T 5/50 (2006.01); H04N 23/50 (2023.01)
CPC H04N 23/56 (2023.01) [A61B 1/0005 (2013.01); A61B 1/00172 (2013.01); A61B 1/00186 (2013.01); A61B 1/043 (2013.01); A61B 1/045 (2013.01); A61B 1/0638 (2013.01); A61B 5/0261 (2013.01); A61B 5/0275 (2013.01); A61B 5/4887 (2013.01); A61B 5/489 (2013.01); A61B 5/4893 (2013.01); G06T 5/50 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/10068 (2013.01); G06T 2207/10152 (2013.01); G06T 2207/20221 (2013.01); H04N 23/555 (2023.01)] 24 Claims
OG exemplary drawing
 
1. A system comprising:
an emitter that emits a plurality of pulses of electromagnetic radiation;
an image sensor comprising a pixel array that senses reflected electromagnetic radiation; and
a controller comprising a processor in electrical communication with the image sensor and the emitter;
wherein the controller synchronizes timing of the plurality of pulses of electromagnetic radiation during a blanking period of the pixel array; and
wherein the pixel array senses the reflected electromagnetic radiation to generate a plurality of exposure frames that correspond in time with the plurality of pulses of electromagnetic radiation;
wherein the plurality of exposure frames comprises a laser mapping exposure frame sensed in response to the emitter pulsing electromagnetic radiation in a laser mapping pattern;
wherein the plurality of exposure frames further comprises one or more of:
a multispectral exposure frame comprising data corresponding to a spectral response, wherein the pixel array senses the multispectral exposure frame in response to the emitter pulsing a wavelength of electromagnetic radiation that elicits the spectral response; or
a fluorescence exposure frame comprising data corresponding to a fluorescence relaxation wavelength, wherein the pixel array senses the fluorescence exposure frame in response to the emitter pulsing a fluorescence excitation wavelength of electromagnetic radiation; and
wherein the laser mapping exposure frame comprises data for determining a surface topology of one or more objects within a scene and one or more of:
a distance between two or more objects within the scene;
a dimension of an object within the scene; or
an angle between two or more objects within the scene.