US 12,133,715 B2
Hyperspectral and fluorescence imaging and topology laser mapping with minimal area monolithic image sensor
Joshua D. Talbert, Cottonwood Heights, UT (US); and Donald M. Wichern, Ogden, UT (US)
Assigned to Cilag GmbH International, Zug (CH)
Filed by Cilag GmbH International, Zug (CH)
Filed on Jul. 28, 2022, as Appl. No. 17/815,745.
Application 17/815,745 is a continuation of application No. 17/177,811, filed on Feb. 17, 2021, granted, now 11,399,717, issued on Aug. 2, 2022.
Application 17/177,811 is a continuation of application No. 16/673,829, filed on Nov. 4, 2019, granted, now 10,952,619, issued on Mar. 23, 2021.
Claims priority of provisional application 62/864,194, filed on Jun. 20, 2019.
Prior Publication US 2022/0378294 A1, Dec. 1, 2022
Int. Cl. A61B 5/00 (2006.01); A61B 1/04 (2006.01); A61B 5/0275 (2006.01); H04N 9/64 (2023.01); H04N 13/00 (2018.01); H04N 13/15 (2018.01); H04N 23/50 (2023.01); H04N 23/54 (2023.01); H04N 23/72 (2023.01)
CPC A61B 5/0071 (2013.01) [A61B 1/043 (2013.01); A61B 5/0062 (2013.01); A61B 5/0275 (2013.01); A61B 5/4887 (2013.01); A61B 5/489 (2013.01); A61B 5/4893 (2013.01); H04N 9/646 (2013.01); H04N 13/15 (2018.05); H04N 23/54 (2023.01); H04N 23/72 (2023.01); H04N 2013/0081 (2013.01); H04N 23/555 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
actuating an emitter in a light deficient environment to cycle a plurality of electromagnetic sources according to a variable pulse cycle to emit a plurality of pulses of electromagnetic radiation wherein the plurality of electromagnetic sources comprises:
a visible source that pulses a visible wavelength of electromagnetic radiation;
a source that pulses one or more wavelengths of electromagnetic radiation for generating mapping data; and
a plurality of spectral sources that each pulses electromagnetic radiation within a waveband that is selected for spectral imaging;
accumulating electromagnetic radiation with an image sensor that comprises a pixel array;
generating a plurality of exposure frames that each correspond to one or more pulses of electromagnetic radiation by the emitter, wherein at least a portion of the plurality of exposure frames comprises:
a visible exposure frame corresponding to the visible wavelength of electromagnetic radiation,
a mapping exposure frame comprising the mapping data and corresponding to the one or more wavelengths for generating mapping data, and
a spectral exposure frame comprising spectral imaging data and corresponding to a spectral response elicited by a wavelength from the one or more spectral sources;
generating, by a black clamp circuit, offset control for data generated by the pixel array;
wherein the mapping data comprises three-dimensional data about one or more of a distance from an endoscope or a tool to an object, surface area information about the object, a size of one or more surgical tools, a size of one or more structures, a size of one or more anatomical structures, or other positional data and metrics about the object within the light deficient environment;
wherein data from one or more of the mapping exposure frame or the spectral exposure frame are combined with data from the visible exposure frame to generate an overlay frame to visualize one or more of the mapping data or the spectral imaging data;
wherein the variable pulse cycle is adjustable based on one or more of user input or exposure of a scene.