US 11,877,065 B2
Image rotation in an endoscopic hyperspectral imaging system
Joshua D. Talbert, Salt Lake City, UT (US); and Donald M. Wichern, Ogden, UT (US)
Assigned to Cilag GmbH International, Zug (CH)
Filed by Cilag GmbH International, Zug (CH)
Filed on Mar. 3, 2020, as Appl. No. 16/807,785.
Claims priority of provisional application 62/864,245, filed on Jun. 20, 2019.
Prior Publication US 2020/0402228 A1, Dec. 24, 2020
Int. Cl. G06T 7/00 (2017.01); H04N 23/73 (2023.01); A61B 1/04 (2006.01); A61B 1/06 (2006.01); G06T 7/77 (2017.01); H04N 13/254 (2018.01); A61B 1/00 (2006.01); A61B 1/045 (2006.01); H04N 23/72 (2023.01); H04N 23/84 (2023.01); H04N 25/11 (2023.01); A61B 5/00 (2006.01); A61B 5/20 (2006.01); A61B 5/026 (2006.01); H04N 23/50 (2023.01)
CPC H04N 23/73 (2023.01) [A61B 1/0005 (2013.01); A61B 1/00057 (2013.01); A61B 1/000095 (2022.02); A61B 1/00194 (2022.02); A61B 1/043 (2013.01); A61B 1/045 (2013.01); A61B 1/0638 (2013.01); A61B 1/0646 (2013.01); A61B 1/0653 (2013.01); A61B 1/0655 (2022.02); A61B 1/0676 (2013.01); G06T 7/0012 (2013.01); G06T 7/77 (2017.01); H04N 13/254 (2018.05); H04N 23/72 (2023.01); H04N 23/84 (2023.01); H04N 25/11 (2023.01); A61B 1/063 (2013.01); A61B 5/0075 (2013.01); A61B 5/0261 (2013.01); A61B 5/20 (2013.01); A61B 5/489 (2013.01); A61B 5/4887 (2013.01); A61B 5/4893 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/10036 (2013.01); G06T 2207/30096 (2013.01); G06T 2207/30104 (2013.01); H04N 23/555 (2023.01)] 26 Claims
OG exemplary drawing
 
1. An endoscopic system for use in a light deficient environment comprising:
an emitter that emits a plurality of pulses of electromagnetic radiation for illuminating a surgical scene;
an image sensor comprising a pixel array that senses reflected electromagnetic radiation, wherein the image sensor is disposed within a lumen of an endoscope;
a rotation sensor that detects an angle of rotation of the endoscope; and
a controller in electronic communication with the emitter and the image sensor;
wherein at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises:
a first multispectral emission comprising electromagnetic radiation within a first waveband; and
a second multispectral emission comprising electromagnetic radiation within a second waveband;
wherein the first waveband is different from the second waveband;
wherein the image sensor senses the reflected electromagnetic radiation to generate a first multispectral frame in response to the emitter pulsing the first multispectral emission;
wherein the image sensor senses the reflected electromagnetic radiation to generate a second multispectral frame in response to the emitter pulsing the second multispectral emission;
wherein the controller is configured to synchronize timing of the pulses of electromagnetic radiation during a blanking period of the image sensor; and
wherein at least one of the first waveband or the second waveband is selected to identify one or more of a tissue condition, a tissue type, a disease, a biological process, or a chemical process.