| CPC A61B 1/0005 (2013.01) [A61B 1/00006 (2013.01); A61B 1/00009 (2013.01); A61B 1/000094 (2022.02); A61B 1/000096 (2022.02); A61B 1/00011 (2013.01); A61B 1/00045 (2013.01); A61B 1/00052 (2013.01); A61B 1/307 (2013.01); G06T 7/0012 (2013.01); G06T 2207/10068 (2013.01); G06T 2207/30081 (2013.01)] | 20 Claims |

|
1. A method, comprising:
receiving, by a processor, an imagery from an endoscope imaging a cavity having a feature, wherein the imagery depicts the feature;
performing, by the processor, a classification for the feature while the endoscope images the cavity;
determining, by the processor, a confidence metric for the classification while the endoscope images the cavity;
determining, by the processor, a motion vector for the endoscope imaging the cavity while the endoscope images the cavity; and
taking, by the processor, an action based on the classification, the confidence metric, and the motion vector,
wherein at least one of:
(a) wherein the action includes deploying an end effector within the cavity being imaged by the endoscope;
(b) wherein the motion vector is determined based on a motion signal of a housing associated with the endoscope, wherein the housing hosts a display simultaneously presenting the imagery and at least two of the classification, the confidence metric, or the motion vector over the imagery while the endoscope images the cavity;
(c) wherein the imagery depicts at least a portion of an end effector deployed within the cavity while the endoscope images the cavity; or
(d) further comprising:
receiving, by the processor, a user input selecting a procedure identifier; and
retrieving, by the processor, a model corresponding to the procedure identifier, wherein the classification is based on the imagery being compared with the model.
|