CPC A61B 5/0077 (2013.01) [A61B 5/004 (2013.01); A61B 5/02042 (2013.01); A61B 5/1032 (2013.01); A61B 5/7282 (2013.01); A61B 5/7425 (2013.01); G06F 18/211 (2023.01); G06T 7/0012 (2013.01); G06T 7/11 (2017.01); G06T 7/90 (2017.01); G06V 10/255 (2022.01); G06V 10/56 (2022.01); G06V 20/52 (2022.01); H04N 5/445 (2013.01); A61B 2505/05 (2013.01); A61B 2576/00 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/30008 (2013.01); G06T 2207/30096 (2013.01); G06T 2207/30101 (2013.01); G06V 2201/03 (2022.01)] | 20 Claims |
1. A monitoring system for providing visual enhancements during a medical procedure, the system comprising:
a sensor for capturing visual information of a site during the medical procedure in real time, the sensor including a camera and the visual information including a video of a field-of-view (FOV) of the site during the medical procedure, the visual information comprising current visual information including a current frame of the video corresponding to a first point in time during the medical procedure;
a memory for storing at least a portion of the visual information as stored visual information, the stored visual information including one or more past frames of the video corresponding to at least a second point in time during the medical procedure prior to the first point in time;
a display for displaying at least the current visual information; and
a processor coupled to receive the current and stored visual information from the sensor and the memory, and coupled to transmit output data for display on the display, the processor being configured to:
analyze the current visual information at the first point in time and the stored visual information at the second point in time using a machine vision algorithm to segment an area of the site and identify the segmented area as a feature of interest;
generate feedback data associated with the feature of interest using the current visual information and the stored visual information; and
cause the display to display a virtual representation of the feedback data overlaid on the current visual information.
|