US 11,666,222 B2
System and method for intraoperative video processing
Bradley Allan Fernald, Toronto (CA); Gal Sela, Toronto (CA); and Neil Jeffrey Witcomb, Toronto (CA)
Assigned to SYNAPTIVE MEDICAL INC., Toronto (CA)
Filed by SYNAPTIVE MEDICAL INC., Toronto (CA)
Filed on Jun. 2, 2021, as Appl. No. 17/337,125.
Application 17/337,125 is a continuation of application No. 16/432,404, filed on Jun. 5, 2019, granted, now 11,026,585.
Claims priority of provisional application 62/681,045, filed on Jun. 5, 2018.
Claims priority of provisional application 62/681,052, filed on Jun. 5, 2018.
Prior Publication US 2021/0282647 A1, Sep. 16, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06K 9/00 (2022.01); A61B 5/00 (2006.01); A61B 5/02 (2006.01); G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06T 7/90 (2017.01); A61B 5/103 (2006.01); H04N 5/445 (2011.01); G06F 18/211 (2023.01); G06V 10/56 (2022.01); G06V 10/20 (2022.01); G06V 20/52 (2022.01)
CPC A61B 5/0077 (2013.01) [A61B 5/004 (2013.01); A61B 5/02042 (2013.01); A61B 5/1032 (2013.01); A61B 5/7282 (2013.01); A61B 5/7425 (2013.01); G06F 18/211 (2023.01); G06T 7/0012 (2013.01); G06T 7/11 (2017.01); G06T 7/90 (2017.01); G06V 10/255 (2022.01); G06V 10/56 (2022.01); G06V 20/52 (2022.01); H04N 5/445 (2013.01); A61B 2505/05 (2013.01); A61B 2576/00 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/30008 (2013.01); G06T 2207/30096 (2013.01); G06T 2207/30101 (2013.01); G06V 2201/03 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A monitoring system for providing visual enhancements during a medical procedure, the system comprising:
a sensor for capturing visual information of a site during the medical procedure in real time, the sensor including a camera and the visual information including a video of a field-of-view (FOV) of the site during the medical procedure, the visual information comprising current visual information including a current frame of the video corresponding to a first point in time during the medical procedure;
a memory for storing at least a portion of the visual information as stored visual information, the stored visual information including one or more past frames of the video corresponding to at least a second point in time during the medical procedure prior to the first point in time;
a display for displaying at least the current visual information; and
a processor coupled to receive the current and stored visual information from the sensor and the memory, and coupled to transmit output data for display on the display, the processor being configured to:
analyze the current visual information at the first point in time and the stored visual information at the second point in time using a machine vision algorithm to segment an area of the site and identify the segmented area as a feature of interest;
generate feedback data associated with the feature of interest using the current visual information and the stored visual information; and
cause the display to display a virtual representation of the feedback data overlaid on the current visual information.