US 11,935,641 B2
Using multiple modalities of surgical data for comprehensive data analytics of a surgical procedure
Jagadish Venkataraman, Menlo Park, CA (US); and Pablo Garcia Kilroy, Menlo Park, CA (US)
Assigned to Verb Surgical Inc., Santa Clara, CA (US)
Filed by Verb Surgical Inc., Santa Clara, CA (US)
Filed on Oct. 4, 2021, as Appl. No. 17/493,589.
Application 17/493,589 is a continuation of application No. 16/418,790, filed on May 21, 2019, granted, now 11,139,062.
Prior Publication US 2022/0028525 A1, Jan. 27, 2022
Int. Cl. G16H 30/40 (2018.01); G06F 16/45 (2019.01); G16H 20/40 (2018.01); G16H 40/40 (2018.01)
CPC G16H 20/40 (2018.01) [G06F 16/45 (2019.01); G16H 30/40 (2018.01); G16H 40/40 (2018.01)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented method for performing comprehensive data analytics for a surgical procedure, the method comprising:
receiving two or more modalities of surgical data acquired from multiple data sources during a surgical procedure, wherein receiving the two or more modalities of surgical data includes:
receiving a real-time video feed which captures an anatomy containing an anomaly from inside of a patient's body; and
receiving image data which captures the anatomy from outside of the patient's body;
time-synchronizing the two or more modalities of surgical data to generate two or more modalities of time-synchronized surgical data;
converting each modality of the time-synchronized surgical data into a corresponding array of values of a common format;
combining the two or more arrays of values corresponding to the two or more modalities to generate a combined set of values;
performing comprehensive data analytics on the combined set of values to generate a surgical decision for the surgical procedure, wherein performing the comprehensive data analytics on the combined set of values includes translating an identifiable location of the anomaly in the image data to a corresponding location on the anatomy within the real-time video feed; and
highlighting the corresponding location within the real-time video feed.