CPC A61B 1/00006 (2013.01) [A61B 1/000096 (2022.02); A61B 34/25 (2016.02); A61B 34/35 (2016.02); A61B 34/74 (2016.02); A61B 34/76 (2016.02); G06T 7/0012 (2013.01); A61B 1/04 (2013.01); A61B 34/20 (2016.02); A61B 2034/305 (2016.02); A61B 2034/743 (2016.02)] | 20 Claims |
1. A computer-implemented method for generating a haptic feedback based on a surgical video containing interactions between surgical tools and their surrounding environment, the method comprising:
receiving a surgical video of a surgical procedure;
processing the surgical video to detect a type of surgical tool interaction that is captured in the surgical video;
applying a machine learning model to one or more video images in the surgical video, the one or more video image being associated with the detected type of surgical tool interaction, and wherein the machine learning model when applied to the one or more video images predicts a target interaction between a surgical tool and its surrounding environment; and
outputting the predicted target interaction to a surgeon performing the surgical procedure as a haptic feedback signal.
|